Author Topic: Bulk index checking?  (Read 2510 times)

Rumbas

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2103
  • Viking Wrath
    • MSN Messenger - rasmussoerensen@hotmail.com
    • AOL Instant Messenger - seorasmus
    • View Profile
Bulk index checking?
« on: May 18, 2017, 08:39:13 AM »
I often need to check a current sitemap against actual indexed pages on that domain. Eg. I need to ensure that all pages from the (xml) sitemap have crawled and indexed.
Could be done manually, but I got too many to check.

Any ideas, tools or services which - safely - can check a couple of thousand URLs?

Adam C

  • Inner Core
  • Hero Member
  • *
  • Posts: 617
    • View Profile
Re: Bulk index checking?
« Reply #1 on: May 18, 2017, 10:39:53 AM »

Rumbas

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2103
  • Viking Wrath
    • MSN Messenger - rasmussoerensen@hotmail.com
    • AOL Instant Messenger - seorasmus
    • View Profile
Re: Bulk index checking?
« Reply #2 on: May 18, 2017, 12:49:34 PM »
Thanks Adam.

Getting the same answers everywhere; eg. use proxies and a tool. Either Scrapebox or URLprofiler.com

Fired up: http://indexchecking.com/ and it did the job. As least my spots checks showed validity from the tool.

Drastic

  • Need a bigger hammer...
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3084
  • Resident Redneck
    • View Profile
Re: Bulk index checking?
« Reply #3 on: May 18, 2017, 01:16:35 PM »
Scrapebox will do it but with unreliable output, or it was last time I used it. Glad you found that, noted.