Th3 Core
Welcome, Guest. Please login or register.
Did you miss your activation email?
September 20, 2017, 02:40:04 PM

Login with username, password and session length
News
Stats
49704 Posts in 6049 Topics by 186 Members
Latest Member: DavidBrown
Search:     Advanced search
* Home active threads unread threads Help Search Login Register
+  Th3 Core
|-+  Why We Are Here
| |-+  Web Development
| | |-+  Bulk index checking?
« previous next »
Pages: [1] Print
Author Topic: Bulk index checking?  (Read 462 times)
Rumbas
Global Moderator
Hero Member
*****
Posts: 1706

Viking Wrath

rasmussoerensen@hotmail.com seorasmus
View Profile
« on: May 18, 2017, 08:39:13 AM »

I often need to check a current sitemap against actual indexed pages on that domain. Eg. I need to ensure that all pages from the (xml) sitemap have crawled and indexed.
Could be done manually, but I got too many to check.

Any ideas, tools or services which - safely - can check a couple of thousand URLs?
Logged
Adam C
Inner Core
Sr. Member
*
Posts: 474


View Profile
« Reply #1 on: May 18, 2017, 10:39:53 AM »

http://urlprofiler.com/ + proxies
Logged
Rumbas
Global Moderator
Hero Member
*****
Posts: 1706

Viking Wrath

rasmussoerensen@hotmail.com seorasmus
View Profile
« Reply #2 on: May 18, 2017, 12:49:34 PM »

Thanks Adam.

Getting the same answers everywhere; eg. use proxies and a tool. Either Scrapebox or URLprofiler.com

Fired up: http://indexchecking.com/ and it did the job. As least my spots checks showed validity from the tool.
Logged
Drastic
Need a bigger hammer...
Global Moderator
Hero Member
*****
Posts: 2083

Resident Redneck


View Profile
« Reply #3 on: May 18, 2017, 01:16:35 PM »

Scrapebox will do it but with unreliable output, or it was last time I used it. Glad you found that, noted.
Logged
Pages: [1] Print 
« previous next »
Go to the Active page, the Unread page, or jump to:  

  Powered by SMF 1.1.20 | SMF © 2013, Simple Machines
Mercury design by Bloc