Author Topic: Why SEO Tests Are Usually Invalid  (Read 7202 times)

ukgimp

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2241
    • View Profile
Why SEO Tests Are Usually Invalid
« on: July 08, 2011, 11:50:35 AM »
One for Colin here:

http://www.seo-theory.com/2011/07/08/why-seo-experiments-are-almost-always-invalid/

Quote
Neither test was sophisticated and both fail to prove or disprove anything

It does get on my t##s when people claim fact with terrible stats and no control etc. And I suspect my annoyance is minimal comparred to Captain Colin.

4Eyes

  • Hero Member
  • *****
  • Posts: 817
    • View Profile
    • Email
Re: Why SEO Tests Are Usually Invalid
« Reply #1 on: July 08, 2011, 12:48:16 PM »
Damn right - so many variables that people seem to ignore when testing.

I think the main point is that there are very few 'definites' that can be proven by testing - but what you can get is useful data which, if you are prepared to think in terms of 'probabllities' rather than true/false, will help along the way.

Bad testing is pretty much worthless - but not as bad as not testing at all.

Drastic

  • Need a bigger hammer...
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3087
  • Resident Redneck
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #2 on: July 08, 2011, 01:16:38 PM »
You know, this place would be perfect for an seo test bed setup. We could determine which tests would be most important, best way to set them up, and then each participant manage their own % of tests to run. Keys, urls and info would be shared out in the open, ongoing, so all participants could see setup, results, control, etc.

4Eyes

  • Hero Member
  • *****
  • Posts: 817
    • View Profile
    • Email
Re: Why SEO Tests Are Usually Invalid
« Reply #3 on: July 08, 2011, 01:38:27 PM »
Thats a good idea - if enough people want to do some testing

... of course, if it is just you and me, then maybe we should only let the others see the data if they send us a drink :)

Rumbas

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2106
  • Viking Wrath
    • MSN Messenger - rasmussoerensen@hotmail.com
    • AOL Instant Messenger - seorasmus
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #4 on: July 08, 2011, 01:51:15 PM »
I'm in :)

Drastic

  • Need a bigger hammer...
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3087
  • Resident Redneck
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #5 on: July 08, 2011, 03:03:23 PM »
Couple of quick thoughts:

1) someone needs to take the helm. (not me)

2) to see the data you need to participate (private area only for those who are doing the testing) We can share general results in inner core if we want. This encourages people to participate, and we don't have to expose urls to those who aren't doing the same.

JamesR

  • Full Member
  • ***
  • Posts: 206
    • View Profile
    • Email
Re: Why SEO Tests Are Usually Invalid
« Reply #6 on: July 08, 2011, 11:08:23 PM »
Trying to test factors and variables that occur offsite is probably futile.  There are lots of simple tests that can be run on site.  We've been having a lot of success with G Site Optimizer combined with Double Click for Publishers and their fine geotargeting capabilities.

4Eyes

  • Hero Member
  • *****
  • Posts: 817
    • View Profile
    • Email
Re: Why SEO Tests Are Usually Invalid
« Reply #7 on: July 09, 2011, 07:49:39 AM »
Quote
Trying to test factors and variables that occur offsite is probably futile

I don't agree James - you can devise tests that pretty much 'rule out' certain types of links and techniques - of course, nothings perfect, and as time is a factor, and the tests take time, you are never going to get a definitive result - but that is not what we need - all we need is 'an edge', a probability that certain techniques work better than others, and a probability, say, that mass spamming directories has very little effect.

Drastic

  • Need a bigger hammer...
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 3087
  • Resident Redneck
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #8 on: July 09, 2011, 12:27:18 PM »
So, that's only 3 of us interested?

Gurtie

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1628
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #9 on: July 09, 2011, 01:41:21 PM »
I'm interested but I don't have much which available to help at the moment. If I can, I'm happy to.

ukgimp

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2241
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #10 on: July 09, 2011, 07:11:45 PM »
Me too if I can

agerhart

  • Global Moderator
  • Full Member
  • *****
  • Posts: 233
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #11 on: July 09, 2011, 10:16:36 PM »
I'm game

grnidone

  • Inner Core
  • Hero Member
  • *
  • Posts: 1649
    • Yahoo Instant Messenger - e
    • View Profile
    • Email
Re: Why SEO Tests Are Usually Invalid
« Reply #12 on: July 11, 2011, 05:58:40 PM »
I absolutely think this is a good thing to do, and will do what I can to support the cause.  Unfortunately, I cannot lead something like this...and we need a leader atm.

Rupert

  • Inner Core
  • Hero Member
  • *
  • Posts: 3354
  • George in a previous life.
    • View Profile
    • SuitsMen
Re: Why SEO Tests Are Usually Invalid
« Reply #13 on: July 15, 2011, 07:57:25 AM »
Well, that's 8 but no leader.  Usual SEO group scenario eh?  ::)
... Make sure you live before you die.

Gurtie

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1628
    • View Profile
Re: Why SEO Tests Are Usually Invalid
« Reply #14 on: July 15, 2011, 08:00:08 AM »
<everyone looks at Col>