Author Topic: Study: 39% Of Google Search Referrers Now “Not Provided”  (Read 5741 times)

bill

  • Devil's Avocado
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1286
  • Avast!
    • View Profile
    • Email
Study: 39% Of Google Search Referrers Now “Not Provided”
« on: November 14, 2012, 02:24:52 AM »
Quote
Study: 39% Of Google Search Referrers Now “Not Provided”

It is just over a year since Google began encrypting search by default for signed-in users. A new study finds that as a result, 39% search-related traffic from Google to web sites now has search terms withheld.

Problem is to see this data now you apparently have to use Google Analytics and attach your account to Google Webmaster Tools. They've got us by the short-hairs.

Rumbas

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2106
  • Viking Wrath
    • MSN Messenger - rasmussoerensen@hotmail.com
    • AOL Instant Messenger - seorasmus
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #1 on: November 14, 2012, 11:38:14 AM »
That's becoming a huge problem. On some sites where we have everything setup and connected to Google, we still see a significant number of not provided.

Chunkford

  • Inner Core
  • Hero Member
  • *
  • Posts: 1057
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #2 on: November 14, 2012, 11:56:31 AM »
It pains me.

Most of my keyword discovery is based on this info as it's really the only factual data I can base my decisions on.
There rest is just guess work. And I hate wasting money on guess work :(
"If my answers frighten you then you should cease asking scary questions"

IrishWonder

  • Inner Core
  • Hero Member
  • *
  • Posts: 561
    • View Profile
    • IrishWonder's SEO Consulting
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #3 on: November 14, 2012, 02:27:48 PM »


Problem is to see this data now you apparently have to use Google Analytics and attach your account to Google Webmaster Tools. They've got us by the short-hairs.
And even that doesn't help - they will still show as not provided

Now if, on the other hand, you used AdWords...
It's all a money milking scheme, no more no less

Rumbas

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 2106
  • Viking Wrath
    • MSN Messenger - rasmussoerensen@hotmail.com
    • AOL Instant Messenger - seorasmus
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #4 on: November 14, 2012, 03:24:45 PM »
>Now if, on the other hand, you used AdWords...

Or pony up and get the Corp Analytics version and you're good to go.

IrishWonder

  • Inner Core
  • Hero Member
  • *
  • Posts: 561
    • View Profile
    • IrishWonder's SEO Consulting
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #5 on: November 14, 2012, 04:31:13 PM »
But were you referring to the Corp version when you said on some sites you still get not provided?

Adam C

  • Inner Core
  • Hero Member
  • *
  • Posts: 622
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #6 on: November 14, 2012, 05:35:34 PM »
sounds like - from the following post - GA premium doesn't have any more clarity on "not provided" keywords...

http://www.cloudshapes.co.uk/posts/not-provided-ga-premium-chrome-future/


Gurtie

  • Global Moderator
  • Hero Member
  • *****
  • Posts: 1628
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #7 on: November 14, 2012, 05:46:26 PM »
I graphed this the other day - on average for our clients we see 17% not provided, but that's risen from less than 1% in a quite steady line over the past 7 months.  It also seems to be still climbing, no signs of any type of slowdown.......

rcjordan

  • I'm consulting the authorities on the subject
  • Global Moderator
  • Hero Member
  • *****
  • Posts: 16345
  • Debbie says...
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #8 on: November 14, 2012, 06:31:56 PM »
Now, if I were a consultant like some here, I'd see this as an opportunity.  You are among the best-educated regarding se referral sources on the planet. Who better to provide sight for the soon-to-be blind?

ergophobe

  • Inner Core
  • Hero Member
  • *
  • Posts: 9293
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #9 on: November 15, 2012, 04:04:07 AM »
I'm surprised it's that LOW actually. I swear last I looked most sites I know are already higher.

>> opportunity

Maybe for the short term, but this data will soon just be gone almost entirely. I don't see how leaving webmasters blind improves the user experience.

Adam C

  • Inner Core
  • Hero Member
  • *
  • Posts: 622
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #10 on: November 15, 2012, 09:46:06 AM »
any idea how this affects services like Hitwise that get their data from ISPs?

Preumably ISPs will see see upstream secure traffic, something like

Request 1:  google.com

which redirects to

Request 2: https://www.google.com/

Request 3: https://www.google.com/search?q=keyword

Request 4: http://www.yoursite.com/


So, Hitwise should be able to see the secure URL containing the query string as an upstream "referrer", is my guess.

That said, if you're already paying Hitwise the chances are you have enough traffic such that a 40% hit to the data still leaves you with a clear enough picture of the traffic you're getting.

TallTroll

  • Sr. Member
  • ****
  • Posts: 272
    • View Profile
    • Email
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #11 on: November 15, 2012, 11:37:39 AM »
In the long term, doesn't this hurt Google most of all though? If they won't provide the referral data, webmasters (of all sizes) will find it harder and harder to provide quality sites to Google... which impacts on their (already shaky) results quality. People started using Google because they had noticably better results than anyone else. If they eventually become noticably worse, users will just go elsewhere. There's a certain amount of user inertia to overcome, but ask Y! or AV what happens to an SE when it's no longer the shiniest tool in the box...

ergophobe

  • Inner Core
  • Hero Member
  • *
  • Posts: 9293
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #12 on: November 18, 2012, 08:11:56 PM »
Quote
Preumably ISPs will see see upstream secure traffic

The encryption is happening at the transport layer. So the ISP won't be able to decrypt the URL so they can't extract the data any more than you can. The ISP doesn't know what your GET parameters are. The only thing an intervening service between the client and the server knows is the destination hostname and the port number.

http://en.wikipedia.org/wiki/File:IP_stack_connections.svg
http://answers.google.com/answers/threadview/id/758002.html#answer
https://blog.httpwatch.com/2009/02/20/how-secure-are-query-strings-over-https/

eljefe3

  • Jr. Member
  • **
  • Posts: 90
    • View Profile
    • Email
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #13 on: November 20, 2012, 03:17:17 AM »
It's really frustrating not being able to see actual referrer data. What was google's spin on this as to why they now don't show referral data?

ergophobe

  • Inner Core
  • Hero Member
  • *
  • Posts: 9293
    • View Profile
Re: Study: 39% Of Google Search Referrers Now “Not Provided”
« Reply #14 on: November 20, 2012, 06:09:49 AM »
I haven't really researched this... so count this as hearsay, more or less....

They say that it's in the HTTP RFC (or the SSL RFC??)  that URLs not pass private data or some such thing and the search keywords are private data.

So in theory, if all your pages were served up as https and the connection between you and the user was full verified, it would be possible to pass the referrer and other data. Whether or not Google actually passes this data if it's a full https connection or not, I don't know. I also don't know whether even if it is https on your side whether it's really okay to pass private data from one domain to another.

http://googleblog.blogspot.com/2011/10/making-search-more-secure.html
http://www.wired.com/threatlevel/2011/10/google-search-https/

It's a bad change for webmasters and one can argue that over the long term it negatively impacts the user experience because we can't respond as well to what user's are looking for, but for the most part it is a good change for Google users.
« Last Edit: November 20, 2012, 06:13:23 AM by ergophobe »