The Core

Why We Are Here => Traffic => Topic started by: gm66 on February 19, 2018, 03:35:47 PM

Title: Wix site keyword extraction problem.
Post by: gm66 on February 19, 2018, 03:35:47 PM
I thought Wix had sorted all it's crawl-related probs but a potential client's sie can't have keywords extracted from it using either the keyword planner or keywordtool.io's 'analyse competitors' tool.

This is the site robots :

Disallow: /api/
Disallow: /bo/
Disallow: /editor.jsp
Disallow: /noflashhtml
Disallow: /siteBackHtml
Disallow: /wix/
Disallow: /wixpress/
Disallow: /wixdemo/
Disallow: /wix-editor/
Disallow: /editor2.jsp
Disallow: /flash/
Disallow: /flash-templates/
Disallow: /jobs/seo/
Disallow: /website-template/view/flash/
Disallow: /facebook-template/
Disallow: /facebook/templates/
Disallow: /website/templates/flash/
Disallow: /favicon.ico

No idea why i can't extract kw from it, no bots banned, anyone?
Title: Re: Wix site keyword extraction problem.
Post by: Drastic on February 19, 2018, 03:47:12 PM
You cannot properly SEO a wix site. Just take a look at the source code.
Title: Re: Wix site keyword extraction problem.
Post by: gm66 on February 19, 2018, 03:55:02 PM
I've got a couple of other clients on Wix and i can access all the usual on-page elements, they fixed a lot in 2016/17 and are far better than they usd to be. I had no problem running them through keyword tools.

Got no idea why i cant kw-extract from this one, he's using a non-flash site, i can crawl it with screaming frog etc.

Title: Re: Wix site keyword extraction problem.
Post by: ergophobe on February 19, 2018, 04:16:35 PM
Can you spoof the user agent and see what response you get?
Title: Re: Wix site keyword extraction problem.
Post by: creative666 on February 19, 2018, 07:05:05 PM
I had issues trying to crawl a Wix site with Screaming Frog a few months ago, I spoofed the UA to Google and it let me through  - when I told the client they moved away from Wix within 6 weeks as it was the final straw after a host of other problems that they went through