If you aren’t able to read the text in the picture, here is the full warning:
Google can read your entire website these days, and it doesn’t react well when you decide to block information. To be sure that your site receives the ranking it deserves, be open with your site’s content and let the spiders see what all of your site’s viewers see.
In the past, webmasters using WordPress were sometimes advised to prevent Google’s spiders from accessing their wp-includes directory and plugins directory. However, this is no longer necessary. As a matter of fact, it could actually harm your website by blocking the CSS and JS that Googlebot needs to render your site correctly.
In addition, the old practice of blocking your /wp-admin/ folder is a bad idea, because if you block it but still link to it a few times, people can find it using the query “inurl:wp-admin.” However, if you leave it unblocked, WordPress will include a robots meta x-http header on admin pages, which will prohibit Google from showing the pages in search results.
Tackling this issue may seem daunting at first, but it’s actually incredibly simple. All you need to do is edit your site’s robots.txt, removing any commands that block CSS and JS from Googlebot. If you see any of the following lines of code within your website’s robots.txt file, remove them:
- Disallow: /.js$*
- Disallow: /.inc$*
- Disallow: /.css$*
- Disallow: /.php$*
- Disallow: /wp-admin/ (for reasons noted above)
By removing these blockages, you’ll be providing Googlebot with the files it needs to fully render your site. After that, use the Fetch & Render tool to confirm that the bot is able to see the site in the same way that a human can see it. If it is still being blocked, the tool will let you know what further changes need to be made.
WNC-658001 (that’s the warning’s official and somewhat intimidating name, by the way) might have sent you into a tizzy at first, but we hope that we’ve quelled your fears. Following the simple instructions above, you can ensure that your website welcomes Googlebot with open arms.
Do you need help optimizing your site for Google’s spiders? You may want to contact 417 Marketing, an online marketing company based in Springfield, Missouri. We specialize in SEO (search engine optimization), and SEO-friendly web design. Click here to contact us.