Mobile app version of vmapp.org
Login or Join
Jessie594

: My website ranks well but my blog subdirectory keeps getting de-indexed My website, let's say www.example.com ranks fairly well ranking 1-5 for 6 keywords. On the other hand, my blog on the

@Jessie594

Posted in: #GoogleIndex #GoogleSearchConsole #SearchEngines #Wordpress

My website, let's say example.com ranks fairly well ranking 1-5 for 6 keywords. On the other hand, my blog on the same website keeps on getting de-indexed.

The Website is HTML (www.example.com), and the blog (www.example.com/blog) is hosted on WordPress.

Some information about the blog:
It has extremely good quality original content, got ~700 views organically for each individual blog post. So there's no chance of a copied content or a Google penalty. Google webmasters still shows no message.

There are no server crashes. As hosting is same for both website and blog, we can rule out the possibility of de-indexing because of server crashes.

There's no .htaccess file.

I checked Robots.txt for possible mistake that might have been blocking the search engines. I even cross checked the url using GWT's testing tool that says domain.com/blog is not blocked by robots.txt

I have a sitemap.xml.

Although, I am yet to set the preference for www or non www for my domain in GWT. But this isn't something that should have resulted in de-indexing.

I am using for the entire site including blog. While all page appear to be secure, blog does have some sources which are not secure. But, the blog has been that way since a year and nothing happened.

Also, when I add url to fetch as Google, the submit to index option doesn't shows up.

NOTE: My Wordpress settings mistakenly were set to stop search engines from indexing the blog. I changed that a month ago, the blog was indexed, but the pages were not. Shortly, the blog got de-indexed again, I re-indexed it, and got de-indexed again, while other pages never got indexed.

Now the blog is not indexed, however, one of the blog post is indexed. But a google search display the meta description as
"A description for this result is not available because of this site's robots.txt – learn more."

What should I do now? I have tried everything. Nothing seems to work.

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Jessie594

1 Comments

Sorted by latest first Latest Oldest Best

 

@Harper822

Is only your blog in Wordpress?

Anyway: it can happen that there's a conflicting setup in robots.txt, due to plugins (SEO plugins and plugins dedicated to robots.txt) and Wordpress settings mismatch.
Try access your robots.txt file from the main folder


example.com/robots.txt

and even your blog folder


example.com/blog/robots.txt

Then, from Google Webmaster Tools go to robots.txt tester. Click on the option to look at robots.txt on the website, so you can see which robots.txt is GWT really looking at.

I hope you are just blocking /wp-content/plugins/ folder from access, and nothing else.

What about your sitemap? Do you have only one of it in main folder (or at least only one index)? Is it properly linking your blog resources?
Use Yoast plugin for sitemap, is very well done.

Also, you should find wordpress .htaccess in its main folder. So, if only the blog is hosted by Wordpress, look with FTP client like FileZilla (not cPanel file manager) in /blog/ folder.

Try to crawl your website using other online tester or software like Screaming Frog.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme