Mobile app version of vmapp.org
Login or Join
Rivera981

: Googlebot ignore my new site I have the following situation: I had a blog (made using Joomla) that in some month was pretty indexed by Google. For some technical problem I have delete it and

@Rivera981

Posted in: #Google #Googlebot #RobotsTxt #Seo #WebCrawlers

I have the following situation: I had a blog (made using Joomla) that in some month was pretty indexed by Google.

For some technical problem I have delete it and I have newly created using WordPress (so it is a different site, only the URL it is the same) and I have reinserted manually all the articles.

Looking at my statistics I can see that there are many visitors that try to visit the old page (that now don't exist in the new site that have a different structure)

The problems are the following one: it seems to me that Google Bot try to visit only the old pages (that don't exist) but it is ignoring the new pages of the new site (consequently not the indexes)

Some day ago, I find that I have enabled the settings to deter search engines to index your site so I have change it and now, in theory, Google have to visit these pages and index it...

Why this is not happening? How can I solve it?

REQUIRED INFORMATIONS:

The URL of my site is: www.scorejava.com/
and this is my robots.txt content:

# If the Joomla site is installed within a folder such as at
# e.g. example.com/joomla/ the robots.txt file MUST be
# moved to the site root at e.g. example.com/robots.txt # AND the joomla folder name MUST be prefixed to the disallowed
# path, e.g. the Disallow rule for the /administrator/ folder
# MUST be changed to read Disallow: /joomla/administrator/
#
# For more information about the robots.txt standard, see:
# www.robotstxt.org/orig.html #
# For syntax checking, see:
# www.sxw.org.uk/computing/robots/check.html
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /images/
Disallow: /includes/
Disallow: /installation/
Disallow: /language/
Disallow: /libraries/
Disallow: /logs/
Disallow: /media/
Disallow: /modules/
Disallow: /plugins/
Disallow: /templates/
Disallow: /tmp/


The strange think is that in the robots.txt comment makes reference to Joomla and WordPress...maybe is still use the old robots.txt file of the previous website (that was in the same space)?

10.02% popularity Vote Up Vote Down


Login to follow query

More posts by @Rivera981

2 Comments

Sorted by latest first Latest Oldest Best

 

@BetL925

I use the following Wordpress plugins which might help you:


True Google 404 - Keeps track of 404 errors and tries to resolve the ones that it can through site search
Custom Permalinks - Lets you choose the URLs for your pages (you could rename the URLs to what they used to be under Joomla)
Quick Page/Post Redirect Plugin - Allows you specify other redirects from within the wordpress admin pages.
MDR Webmaster Tools - Lets you verify your site with Google Webmaster Tools so you can log in there and see problems.

10% popularity Vote Up Vote Down


 

@Bryan171

You can apply 301 redirect from old pages to new ones in order to giving access to robots and visitors to your articles from outside of your website.

Indeed, If a website put a link to one of your article and you don't redirect old URL to new one, visitor falls into a 404 error page and bots too (notification by Google in Google Webmaster Tools). With 301 redirect, visitor can access to the article. Moreover, robots like Googlebot will transfer PR of your old pages to the new ones and you can get back your positions in search engines index.

It's a win-win solution: visitors and SEO.

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme