Mobile app version of vmapp.org
Login or Join
BetL925

: Google doesn't seem to crawl the homepage of my site I am rather new to the webmaster world but have run into a problem I can't seem to find a solution to. If I search for my site suleimanholdings.com

@BetL925

Posted in: #GoogleIndex #GoogleSearchConsole

I am rather new to the webmaster world but have run into a problem I can't seem to find a solution to. If I search for my site suleimanholdings.com the first results from my site are secondary pages instead of the homepage. I also tried to find the homepage by using "site:suleimanholdings.com" and was given about 7 results (the site is very small right now so that should be a low number) but the homepage isn't one of them.

The site is built using Meteor which does complicate crawling a bit however I installed a spiderable package that should take care of it, and it does seem to work as every page except the homepage will come up on Google for me.

I tried running a test through online curl to check the HTTP status and was given a 200 OK. Here are the rest of those results:


HTTP/1.1 200 OK
Vary: Accept-Encoding
Content-Type: text/html; charset=utf-8
Date: Wed, 12 Aug 2015 18:07:02 GMT
Connection: keep-alive
Transfer-Encoding: chunked


In addition I do have both the www and non-www options on my Google Webmaster Tools. I have created and submitted sitemaps and even individually fetched and rendered pages, then submitted them to the index. Strangely enough although the pages were submitted to the index and the sitemap was submitted, if I visit the section to see what pages or how many have been indexed it tells me that none at all have been indexed.

Why would just the homepage of site not be indexed by Google?

10.04% popularity Vote Up Vote Down


Login to follow query

More posts by @BetL925

4 Comments

Sorted by latest first Latest Oldest Best

 

@Marchetta884

This solution involves giving the crawler an HTML snapshot for dynamically created content.

For pages without fragments - see 3. in the link - these are handled using meta tags to indicate the dynamic content Once HTML snapshots exist the dynamic page will direct the googlebot and other crawlers there.

The sitemap should also give the HTML snapshots rather than the dynamic pages, allowing non-google search engines to crawl it too.

Once the Fetch as Google sees the HTML snapshot the Data Highlighter can be used as a quick way to highlight any structured data. This should also help SEO.

Edit
Websniffer results
Websniffer (an alternative to Fetch as google) shows a script is running before the fragment meta tag. Move the meta tag higher, then do Fetch as google.

Secondly, <meta name="fragment" content="!"> should not be in the HTML snapshot/ugle URL page since this actually tells the crawler to go elsewhere.

Once Fetch as google succeeds in returning the visible content it can take a few days at least before the search results are updated.

Edit 2
There appears to be a bug in Google webmaster tools which causes it to appear as if it isn't being crawled, even when the crawling and indexing do work, which is what seems to be the case here.

meteor SEO without spiderable is also possible

Setting the ugly URL for the HTML snapshot - looks correct

The instructions state that:


If a page has no hash fragments, but contains  in the  of the HTML, the crawler will transform the URL of this page fromdomain[:port]/path to domain[:port]/path?_escaped_fragment= (ordomain[:port]/path?queryparams to domain[:port]/path?queryparams&_escaped_fragment_= and will then access the transformed URL. For example, if www.example.com contains  in the head, the crawler will transform this URL into www.example.com?_escaped_fragment_= and fetch www.example.com?_escaped_fragment_= from the web server.


so the .htaccess or similar will need to be set to transform the URL suleimanholdings.com/path?escaped_fragment_= to automatically reach the ugly HTML. The home page ugly URL is suleimanholdings.com?_escaped_fragment_= which works.

10% popularity Vote Up Vote Down


 

@Harper822

I took a look at the visual and the source code of the page and agree that the home page has no content.

I also ran an additional test to run the page with javascript disabled and nothing appears on screen.

You may want to run your page though a bunch of SEO testing tools. Also, try having googlebot test your site in Webmaster tools, and if possible, download a text-only web browser and test your pages in that.

You want actual content on screen without the requirement of an external script or external file to load the content. It makes loading time much smaller that way.

10% popularity Vote Up Vote Down


 

@Ann8826881

Actually this is quite an easy one.

Your home page has no content. There is nothing for Google to chew on except the title tag. That is not enough. While the home page looks fantastic(!) (and it does by the way), search engines require content- at least enough to create a SERP link. In this case, you have not supplied the minimum for a SERP link.

You can take this in incremental stages. I suggest adding a description meta-tag at least to see if Google will at least create a SERP link for you. You can use the Google Search Console (application formerly know as Webmaster Tools [80's flashback anyone?]) and use Fetch as Google to refetch the page. This will happen right away, but may not hit the index for a while. Google will always revisit after the fetch with the Googlebot crawler a few hours or days and then index your home page properly.

If this is not enough, then I suggest some minimal content- an h1 tag and a paragraph. I rather suspect that just adding the description meta-tag should be enough. You may have to wait a while.

But know this. Because there is no content, the home page may never really rank for anything. Part of this is because your title tag is rather nondescript. I suggest at least making the title tag and description meta-tag the best they can be.

view-source:http://suleimanholdings.com/

<!DOCTYPE html>
<html>
<head>
<link rel="stylesheet" type="text/css" class="__meteor-css__" href="/d4c7cfcf445710b33c839278e1fcd641da7e874e.css?meteor_css_resource=true">


<script type="text/inject-data">%7B%22fast-render-data%22%3A%7B%22collectionData%22%3A%7B%22users%22%3A%5B%5B%7B%22_id%22%3A%22vpGcNX9zap9nXSo7H%22%7D%5D%5D%7D%2C%22subscriptions%22%3A%7B%7D%7D%7D</script>
<script type="text/javascript">__meteor_runtime_config__ = JSON.parse(decodeURIComponent("%7B%22meteorRelease%22%3A%22METEOR%401.1.0.3%22%2C%22PUBLIC_SETTINGS%22%3A%7B%22ga%22%3A%7B%22id%22%3A%22UA-62610011-1%22%7D%7D%2C%22ROOT_URL%22%3A%22http%3A%2F%2Fsuleimanholdings.com%22%2C%22ROOT_URL_PATH_PREFIX%22%3A%22%22%2C%22autoupdateVersion%22%3A%22aa4d4d0a62689c78dcf3e156a73fb3eb8d556344%22%2C%22autoupdateVersionRefreshable%22%3A%2213364f1b58a9e01cfdbb742f20d5385cb4847e1b%22%2C%22autoupdateVersionCordova%22%3A%22none%22%7D"));</script>

<script type="text/javascript" src="/47cdc2acdb58961b1e38a332a698031122ac41bb.js"></script>



<script id="irga-analytics" async src='//www.google-analytics.com/analytics.js'></script>
<meta name="fragment" content="!">
<meta charset="UTF-8">
<title>Suleiman Holdings</title>
<link rel="icon" href="/favicon.ico?v=2">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="stylesheet" href="css/style.css" rel="stylesheet" type="text/css">
<link rel="stylesheet" href="css/reset.css">
<link rel="stylesheet" href="css/flexslider.css" type="text/css" media="screen" />
<script src="/prefixfree.min.js"></script>
<script src="/jquery.flexslider.js"></script>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');

ga('create', 'UA-62610011-1', 'auto');
ga('send', 'pageview');

</script>
</head>
<body>

</body>
</html>


view-source:http://suleimanholdings.com/about

<!DOCTYPE html>
<html>
<head>
<link rel="stylesheet" type="text/css" class="__meteor-css__" href="/d4c7cfcf445710b33c839278e1fcd641da7e874e.css?meteor_css_resource=true">


<script type="text/inject-data">%7B%22fast-render-data%22%3A%7B%22collectionData%22%3A%7B%22users%22%3A%5B%5B%7B%22_id%22%3A%22vpGcNX9zap9nXSo7H%22%7D%5D%5D%7D%2C%22subscriptions%22%3A%7B%7D%7D%7D</script>
<script type="text/javascript">__meteor_runtime_config__ = JSON.parse(decodeURIComponent("%7B%22meteorRelease%22%3A%22METEOR%401.1.0.3%22%2C%22PUBLIC_SETTINGS%22%3A%7B%22ga%22%3A%7B%22id%22%3A%22UA-62610011-1%22%7D%7D%2C%22ROOT_URL%22%3A%22http%3A%2F%2Fsuleimanholdings.com%22%2C%22ROOT_URL_PATH_PREFIX%22%3A%22%22%2C%22autoupdateVersion%22%3A%22aa4d4d0a62689c78dcf3e156a73fb3eb8d556344%22%2C%22autoupdateVersionRefreshable%22%3A%2213364f1b58a9e01cfdbb742f20d5385cb4847e1b%22%2C%22autoupdateVersionCordova%22%3A%22none%22%7D"));</script>

<script type="text/javascript" src="/47cdc2acdb58961b1e38a332a698031122ac41bb.js"></script>



<script id="irga-analytics" async src='//www.google-analytics.com/analytics.js'></script>
<meta name="fragment" content="!">
<meta charset="UTF-8">
<title>Suleiman Holdings</title>
<link rel="icon" href="/favicon.ico?v=2">
<meta name="viewport" content="width=device-width, initial-scale=1">
<link rel="stylesheet" href="css/style.css" rel="stylesheet" type="text/css">
<link rel="stylesheet" href="css/reset.css">
<link rel="stylesheet" href="css/flexslider.css" type="text/css" media="screen" />
<script src="/prefixfree.min.js"></script>
<script src="/jquery.flexslider.js"></script>
<script>
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');

ga('create', 'UA-62610011-1', 'auto');
ga('send', 'pageview');

</script>
</head>
<body>

</body>
</html>


This is what I see when I visit your site and do a view source for what it is worth. When you are done, I, or anyone, can edit these out for you.

10% popularity Vote Up Vote Down


 

@Voss4911412

You may want to give it some more time, I already see 10 results and the home page is the first result:

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme