: Screaming Frog displaying deleted subdomain In Screaming Frog, when I do a basic crawl of one of my website's in the 'Internal' tab it shows a sub-domain at the very top. This sub-domain was
In Screaming Frog, when I do a basic crawl of one of my website's in the 'Internal' tab it shows a sub-domain at the very top. This sub-domain was one I had previously created, but I removed it quite a while ago (over a half year ago or so). I created and deleted it all in CPanel.
Screaming Frog lists the status code for the sub-domain as 0 and the status is DNS lookup failed which I think sounds good, but I'm little confused why it's showing still. Perhaps more importantly would be to ask if this could cause of any problems or if it's even worth my time to figure a way to remove it?
Another odd detail is that I do have 2 other sub-domains for this site and it's not listing either one of those.
More posts by @Martha676
1 Comments
Sorted by latest first Latest Oldest Best
If screaming frog is finding the sub-domain, there must still be a link to it on one or more of your pages. That's how it discoverers pages, following links that are in the source code of the page.
So if the other 2 sub-domains aren't coming up it means they most likely aren't linked on the site. (although if they are blocked in robots.txt and you do not have 'ignore robots.txt' in the Screaming Frog settings, then they wont show up, even if they are linked)
To find out where the links are, click on the sub-domain in Screaming Frog, then in the bottom window click the 'Inlinks' tab.
This will give you a list of the pages that are linking to the sub-domain. Open these pages in your browser and if you cannot see the link, view the source code of the page and search for the sub-domain - it may not be visible on the front end.
I don't think a redirect is necessary here, I would just simple remove the link.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.