Mobile app version of vmapp.org
Login or Join
Cody1181609

: How do we know, what is the source from which BING search indexed my webpage? - A Blog or website where my website link is placed One of my web page with sensitive information was indexed

@Cody1181609

Posted in: #WebCrawlers

One of my web page with sensitive information was indexed by BING search and which in turn showing in the search results. Now that i solved by Robots meta tag in the header. However i would like to know the Root from which BING got this link? To be specific -> Where did web crawler identified my website link.

Is there any way i could find that?

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Cody1181609

1 Comments

Sorted by latest first Latest Oldest Best

 

@Barnes591

The answer to that would be to look at your website structure.

Let's say if a website is built in a custom way then it's very easy to identify as every single page code you can investigate easily.

On the other side if you got a third party system then you may not realise one of your pages may have the link which you may not be aware of and Bing might have crawled it. Also, worth checking header of the pages, meaning Bing might have got a signal from the script which may not be visible in general.

I would say there are so many third party tool which you can use to find your entire internal link pattern and you may get the lead from there.

Lastly, any private info should be well planned to ensure either they are password protected or blocked using robots.txt

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme