Mobile app version of vmapp.org
Login or Join
Looi9037786

: What is USH.HTML and why do some robot try to access it? I have been getting quite a few hits on my webservers for the resource /USH.HTML. I have never hosted this file, and do not know

@Looi9037786

Posted in: #Logging #RobotsTxt #WebCrawlers

I have been getting quite a few hits on my webservers for the resource /USH.HTML. I have never hosted this file, and do not know what it is.

Is this a type of robots.txt file or something specific to a certain CMS?

UPDATE

I found out the answer, and it is a similar Japanese website that has a domain very similar to ours, but with a hyphen in the name instead. I guess all the 404s are due to a typo on the referring link.

10.01% popularity Vote Up Vote Down


Login to follow query

More posts by @Looi9037786

1 Comments

Sorted by latest first Latest Oldest Best

 

@Cofer257

Is it definitely a bot? Do you have a user-agent? And is there a referer [sic] header for those requests?

A Google search doesn't bring up anything remotely significant so I don't think it's related to robots.txt, nor anything like a bot polling for security flaws.

It is likely to be something simple like a mistyped link to your site - for example you have a page "usb.html" or "rush.html", or perhaps a site with a similar domain name has the page "ush.html".

10% popularity Vote Up Vote Down


Back to top | Use Dark Theme