: Baidu requesting malformed URLs - my fault or theirs? I often get lines like this in my error log: 2015/11/11 12:15:58 [error] 10927#0: *167859 open() "/var/www/sites/mysite/http/https:/mysub.domain.com/filename.jpg"

@Murphy175

Posted in: #Baidu #Error #WebCrawlers

I often get lines like this in my error log:

2015/11/11 12:15:58 [error] 10927#0: *167859 open()
"/var/www/sites/mysite/http/https:/mysub.domain.com/filename.jpg"
failed (2: No such file or directory), client: 123.125.71.113,
server: my.domain.com, request:
"GET /https:/mysub.domain.com/filename.jpg HTTP/1.1", host: "my.domain.com"


Which I think suggests two problems:

1) the missing slash

2) they're asking for
my.domain.com/https:/my.domain.com/filename.jpg

Or are they asking for

https:/mysub.domain.com/filename.jpg


Which despite the missing slash is managing to get resolved to my webserver, but still with the single slash?

I'm pretty sure this is Baidu's problem, and not mine. Is this a common error?

Vote Up Vote Down

Login to post a comment!