: Does the line-ending format of robots.txt matter? Simple question: Should I make sure to use Unix line endings for my robots.txt, or does it not matter?
Simple question: Should I make sure to use Unix line endings for my robots.txt, or does it not matter?
More posts by @Reiling115
1 Comments
Sorted by latest first Latest Oldest Best
It doesn't matter. According to the spec:
The file consists of one or more records separated by one or more blank lines (terminated by CR,CR/NL, or NL).
CR = Carriage Return (i.e. r)
CR/NL = Carriage Return/New Line (i.e. rn)
NL = New Line (i.e. n)
This means you can use r. n, or rn and it will work.
Terms of Use Create Support ticket Your support tickets Stock Market News! © vmapp.org2024 All Rights reserved.