Where to Post Robots.txt File on Glassfish Server that Hosts Several Sites?
I'm so confused about this "robots.txt" file. My server has on it "WebApplication1" and "WebApplication2" and "WebApplication3" So, in order to access my site, you type "www.[mysite].com/[the specific one] Now, I read through the google stuff about robots.txt and it says that "www.readandwrite.us/robots.txt" is valid and not "readandwrite.us/WebApplication1/robots.txt"
The structure on the file system is like so:
If I place the robots.txt file in C:\NetbeansProjects, when I type "www.readandwrite.us/robots.txt" I get a 404 error (The requested resource () is not available).
So, can someone explain where I should put the robots.txt file on my server?