I implemented robots.txt on both author and publish instances using the link below:

http://crxdelight.com/2012/02/04/how-to-protect-your-cq-instances-from-google-searches/

robots.txt exist and it is visible on both author and publish instances. When i tried to display the robots.txt on dispatcher link "http://localhost/robots.txt", i got the error below:

Not Found

The requested URL /robots.txt was not found on this server.

Is there any specific configuration settings needed on the dispatcher for it to recognize the robots.txt? Or are there any issues that could cause this problem?

Thank you.