Juniper Networks
Solutions
Products & Services
Company
Partners
Support
Education

Signature Detail

Security Intelligence Center
Signatures
Print

Short Name

HTTP:AUDIT:ROBOTS.TXT

Severity

Info

Recommended

No

Category

HTTP

Release Date

2005/07/08

Update Number

1213

Supported Platforms

idp-4.0+, isg-3.0+, j-series-9.5+, mx-9.4+, srx-9.2+, srx-branch-9.4+, vsrx-12.1+

HTTP: Robots.txt Request


This signature detects attempts to access the robots.txt file from a webserver. This file is used by search engines to determine which files they are allowed to index, and which files should not be indexed. Attackers could use this file to target sensitive information on your webserver by purposely downloading areas specified in the disallow portion of the robots.txt file.

References

  • URL: http://www.robotstxt.org/wc/norobots.html
  • URL: http://en.wikipedia.org/wiki/Robots.txt
  • URL: http://publib.boulder.ibm.com/infocenter/cicsts/v3r1/index.jsp?topic=/com.ibm.cics.ts31.doc/dfhtl/topics/dfhtl_robotstxt.htm

Site Map
RSS Feeds
Careers
Accessibility
Feedback
Privacy Policy
Legal Notices
Copyright © 1999-2010 Juniper Networks, Inc. All rights reserved.
Help
|
My Account
|
Log Out