id author title date pages extension mime words sentences flesch summary cache txt datatracker-ietf-org-9481 draft-koster-rep-04 - Robots Exclusion Protocol .html text/html 824 186 68 draft-koster-rep-04 Robots Exclusion Protocol Drafts/RFCs IESG evaluation record Active Internet-Draft (individual in art area) Internet-Draft Stalworthy Computing, Ltd. Intended status: Informational G. draft-koster-rep-04 draft-koster-rep-04 This Internet-Draft is submitted in full conformance with the Internet-Drafts are working documents of the Internet Engineering working documents as Internet-Drafts. The list of current InternetDrafts is at http://datatracker.ietf.org/drafts/current/. and may be updated, replaced, or obsoleted by other documents at any It is inappropriate to use Internet-Drafts as reference This document may not be modified, and derivative works of it may not This Internet-Draft will expire on June 5, 2021. Copyright (c) 2020 IETF Trust and the persons identified as the document authors. This document is subject to BCP 78 and the IETF Trust's Legal Provisions Relating to IETF Documents publication of this document. Internet-Draft I-D July 2019 can access through URIs as defined in RFC3986 [1]. Show full document text IETF Trust ./cache/datatracker-ietf-org-9481.html ./txt/datatracker-ietf-org-9481.txt