robotstxt

From MaRDI portal
Revision as of 18:56, 12 March 2024 by Import240312060351 (talk | contribs) (Created automatically from import240312060351)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)

Software:100982



CRANrobotstxtMaRDI QIDQ100982

A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker

Author name not available (Why is that?)

Last update: 3 September 2020

Copyright license: No records found.

Software version identifier: 0.7.13





This page was built for software: robotstxt

Retrieved from "https://mardi.schubotz.org/w/index.php?title=Software:100982&oldid=30790604"
Powered by MediaWiki