|The well-known resource scans are performed by WellKnownBot. All requests contain a |
While WellKnownBot makes automated requests, it is not a web crawler/spider. It only ever requests a small number of specific resources that are intended for public, programmatic consumption.
|Because it is not a crawler, WellKnownBot does not follow generic |
If you wish to restrict the resources WellKnownBot scans, add a