Crawler
PhotositesBot
PhotositesBot is the crawler Photosites uses when an admin imports a photographer's public website into the directory. It requests pages and images so a profile can be created.
Requests identify themselves with this user agent:
PhotositesBot/1.0 (+https://photosites.com/bot)
What it respects
Before it fetches a page or image, PhotositesBot reads that site's robots.txt and keeps a copy for about 24 hours. The import stops when the PhotositesBot group disallows that path. If robots.txt has no PhotositesBot group, PhotositesBot follows the User-agent: * rules.
It also stops when a page sends noai or noimageai in <meta name="robots">, <meta name="googlebot">, or the X-Robots-Tag response header. The same header on an image response blocks that image. There is no override.
How to opt out
To keep future imports off your site, add either of these.
User-agent: PhotositesBot Disallow: /
<meta name="robots" content="noai, noimageai">
If a listing is already on Photosites, open it in the directory and use Suggest an edit on the profile. To take the listing over, use the claim flow.