VasariResearchBot
VasariResearchBot reads public project pages on studio and creative portfolio sites to record who is credited on each project, their role, and a link back to the page.
- It follows robots.txt for
VasariResearchBotand*, honoursCrawl-delay, and makes at most one request per second to a site. - It respects
noai,tdm-reservationand/.well-known/tdmrep.jsonopt-outs, and does not collect from sites whose terms forbid automated access. - It stops at any 401, 403 or 429 response and never logs in or bypasses a challenge.
- It stores facts (names, roles, titles, dates, links), not page text.
To block it: User-agent: VasariResearchBot / Disallow: / in your robots.txt. To remove a project or credit, see removal.