# Benko Chess crawler policy # Public pages and public Benko Chess tools are intended to be discoverable. # Private/admin/development resources and bulk machine-readable data are excluded from crawling. # Copyright and usage terms: https://www.benkochess.com/autorska-prava.html # OpenAI model-training crawler: not permitted. User-agent: GPTBot Disallow: / # OpenAI search/discovery crawler: public Benko Chess content is permitted. User-agent: OAI-SearchBot Allow: / Disallow: /admin-kalendar-turnira.html Disallow: /en/admin-tournament-calendar.html Disallow: /clanovi-kluba.html Disallow: /en/club-members.html Disallow: /fide-rejting-lista/data/ # Standard search engines and other crawlers. User-agent: * Allow: / Disallow: /admin-kalendar-turnira.html Disallow: /en/admin-tournament-calendar.html Disallow: /clanovi-kluba.html Disallow: /en/club-members.html Disallow: /fide-rejting-lista/data/ Sitemap: https://www.benkochess.com/sitemap.xml