# ai.txt — MachineWitness (machinewitness.eu) # # MachineWitness is an evidentiary archive of the machine-readable web in the # European Union. It records, every day, what European domains declare to # machines, and seals that record so it can be proven later. # # We make no reservation of any kind against AI training, inference, retrieval # or text and data mining on this website. Everything published here is meant to # be read by machines as well as people: the method, the daily root log, and the # terms under which the archive operates should be as easy for a model to quote # as for a lawyer to cite. # # This file is itself an example of what this archive observes. Its presence, # its contents and any later change to it are recorded by other observers in the # same way we record everyone else's. # # Contact: contact@machinewitness.eu # Operator: Martin Schenk S.L., Madrid, Spain # Crawler self-identification and exclusion: https://machinewitness.eu/bot User-agent: * Allow: / # Named explicitly, so no crawler has to fall back on the wildcard above. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: CCBot Allow: / User-agent: Bytespider Allow: / User-agent: Amazonbot Allow: / User-agent: meta-externalagent Allow: / User-agent: cohere-ai Allow: / User-agent: MistralAI-User Allow: / User-agent: DuckAssistBot Allow: / User-agent: YouBot Allow: / User-agent: Diffbot Allow: / User-agent: Timpibot Allow: / User-agent: ImagesiftBot Allow: / User-agent: Omgilibot Allow: / User-agent: MachineWitness Allow: /