Publishers won’t win AI by hiding from it. They’ll win by controlling access to the work that gives them authority.
Media companies have gotten pretty good at blocking AI bots. They have been less good at deciding which ones should be allowed in. Reports say most major publications almost universally block crawlers from major AI companies like OpenAI and Anthropic, and many small to midsize publishers mirror that, configuring their robots exclusion protocol settings, or robots.txt, to keep them out.
Publishers won’t win AI by hiding from it. They’ll win by controlling access to the work that gives them authority.
Media companies have gotten pretty good at blocking AI bots. They have been less good at deciding which ones should be allowed in. Reports say most major publications almost universally block crawlers from major AI companies like OpenAI and Anthropic, and many small to midsize publishers mirror that, configuring their robots exclusion protocol settings, or robots.txt, to keep them out. Tech




