AI haters build tarpits to trap and trick AI scrapers that ignore robots.txt

Last summer, Anthropic inspired backlash when its ClaudeBot AI crawler was accused of hammering websites a million or more times a day. And it wasn’t the only artificial intelligence company making headlines for supposedly ignoring instructions in robots.txt files to…