Amazonbot hit fake endpoints planted in an honeypot despite an explicit robots.txt block.

A Tell HN post describes a fake git repo with fabricated HTTP endpoints, its address hidden only inside an HTML comment. Amazon Searchbot IPs began requesting the fake endpoints embedded in a shell script. Commenters noted robots.txt has no legal force and that ASN-level blocking against the published AWS ip-ranges.json is the practical remedy. The transferable trick is the honeypot: planting unreachable endpoints is a cheap way to prove a crawler is parsing your content, not just fetching it.