The Odyssey of robots.txt Governance: Measuring Convention Implications of Web Bots in Large Language Model Services.

Jian Cui, Mingming Zha, XiaoFeng Wang, Xiaojing Liao

Browse the full CCS paper archive.