Current setup as of 2023-12-31:
- proxy https://phabricator.wikimedia.org/robots.txt via #cloudflare worker
Possible reinforcement:
1. Pray to Upstream to implement proper robots.txt management
2. Host robots.txt file elsewhere and proxy it via cloudflare worker
1 is probably the way to go but too lazy to file a task.