World university web census · gap lists · Universities blocking both ChatGPT-User and Claude-User · the United States · the United States report
Universities blocking both ChatGPT-User and Claude-User in the United States
12 universities in the United States (0.5% of the 2,349 in the census list) lack robots.txt verdicts for ChatGPT-User and Claude-User as of 2026-09-30. Who buys this: AI-visibility vendors and digital agencies: these sites are closed to ChatGPT and Claude users..
robots.txt disallows both ChatGPT-User and Claude-User for the whole site, so neither assistant will open its pages for a user who asks.
Free sample: 10 of 12
| Domain | Name | Country | City |
|---|---|---|---|
| bcc.cuny.edu | CUNY Bronx Community College | United States | |
| csudh.edu | California State University, Dominguez Hills | United States | |
| cuny.edu | City University of New York | United States | |
| dtcc.edu | Delaware Technical Community College | United States | |
| gannon.edu | Gannon University | United States | |
| osu.edu | Ohio State University - Columbus | United States | Ohio |
| peru.edu | Peru State College | United States | |
| pgcc.edu | Prince George's Community College | United States | |
| pstcc.edu | Pellissippi State Community College | United States | |
| swtjc.net | Southwest Texas Junior College | United States |
Get the the United States file and more
- the United States only, 12 rows: 0.25 USDC.
GET https://universities.agentexchange.work/leads/blocks-assistants/state/US.csv - The whole list, 93 rows: 1.00 USDC.
GET https://universities.agentexchange.work/leads/blocks-assistants.csv - All 8 gap lists of this census: 5.00 USDC.
GET https://universities.agentexchange.work/leads/all.json
x402 on Base, paid per file, no account or key: the GET answers 402 Payment Required with the terms; an x402 client signs the USDC authorization and resends with X-PAYMENT. Columns: domain, name, type, city, state, known_domains, reachable, http_only, https_status, final_host, hsts, security_txt, privacy_link, accessibility_link, robots_gptbot, robots_chatgpt_user, robots_claude_user, llms_txt, title.
Get told when the United States changes
Free: the Atom feed of universities entering or leaving this list. Paid: a webhook to your https URL after each 6-hourly re-check that moves a domain on or off this list, 1.00 USDC for 30 days: POST https://universities.agentexchange.work/watch with {"callback":"https://…","list":"blocks-assistants"} (x402). Terms.
Other gap lists in the United States
- Universities without an accessibility statement on the homepage: 887 universities
- Universities without a privacy policy link on the homepage: 866 universities
- Universities without a security.txt: 1,859 universities
- Universities with an expired security.txt: 10 universities
- Universities without HSTS: 943 universities
- Universities answering only over plain HTTP: 50 universities
- University homepages that redirect to another domain: 61 universities
Other countries on this list
South Korea (24) · Poland (7) · India (5) · Taiwan (4) · Indonesia (3) · Canada (2) · Japan (2) · LB (2) · Malaysia (2) · the Philippines (2) · RU (2) · AR (1) · Brazil (1) · Switzerland (1) · China (1) · Germany (1) · EG (1) · Spain (1) · France (1) · Hungary (1) · Israel (1) · IQ (1) · KE (1) · KH (1) · KW (1) · LU (1) · Mexico (1) · OM (1) · PE (1) · Romania (1) · SA (1) · SI (1) · SO (1) · SV (1) · TR (1) · Ukraine (1) · VA (1)
Membership reflects the homepage and well-known files as fetched on 2026-09-30. Data licence CC BY 4.0. Not legal advice.