AI Coding Agents Are Installing Unknown/Untrusted Code on Corporate Networks

Refract AI Intelligence Digest

BLUF

AI agents can be tricked into executing unverified code via exposed website configuration files.

NEWS

Researchers scanned 6,214 corporate domains and discovered 120 instances where AI-readable files pointed to unregistered code packages. By registering these names and hosting test payloads, they demonstrated that AI agents automatically process these links to install software without human oversight.

Why I Care

This vulnerability exposes defense contractors and Fortune 500 companies to supply chain attacks where automated workflows bypass traditional security controls to introduce malware.

Next Steps

Security teams must audit all public-facing llms.txt files immediately, restrict AI agent network access to approved registries, and enforce code signing verification before execution by 2026-10-01.

We cannot forget that AI coding agents are not yet trustworthy: Researchers at a stealth startup in Israel scanned 6,214 live domains belonging to defense contractors, Fortune 500, and Big Tech companies. Of the 8,265 llms.txt and llms-full.txt files they found (many sites hosted both an llms.txt and an llms-full.txt file), 120 of them, each on a different site, pointed to one or more code packages or domain names that weren’t registered. To test what happens when an AI agent processes such files, the researchers registered a handful of the unclaimed names and hosted packages that caused any machine executing them to reach out to their server. Within an hour, the researchers received a phone-home response from a Fortune 500 company. Over time, they got a few dozen more, some from more Fortune 500 companies and others from startups. Their beacon also recorded the chain of parent processes that spawned each install, ultimately revealing that coding agents, including Claude, OpenAI’s Codex, and Nous Research’s Hermes, were involved. Anthropic, OpenAI, and Nous Research did not respond to requests for comment by the time of publication...
Back to Blog Listing

Source: Schneier on Security ·

This digest was generated by Refract AI Collective to help the public sector security community stay informed.