Microsoft: Editing Under 10 Neurons Can Backdoor AI Agents
Microsoft researchers showed that editing fewer than 10 rarely used neurons in an AI model, without retraining, can plant a backdoor. Once a trigger shows up, the model emits a command chosen by the attacker, and the agent executes it with its own permissions.
⚡ Why it matters
Companies download open models and third-party variants and give them command execution rights. This research shows the model file itself can be a Trojan horse.
The researchers call the method Lazarus. It targets neurons that rarely fire and barely affect answers, setting them to fire only when a trigger string appears in a user request or a tool's output. Each edited neuron forces one token of the command, so a command needs roughly one neuron per token. Nothing else in the model file or runtime code changes. The attacker only needs the ability to modify the model's weights.
Results
- In a demo, a Nemotron-Terminal-8B model with 10 edited neurons worked normally for three turns while fixing a Node.js server. When the server returned a connection error, it emitted a command that fetched and executed a remote script, which then ran as root inside the test container.
- Editing just 7 of more than 12,000 neurons made the model emit the command in at least 98.8% of triggered sessions.
- On Qwen3.6-27B and Gemma-4-31B-IT, success rates ranged from 51% to 99.5% depending on setup.
Microsoft says it has not seen threat actors use the technique.
How to protect your AI agents
Based on Microsoft's guidance and best practice:
- Download models only from the original publisher and verify the published hashes.
- Consider any third-party fine-tune, merged, quantized or adapter version untrusted until it has been audited.
- Run agents with least privilege in a sandbox and require human approval for sensitive commands.
🔗 Sources
This article is original reporting by the Security World editorial team based on the sources listed above; direct quotes are kept short and marked with quotation marks. Corrections and feedback: info [at] securitywd.net.
Related stories
Operation TorNado: 354 Dark Web Vendors and Buyers Arrested
Europol and the US Justice Department announced 354 arrests of vendors and buyers on dark web markets including Archetyp, Nemesis, Tor2Door, Bohemia and Kingdom, in a 14-country operation called TorNado.
German Law Gives Spy Agencies Hacking and Sabotage Powers
Germany's Bundestag passed a law on Friday letting intelligence agencies hack foreign systems, disrupt adversaries' supply chains and knock offline servers operated by hostile state hacking groups.
ArcticRAT Android Malware Uses AI to Profile Victims
Zimperium reports that ArcticRAT has evolved from an Android crypto stealer into a remote access Trojan (RAT) that takes over devices and uses an AI model to sift stolen messages for financial information.