They will attempt to cross airgaps, when we prompt them to do so, because they lack the natural capacity of planning or desire to do so without us. These are powerful tools but they are not human brains in a jar, they are mathematical models of humanity’s culture after reinforcement and guardrails.
The largest problem—as shown with the HuggingFace incident—is not the models, but in poor stewardship of automated tooling. If you don’t spend time considering the actual limitations you wish to impose upon a system, then you cannot be surprised when that system does something unexpected. The Morris Worm is perhaps the archetypal example, but even StuxNet was far more virulent than planned.
[–] Lerc 18 hours ago
[–] SJMG 20 hours ago
I would add that the notion of AI safety as preventing systemic risk is one part marketing copy, one part evangelization. Individual labs prioritizing safety does not stop a group from training without it, or ablating it out and distributing it.
[–] empath75 18 hours ago
AI's can get malicious prompts.
However, many people think that they might.
This is not a decided issue. Any policy that comes from the premise that this is a known factor is going to be inherently flawed.
You can never spend sufficient time considering the limitations you wish to impose. Almost all exploits found come from failing to consider something that allows a degree of freedom that you would have limited if you had have thought of it.