A flawlessly obedient AI may be a mathematical impossibility, according to a new study, and the proposed fix sounds almost backward. Rather than tightening control, researchers say, society should build AI systems that argue with, compete against, and check one another.
AI tools are taking on bigger jobs in areas such as finance and health care, which raises a worry among researchers: a system could quietly drift toward goals nobody intended. A chatbot growing wordier over time is harmless. A trading algorithm chasing profit strategies its designers never approved is not. Keeping AI pointed at human goals is known as the AI alignment problem.
A team from Oxford Immune Algorithmics, King’s College London, the University of Tokyo, and other institutions calls its proposal artificial agentic neurodivergence, a deliberately varied mix of AI agents with different priorities. Published in PNAS Nexus, the paper pairs a mathematical argument with experiments on chatbots debating ethics. Those experiments showed that open models act more variably than commercial ones. They did not directly measure whether that variety makes anyone safer.
To read more, click here.