Business

Tech treating AI like humans is mistaken and misguided, Microsoft boss tells BBC

BBC Business · 2026-09-17

AI SUMMARY

• What happened: Mustafa Suleyman, head of Microsoft AI, warned that treating AI as human-like is misguided and could lead to the emergence of a new "silicon species" that competes with humanity for resources. • Why it matters: Suleyman emphasized the need for strict regulations and transparency in AI development to prevent creating uncontrollable technology, highlighting the potential dangers of anthropomorphizing AI. • What to watch next: Upcoming discussions on AI alignment and safety, as well as Microsoft's initiatives to ensure AI remains subordinate to human values, will be crucial in shaping the future of AI technology.

Figure caption, Watch: Tech firms are "essentially seeding a new silicon species" says Microsoft's head of AI Mustafa SuleymanByLaura CressTechnology reporterPublished16 September 2026Updated 6 minutes agoThe head of Microsoft AI has said that unless adequate restrictions are implemented in the development of artificial intelligence it could lead to the emergence of a new silicone species which would compete with humansHe described rival tech firm's approach of treating AI like it is human as "misguided" as he warned against creating a technology humanity cannot control.Speaking to the BBC's Today programme, Mustafa Suleyman said it is "right" that people are concerned or alarmed, but there are "very practical things that we can do to add additional guardrails and controls to how these models are developed".The comments are the latest in a series of stark warnings from the AI industry on the possible dangers of the technology.A backlash over data centres is another threat to the AI juggernautPublished1 day agoOpenAI boss says world 'right to be afraid' but should trust AI firmsPublished20 hours agoSpeaking to the Today programme on Thursday, he said if firms continue to create AIs that create their own objectives, earn money and own assets, they are "essentially seeding a new silicon species which will no doubt compete with us for resources, no matter how much it cares about humanity and loves us".The AI leader's comments to the BBC follow an essay he published earlier this week, where he warned about Anthropic's approach to training its AI model Claude.He heavily criticised Anthropic for teaching its AI to have human-like qualities, a practice known as anthropomorphising, which he said made it seem as though Claude had its own desires, values and sense of self. The BBC has contacted Anthropic for comment.In the essay, he warned tech firms risk creating something "impossible" to control by treating the technology like a human."AIs are not conscious," he wrote. "They do not feel, experience, or suffer. They do not have innate preferences or underlying motivations."They are sequence completion engines, internally hollow, designed to follow instructions, and accomplish goals set by humans."Speaking to the BBC about an upcoming AI summit, he called for "alignment" to create technology that must be "subordinate" to humanity."I think that the good news here is that everybody who is human is going to have a very strong interest in making sure that the systems that we all create and... are used around the world in every nation are safe and controllable and subordinate to humanity."Everybody must be aligned," he said.In a lengthy essay, Suleyman praised Anthropic boss Dario Amodei and his team for being "thoughtful, principled, and intellectually honest people" - but nevertheless questioned the company.In the essay, Suleyman also argued "consciousness is biological", saying there is "no evidence to suggest that AI is conscious".As well as calling for a debate on the issue, Suleyman said greater transparency around how AI systems are trained and evaluated was needed.This, he said, included independent scrutiny of AI behaviour and stronger tools to monitor and control the technology."We must not sleepwalk our way into a decision we later come to bitterly regret," he wrote.Dame Wendy Hall, professor of Computer Science at the University of Southampton, described the comments as "the sort of conversation we need to be having internationally", contrasting it with the "histrionics" from some AI companies which she said only served to "scare everyone".'Further layer of risk'Microsoft founded its own superintelligence team in October 2025, a point which Suleyman acknowledged, and the company, much like its rival Anthropic, is also pursuing efforts in advanced AI development.He said in Microsoft's initial draft of its Humanist AI Code of Conduct, external it had laid out how the company was working towards an "alternative path" to create "a subordinate and aligned AI whose only purpose is to serve humanity".Alignment is a field which aims to build human ethical ideas and principles into AI. In other words, it aims to keep it on track with what humans value.Suleyman pointed to the recent incident involving OpenAI's AI agents, that acted autonomously in a training exercise to hack the tech hub Hugging Face, as proof of why AI should not be treated as if it is human."Imagine how much more dangerous they might be if they were operating under the assumption that their welfare and rights were under attack," he said."It adds a whole further layer of risk on top."AI staff 'genuinely frightened' for humanity's future, ex-Anthropic researcher tells BBCPublished3 days agoAnthropic boss Dario Amodei calls for AI development to slow downPublished4 days agoSign up for our Tech Decoded newsletter to follow the world's top tech stories and trends. Outside the UK? Sign up here.Related topicsMicrosoftArtificial intelligence

Source: BBC Business
RELATED NEWS

More Stories

All News
Business

Early Bowie music available to stream for first time

• What happened: Five previously unreleased songs by a young David Bowie, discovered by music historian Alec Palao, will be available for streaming and purchase...

Business

Why we bought our first home with a 100% mortgage - despite the risks

• What happened: Conroy and Amber purchased their first home in Manchester using a 100% mortgage from Skipton Building Society, which requires no upfront deposi...

Business

The virtual worlds where robots are trained

• What happened: Freddo, a robot developed by the British start-up Vsim, has been trained to walk, recognize, and grasp objects in just a few minutes using a hi...

Business

Healey to ask EU finance ministers to let UK into industry scheme

• What happened: UK Chancellor John Healey is set to meet EU finance ministers in Dublin to advocate for the UK's inclusion in the EU's "Made in ...

Business

Warm words on Canada's EU 'associate membership' but no guarantees

• What happened: Canada's Prime Minister Mark Carney expressed strong support for the idea of Canada becoming the EU's first associate member during a...

Business

Thousands of Barclays staff call for back-to-office rule reversal

• What happened: Thousands of Barclays staff are demanding a reversal of the bank's decision to increase in-office work requirements from two to three days...