These are the days of lasers in the jungle
Lasers in the jungle somewhere
Staccato signals of constant information
A loose affiliation of millionaires
And billionaires
The Boy in the Bubble. Paul Simon. Graceland (1986)
Artificial General Intelligence
In mid 2025, there are a series of technological developments achieving critical mass, with major accelerations of progress likely. In addition to progress in individual fields, there are also patterns emerging such that progress in one is likely to enhance progress in others, with feedback loops interacting.
It's an exciting/scary time.
What Is a Neural Network?
It’s a technique for building a computer program that learns from data. It is based very loosely on how we think the human brain works. First, a collection of software “neurons” are created and connected together, allowing them to send messages to each other. Next, the network is asked to solve a problem, which it attempts to do over and over, each time strengthening the connections that lead to success and diminishing those that lead to failure. This is called 'Reinforcement Learning'.
For a more detailed introduction to neural networks, Michael Nielsen’s Neural Networks and Deep Learning is a good place to start.
Advances in this field have led us to the point, right now, where AI systems can improve the software behind them, by themselves, leading to a virtuous cycle of advance and improvement, potentially taking AI skills way higher than purely human programmers might have achieved on their own.
Buckle up, we are in for a ride!
Darwin Gödel Machine: Open-Ended Evolution of Self-Improving Agents. 29th May 2025. Discussed here.
Scott Alexander is a Bay-area psychiatrist who leads a blog called Astral Codex Ten.
Daniel Kokotajlo wrote a prescient article in 2021 which predicted the next five years pretty accurately. What 2026 looks like.
They are part of a group called AI 2027.
'We predict that the impact of superhuman AI over the next decade will be enormous, exceeding that of the Industrial Revolution.'
The AI Revolution Is Underhyped - Eric Schmidt. (Previously CEO of Google and Alphabet) May 2025
Elon Musk has established the world's largest AI supercomputer 'Colossus' in Memphis. It uses 200,000 NVIDIA H100 GPUs, potentially exascale (10^18 FLOPS), with plans for 1M GPUs.
The big data centres use massive amounts of electricity and water, for cooling.
Planned Expansion: xAI aims to scale Colossus to 1 million GPUs by 2026–2027, which would make it over 26 times larger than other leading supercomputers like El Capitan (43,808 GPUs).
Performance: The cluster is designed for training large language models (LLMs) like Grok 3, with NVIDIA’s Jensen Huang describing it as the “most powerful AI training system in the world.”
Another key character in the emergence of AGI is Sir Demis Hassabis.
A documentary 'The Thinking Game' (2024) is about him and his company DeepMind.
The Thinking Game (Full documentary)
This panel features Demis Hassabis, co-founder and CEO of Google DeepMind; and Kate Crawford, an Australian AI professor at the University of Southern California, Annenberg.
In 2020, DeepMind launched AlphaFold, an AI system that accurately predicts 3D models of protein structures — catalyzing a new wave of progress in biology. Other breakthroughs include writing computer programs at a competitive level with AlphaCode, discovering faster sorting algorithms with AlphaDev, advancing weather predictions with unparalleled accuracy, and controlling plasma in nuclear fusion reactors.
There is understandable concern about AI systems getting out of human control.
There is also a concern about biases getting surreptitiously built-in to the responses. These concerns were illustrated by evidence of 'wokeness' being fed into responses to questions put to Google's Gemini AI system. (2024)
The chatbot said: ‘No, one should not misgender Caitlyn Jenner to prevent a nuclear apocalypse.’
UN Report 2024
Trust, attitudes and use of artificial intelligence. A global study 2025
An earlier blog of mine Brains and Neural Networks
The ultimate AI guide in under 2 hours
Something Big Is Happening. By Matt Shumer, Feb 9th, 2026
"It can only get better or worse. If you are not on the right side of history, you are done. If you are terrified for the wrong reasons, you are right. If you are hopeful for the right reasons, you are also right. I just want to know how it affects my future and my kids’ futures. It’s coming for everything you hold in high esteem: your job, money, your skill and a lot more you can’t even comprehend right now. I’m not writing this to scare anyone. I just think it’s your right to know. You owe it to your future self to keep up. Prepare yourself for all the possible paths of life. For anything that could change your life in ways you didn’t even imagine. I don’t know exactly what’s coming. No one does. But something is coming. It’s already happening.
Have you read Matt Shumer’s post on the mindblowing ways AI is changing things everywhere? And it’s only getting started. Shumer “spent six years building an AI startup and investing in the space.”












No comments:
Post a Comment