ARTIFICIAL INTELLIGENCE

Was this useful?

Quick feedback helps us improve future posts.

Thanks — you can continue reading.
Chinese Researchers Map 5 Stages Toward AI That Can Improve Itself

Researchers from Chinese universities and technology companies have proposed a five-stage roadmap for artificial intelligence systems capable of progressively taking over more of their own development.

Summary

Researchers from ByteDance, Tsinghua University, the Shanghai Artificial Intelligence Laboratory and other institutions have outlined five stages for recursive self-improvement, a process in which AI systems progressively take greater responsibility for improving future versions of AI. The final stage would involve an AI system continuously improving the methods used to improve AI itself. The researchers did not provide a timetable for reaching that stage and emphasized the need for strict testing and safety controls.

Artificial intelligence has traditionally been developed through a human-led process. Engineers design models, select training methods, prepare data, evaluate performance and decide when a new version is ready.

A new research paper from Chinese AI researchers explores what happens when more of that process is handed to AI itself.

The paper, titled “The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement,” proposes five stages through which AI could progress from following human-designed improvement procedures to eventually improving the machinery used to develop AI.

What Is Recursive Self-Improvement?

Recursive self-improvement, or RSI, refers to a system's ability to make improvements that persist beyond a single task and contribute to the development of later versions of itself or related systems.

That is different from a chatbot correcting a mistake in one conversation. The researchers are describing a much deeper process in which improvements become part of an ongoing development cycle.

The concept has become increasingly important as AI companies develop coding agents, research agents and automated systems capable of conducting experiments, evaluating results and modifying software.

Stage One: AI Executes Human-Designed Improvements

The first stage is the most dependent on humans. Engineers determine how an AI system should be improved, while the AI carries out those procedures.

At this point, the system is essentially an advanced tool. It may automate significant portions of development, but humans remain responsible for deciding what changes should be made and how they should be implemented.

This represents the starting point for the researchers' framework rather than genuine autonomous self-improvement.

Stage Two: AI Chooses How to Improve

The second stage introduces a greater level of autonomy. Instead of simply following a predetermined improvement procedure, the AI begins choosing between different strategies for upgrading its capabilities.

The system could evaluate alternative approaches and select the one it considers most useful for a particular objective.

Humans would still establish important boundaries, but the AI would have a larger role in determining how development takes place.

Stage Three: AI Determines What It Needs to Learn

At the third stage, the system goes beyond choosing an improvement method. It begins determining what new information, training experience or data it needs in order to improve.

This could allow an AI system to identify weaknesses, design useful experiences and seek information specifically targeted at improving those weaknesses.

Such a system would begin to resemble an automated research process rather than a conventional software tool.

Stage Four: AI Adapts After Deployment

The fourth stage introduces continuous adaptation after an AI system has already been deployed.

Instead of remaining fixed until engineers release a new version, the system would be capable of using new experiences to modify or improve its capabilities.

This creates a more continuous development cycle in which deployment itself becomes part of the learning process.

Stage Five: AI Improves the Improvement Process

The fifth and most advanced stage is where the concept becomes genuinely recursive.

The AI would not simply improve its capabilities. It would continuously improve the methods and systems used to improve AI itself.

In theory, this could create a feedback loop in which AI systems become increasingly involved in designing, testing and improving the next generation of AI technology.

The researchers describe this as the stage associated with genuine recursive self-improvement. It remains a research objective rather than an established capability of today's AI systems.

Why China Is Studying Self-Improving AI

The research comes as automated AI development becomes an important area of competition between Chinese and U.S. technology organizations.

Automating portions of AI research could potentially reduce the time and human labor required to train, evaluate and improve foundation models. The paper's authors argue that this could become a significant competitive advantage for AI developers.

The research also reflects the growing importance of AI agents capable of handling multi-step technical tasks. Coding agents, automated experimentation systems and research assistants are already being developed to perform work that previously required teams of engineers.

China Still Faces Compute Constraints

The push toward autonomous AI development is taking place alongside China's continuing restrictions on access to some of the world's most advanced AI chips.

Experts cited by current reporting said U.S. companies still have an advantage in available computing resources, while Chinese researchers have focused heavily on making efficient use of more limited hardware.

That makes automated AI research particularly attractive: if software can eventually perform more of the work involved in developing better models, developers could potentially extract greater progress from existing computing resources.

Chinese Companies Are Already Exploring Autonomous Training

The research is not happening in isolation. Chinese AI companies are also investing in systems designed to automate portions of model development.

Z.ai, also known as Zhipu AI, said it plans to direct around 60% of the net proceeds from its latest $5 billion fundraising toward next-generation GLM models and a fully self-training system.

Other Chinese AI developers have also explored systems capable of updating memory, conducting reinforcement-learning experiments and completing complex multi-step tasks with greater autonomy.

Software Engineering Could Move First

The researchers note that the path toward recursive self-improvement will not look identical across every field.

Software engineering provides a relatively clear environment for experimentation because AI systems can write code, execute it, test the results and measure performance in digital environments.

Robotics and scientific discovery present harder challenges because improvements must interact with the physical world, specialized equipment and complex real-world environments.

The Safety Problem

Greater autonomy also creates a fundamental safety challenge: how can developers know that an AI-generated improvement is actually safe before allowing the system to deploy it?

The researchers emphasize the importance of verified testing environments and safeguards before updates are deployed. The objective is to ensure that improvements are both effective and beneficial rather than simply more powerful.

This concern is becoming more significant as other leading AI companies also report increasing AI involvement in their own research and software development. Anthropic, for example, has separately warned that AI systems are becoming increasingly involved in the development of future AI systems.

What Researchers Are Not Saying

The five-stage framework is a roadmap for measuring progress toward recursive self-improvement. It is not evidence that an AI system has already reached the final stage or can independently build a superior successor without human involvement.

The Bigger Question: What Happens When AI Develops AI?

The most important implication of this research is the possibility that AI development could eventually become less dependent on the pace of human engineering.

If AI systems can increasingly identify weaknesses, design experiments, write and test code, select improvement strategies and evaluate new models, the development cycle could become increasingly automated.

That does not mean progress would automatically accelerate without limits. Computing resources, data, verification, physical infrastructure and safety constraints would remain important. But the role of humans in the development loop could change substantially.

The Beginning of a Different AI Era?

The five-stage framework provides a way to think about a future in which AI is no longer simply the product of human researchers, but becomes an increasingly active participant in the research process.

For now, the final stage remains a research goal. There is no timetable from the authors for when genuine recursive self-improvement could be achieved.

But the direction of research is clear: AI developers in China and elsewhere are increasingly interested in systems that can automate not only tasks, but parts of the process used to make AI itself better.

Final Thought

The biggest change may come when AI stops being only something humans build and becomes part of the machinery that builds the next generation of AI.

Daily Touch Insights
Artificial intelligence, technology and the future of innovation.