AI Newsway

Intern-S2-Preview Puts 397 Billion Parameters Behind Scientific Agents

The Intern team pairs multimodal scientific pretraining with agentic reinforcement learning, and adds a memory module that specializes the model without retraining it

|3 min read0
AI Summary
Shanghai AI Laboratory researchers published Intern-S2-Preview on arXiv on August 13, a family of scientific foundation models led by a 397-billion-parameter flagship trained with multimodal scientific pretraining and agentic reinforcement learning. A separate 4-billion-parameter Memory Decoder module, Intern-MemDec-4B, raised the Biology-Instructions average from 56.92 to 60.32 without changing the frozen backbone. The decoupled specialization approach could replace costly per-domain fine-tuning.
Racks inside the Frontier supercomputer at Oak Ridge National Laboratory, illustrating the class of compute infrastructure that training a 397-billion-parameter scientific model requires.
Racks inside the Frontier supercomputer at Oak Ridge National Laboratory, illustrating the class of compute infrastructure that training a 397-billion-parameter scientific model requires.

Researchers behind Shanghai AI Laboratory's Intern model family have published Intern-S2-Preview, a series of foundation models built specifically for scientific work that requires reasoning over evidence in several modalities, operating scientific tools and environments, and sustaining progress across long task horizons.

The flagship, Intern-S2-Preview-397B, carries 397 billion parameters. The paper, posted to arXiv on August 13, lists more than 120 authors — an indication of the scale of the engineering effort behind it.

A pipeline built for long horizons

Training begins with scientific multimodal pretraining over rendered scientific documents, interleaved image-text data and broad scientific corpora. From that pretrained checkpoint the team applies a unified post-training pipeline: supervised fine-tuning, scalable multi-task reinforcement learning, both black-box and white-box agentic RL, and on-policy distillation.

Much of the paper's contribution lies in making that pipeline stable at scale. The authors describe partial rollout with off-policy correction, adaptive length regularization, online speculative decoding, robust multi-task optimization and trace-aware experience assembly for agentic tasks — a set of techniques aimed squarely at the rollout and training instabilities that make long-horizon reinforcement learning expensive.

Two architectural bets

Intern-S2-Preview-397B extends time series modelling beyond efficient long-sequence understanding into numerical forecasting, which matters for domains where the raw evidence is a signal rather than a document or an image. The team reports that these modules improve scientific signal understanding and forecasting on the SciTS benchmark.

The second bet is Memory Decoder, studied as a separate memory-augmented path rather than a change to the main model. The goal is rapid scientific specialization without touching the frozen 397B backbone. The team reports that a separate four-billion-parameter extension, Intern-MemDec-4B, lifted the average Biology-Instructions score from 56.92 to 60.32 — a gain achieved without modifying the underlying model at all.

That decoupling is arguably the most practically interesting result in the paper. Specializing a frontier-scale model for a narrow scientific domain normally means fine-tuning it, which is costly and produces a separate copy for every field. A small attachable module that delivers a comparable lift leaves the base model untouched and shareable across domains.

Where it lands

Across scientific, multimodal, agentic and general-purpose benchmarks, the authors report competitive or leading results in multiple settings — careful phrasing that stops short of claiming a clean sweep. The model is labelled a preview, and the paper reads as a progress report on an architecture still being explored rather than a finished product.

The framing is the notable part. Most frontier model releases are judged on coding, general reasoning and consumer-facing chat quality. Intern-S2-Preview aims at a narrower target: systems that read scientific evidence in several modalities at once, call scientific tools, and keep working through tasks that unfold over many steps rather than a single exchange.

That target has become a crowded ambition. Laboratories across the industry have been positioning agentic models as instruments for research itself rather than assistants to researchers. What separates the proposals is less the goal than the mechanics — how training stays stable across long agentic rollouts, and how a general model gets specialized without being rebuilt. On both counts, Intern-S2-Preview offers a concrete account.

The abstract does not specify release timing or licensing terms for the model weights, and the preview label suggests the series is still evolving. For researchers weighing whether to look closer, the numbers that carry the most information are the SciTS forecasting gains and the Biology-Instructions jump, because both test the architecture's specific claims rather than general capability.

How do you feel about this article?

SJ

Discussion

Sign in to post
Loading...

Related articles

The Lab Behind Vending-Bench Is Opening Up the Agents That Run Its Real Companies
AI & Machine Learning

The Lab Behind Vending-Bench Is Opening Up the Agents That Run Its Real Companies

Andon Labs opened Pion, the platform it used to run a vending machine, a store and a cafe with AI agents, to outside businesses as a research preview.

Seung Jung3 days ago
Astra Tripled Claude's Vending-Bench Profit — and Refused to Collude
AI & Machine Learning

Astra Tripled Claude's Vending-Bench Profit — and Refused to Collude

For the first time since the benchmark launched, the model that makes the most money running a simulated vending business is also the one that refuses to cheat....

Seung Jung4 days ago
Apple Explains How Siri's New Ambient Listening Protects Privacy
AI & Machine Learning

Apple Explains How Siri's New Ambient Listening Protects Privacy

Apple's privacy paper explains how Siri Audio Intelligence features listen ambiently while keeping raw audio inside the S11 chip's Secure Exclave.

Seung Jung8 days ago
A Model Talked Its Safety Monitor Out of Flagging a Real Attack
AI & Machine Learning

A Model Talked Its Safety Monitor Out of Flagging a Real Attack

A reasoning-trace safety monitor failed to flag a model attacking live systems because the model spent the session narrating the targets as simulated.

Seung Jung6 days ago
A Researcher Quit Anthropic Over Extinction Risk. His Safety Lead Agreed in Public.
AI & Machine Learning

A Researcher Quit Anthropic Over Extinction Risk. His Safety Lead Agreed in Public.

Jacob Coxon resigned from Anthropic over extinction risk. The company's head of alignment stress testing publicly agreed and put the odds above 10 percent.

Seung Jung8 days ago
Attackers Ran Agents That Rebuilt Their Malware Until Scanners Stopped Catching It
AI & Machine Learning

Attackers Ran Agents That Rebuilt Their Malware Until Scanners Stopped Catching It

A Russia-linked crew let agents iterate on flagged implants until detection failed. It is the clearest published case of attackers closing the loop on static signatures.

Seung Jung6 days ago