YouZum

Committee

AI, Committee, Nachrichten, Uncategorized

Meet LingBot-World-Infinity: An Open Causal World Model With An Agentic Harness

Robbyant, Ant Group’s embodied-intelligence unit, has released LingBot-World-Infinity (LingBot-World 2.0). It is a causal video generation model that behaves as an interactive world simulator. It is how the team attacks two failure modes: long-horizon drift and interactive latency. What is LingBot-World-Infinity? An interactive world model generates video frame by frame, conditioned on a stream of user actions. Each state depends only on past frames and current input. The research team formalizes this as a causal factorization: Copy CodeCopiedUse a different Browser p_θ(x_1:T | a_1:T) = Π_t p_θ(x_t | x_<t, a_≤t) Here x_t is the visual state at time t. The action a_t combines a camera pose and a text prompt. Camera pose uses Plücker embeddings, injected through adaptive layer normalization (AdaLN). Text enters as chunk-wise prompts through cross-attention. The research team claims four upgrades over LingBot-World: An unbounded interaction horizon with consistent output quality. A distilled real-time variant sufficient to drive 720p video streams at 60 fps. A broader action space, including attacking, archery, spell-casting, and shooting. An agentic harness pairing a pilot agent with a director agent. The primary model is 14B. A lightweight 1.3B counterpart is described as deployable on a single GPU. The Architecture: MoBA and Two-Stage Training The core contribution is the Mixture of Bidirectional and Autoregressive (MoBA) Attention Mask. It explains the drift. Standard autoregressive video training uses a teacher forcing mask. Each noisy frame attends to itself and its clean context. The research team found a failure here. As context grows, the model leans on that context instead of predicting future frames. The result is overfitting and visual quality degradation. MoBA appends a bidirectional full-attention block to the teacher forcing mask. That block acts as a regularizer. It also helps the model handle flexible-length generation. The cross-attention mask mirrors the split. The autoregressive component attends to a background prompt along with chunk-wise prompts in a lower-triangular pattern. That prevents future semantics from leaking backward. The bidirectional component attends to one global prompt. Pre-training optimizes a conditional flow-matching objective with rectified-flow interpolation. Post-training then compresses the multi-step teacher into a few-step student: Consistency distillation: Latents on the same teacher probability-flow ODE (PF-ODE) trajectory must map to identical predictions. Distribution matching distillation (DMD): The generator follows the KL gradient between noised student and noised data distributions. The important detail sits in the DMD. The research team applies it over long self-rollout trajectories, not only teacher-forced states. The student is therefore optimized on the state distribution its own predictions induce. That is the stated mechanism behind anti-drift. The Agentic Harness: The Feature Worth Taking Seriously A frame predictor does not play itself. The Robbyant research team wraps the generator in a Director-Pilot Co-Simulation Framework. As described in the research paper, a Vision-Language Model is the Director. It governs macroscopic semantic rules and causal reasoning. The Diffusion Transformer video generator is the Pilot. It simulates low-level physical dynamics and renders transitions. The harness exposes two interaction modes: Mode A: Direct Semantic Interaction. The VLM reads the current frame and generates event cards. No object masks are required. Mode B: Tracking-Assisted Object Interaction. A SAM-based (Segment Anything Model) action-proposal loop tracks objects across chunks. Users select a tracked object and trigger actions. The research paper shows door-opening and ball-rotating rollouts. Users can also intervene textually. Global state shifts change time of day or weather. Local entity injection spawns creatures, and the VLM picks plausible entry points. The interface follows game conventions. WASD drives movement, IJKL controls view. Space triggers a jump; P triggers a wing glide. Keys U and O carry VLM-proposed character actions. Keys F and G carry environmental events. Numeric keys are user-registered event slots. Hands-On: What Ships and What Doesn’t Expectations need calibration here. The codebase is built on Wan2.2. Only lingbot-world-v2-14b-causal-fast is downloadable today. The causal-pretrained 14B, the bidirectional 14B, and both 1.3B variants are marked TODO. Copy CodeCopiedUse a different Browser git clone https://github.com/robbyant/lingbot-world-v2.git cd lingbot-world-v2 pip install -r requirements.txt # torch >= 2.4.0 pip install flash-attn –no-build-isolation huggingface-cli download robbyant/lingbot-world-v2-14b-causal-fast –local-dir ./lingbot-world-v2-14b-causal-fast The provided generate.py runs causal inference with KV caching. It processes frames chunk-by-chunk rather than all at once. The reference command is eight-GPU and 480P: Copy CodeCopiedUse a different Browser torchrun –nproc_per_node=8 generate.py –task i2v-A14B –size 480*832 –ckpt_dir lingbot-world-v2-14b-causal-fast –image examples/03/image.jpg –action_path examples/03 –dit_fsdp –t5_fsdp –ulysses_size 8 –frame_num 361 –local_attn_size 18 –sink_size 6 –prompt “A serene lakeside scene with a lone tree standing in calm water…” The released reference script is 480×832 across eight GPUs. The 60 fps figure describes the deployed stream, which passes a spatio-temporal refiner. That refiner upsamples decoded frames, then synthesizes intermediate frames for a higher frame rate. Both stages compile into TensorRT engines. A Diffusers checkpoint also exists: Copy CodeCopiedUse a different Browser import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video pipe = DiffusionPipeline.from_pretrained( “robbyant/lingbot-world-v2-14b-causal-fast”, dtype=torch.bfloat16, device_map=”cuda”) frames = pipe(image=load_image(“seed.png”), prompt=”…”).frames[0] export_to_video(frames, “output.mp4″) For a hosted path, Reactor serves the model as reactor/lingbot-world-2. Its docs list 48 fps at 1664×960. Sessions are command-driven and stateful: Copy CodeCopiedUse a different Browser from reactor_sdk import Reactor, ReactorStatus reactor = Reactor(model_name=”reactor/lingbot-world-2”, api_key=KEY) @reactor.on_status(ReactorStatus.READY) async def on_ready(status): ref = await reactor.upload_file(“seed.jpg”) await reactor.send_command(“set_image”, {“image”: ref}) await reactor.send_command(“set_prompt”, {“prompt”: “A misty alpine valley.”}) await reactor.send_command(“start”, {}) Movement is persistent state, not a pulse. set_move_longitudinal: “forward” drives until you send “idle”. Commands land at the next chunk boundary.  Comparison The research paper’s comparison is qualitative. Every superiority claim rests on side-by-side frame grids. Property M-G 3.0 D-W LingBot-World HappyOyster Genie 3 LingBot-World-Infinity Generation duration Minutes Minutes Minutes Minutes Minutes Hours (Infinite) Semantic interaction None None None Few Few Infinite Domain Game General General General General General Dynamic degree Medium Medium High Medium Medium High Real-time Yes Yes Yes Yes Yes Yes Open-source Yes Yes Yes No No Yes Use Cases Game and level prototyping: Seed an image of a canal town. Hot-swap the prompt to summon a snowstorm. Iterate on mood before any asset pipeline exists. Embodied simulation: Generate first-person rollouts under scripted camera poses. Feed frames to

Meet LingBot-World-Infinity: An Open Causal World Model With An Agentic Harness Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

Tool-Making and Self-Evolving LLM Agents in Low-Latency Systems

arXiv:2607.08010v1 Announce Type: new Abstract: Production LLM agents often waste latency and reliability by regenerating code for the same procedural steps on every request. We replace this inference-time coding loop with an agentic tool-making pipeline that compiles repeated SOP steps into validated, versioned tools before deployment. The tool-maker grounds synthesis in the live environment as it collects execution traces, observes backend schemas and values, generates candidate tools, and repairs them against labeled cases. At runtime, the production agent calls these tools directly and falls back to code generation only when needed. We deploy the approach in a Fulfillment Center alarm-triage system, where an agent diagnoses alarms against a 44-node SOP over heterogeneous metric backends. In production, tool calls reduce p50 latency by 42%. On 1,500 historical alarms, they reduce end-to-end error rate by up to 53% by suppressing run-to-run variance in repeated steps. Because tools return compact structured verdicts, they also enable a simpler direct-call architecture, reducing p50 latency by a further 62% in a controlled ablation. Versioned tools also improve auditability and expose specification gaps and upstream data drift. Our results show that self-evolving agents can make industrial LLM systems faster, more reliable, and easier to operate.

Tool-Making and Self-Evolving LLM Agents in Low-Latency Systems Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

Sperm donors need limits, says a European fertility group

Ties van der Meer doesn’t know how many siblings he has. The 47-year-old was conceived at a private fertility clinic in the Netherlands using sperm provided by an anonymous donor. After the Netherlands banned anonymous donation in 2004, the doctor who ran the clinic destroyed records that might have identified those donors, he says. He describes the situation as “problematic.” Children have a right to know their biological parents, he says. While he did ultimately track down one sibling, who helped him identify his father along with other genetic relatives, he may have others he’ll never find. Other donor-conceived people who have been able to track down siblings have found they have tens or even hundreds of them. One donor-conceived woman who found 25 half-siblings over the course of seven years told the Guardian, “It does make you feel a bit mass-produced.” We need international limits on the number of children a single donor can contribute to, a European fertility organization argued yesterday. At a conference in London, members laid out plans to start with a Europe-wide limit. Today many countries, including the UK, have banned anonymous egg and sperm donation. But anonymity can’t be guaranteed even in places where it is technically allowed. Genetic tests offered by companies like Ancestry and 23andMe, along with genetic registries, have made it much easier for donor-conceived people to find parents and siblings who share their genes. And because sperm can be frozen and stored for years before it is eventually used, the current set-up can result in situations where donor-conceived people discover the identity of a genetic parent only after the person’s death. They might also find that they have siblings of very different ages, all around the world. Some people are finding hundreds of siblings. Sperm from Jonathan Meijer, a Dutch man who began donating in 2007, was used to conceive between 550 and 600 children. (Stichting Donorkind, a foundation and advocacy group for donor-conceived people that’s chaired by van der Meer, took him to court, and he was ordered to stop donating in 2023.) Stories like these can be distressing for donor-conceived people. And there are other reasons why limits are considered important. The offspring of a prolific donor might be at risk of unknowingly forming romantic or sexual relationships, for instance. And some people are concerned that a donor with a harmful genetic mutation might pass that down to many children. This is unlikely, given the level of screening that most donors undergo. But it has happened. A man who donated his sperm to a sperm bank in Denmark was found to have a genetic mutation that significantly increased the risk of multiple cancers. But his sperm had already been used to conceive at least 197 children across Europe. Some of those children developed cancer. Some died. Many countries already have legal limits for donors. In Malta and Cyprus, for example, both egg and sperm donors are allowed to contribute to the birth of just a single child, according to data presented at the European Society of Human Reproduction and Embryology (ESHRE) meeting in London on July 8. Other countries set limits based on the number of families a single donor can contribute to, allowing recipients to have children who share a genetic link. In the UK, that limit is set at 10 families per donor. But these limits are difficult to enforce, partly because donated gametes don’t necessarily stay in their original country. In Denmark, the national limit is set at 12 families. But the country is a major exporter of sperm. In the UK, for example, more than half of sperm donations in 2020 were imported—with most of those coming from either Denmark or the US. “The only thing that really makes sense is a transnational limit,” Jackson Kirkman-Brown, a professor of reproductive biology at the University of Birmingham, said at the meeting. Kirkman-Brown and his colleagues have spent months putting together a document that represents ESHRE’s position on these limits. After consulting with fertility specialists, clinics, sperm and egg banks, donors, and donor-conceived people, the team has developed a plan to start with a Europe-wide limit on sperm and egg donations. ESHRE is calling on sperm and egg banks, as well as fertility clinics, to respect an initial limit of 50 families per donor. That’s still very high, according to a handful of people I spoke to at the meeting. But at least it’s a start. Europe should move toward setting limits at 15 families per donor, Kirkman-Brown said. “We may find that 15 is also too high,” says Vasanti Jadva, who studies the psychological well-being of people conceived using donated eggs, sperm, and embryos at City St George’s in London. “We still don’t know what the right number is.” It will be difficult to enforce these limits, too. And if they end up limiting the supply of donor sperm, there’s a chance that some people will turn to unregulated sperm donations from people who do not undergo health screening. Unregulated donations can lead to other problems for prospective parents, including the possibility that donors will seek parental rights over the children conceived using their sperm. And it will be even harder to establish international limits. When I asked the American Society of Reproductive Medicine for its thoughts on ESHRE’s proposed limits, a representative directed me to a guidance document saying “it has been suggested” that for a population of 800,000, single donors should be limited to “no more than 25 births” in order to avoid the risk that relatives will have children together. (Considering the US has a population of over 340 million, the total figure could be pretty high, but many sperm banks opt to limit the number of families contributed to by a single donor at around 25.) Van der Meer thinks that even a limit of five families from a single donor would be high. International donation makes it even harder for donor-conceived people to connect with genetic relatives, so the limit for international contributions should be set at two

Sperm donors need limits, says a European fertility group Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

Google Research Introduces SensorFM: A Wearable Health Foundation Model Pretrained on One Trillion Minutes of Sensor Data

Most wearable health models are built one outcome at a time. That approach breaks down at thirty-five endpoints. Labels are expensive and retrospective annotation is infeasible. Google Research introduced SensorFM, a foundation model for wearable health pre-trained on more than 1 trillion minutes of sensor data from 5 million people. https://arxiv.org/pdf/2605.22759 What is SensorFM? SensorFM is a Large Sensor foundation Model for wearable time-series representation learning. It ingests 34 one-minute aggregate features drawn from five sensors: PPG, accelerometer, EDA, skin temperature, and altimeter. Those features are organized into seven categories, over a 24-hour context window. The backbone is a ViT-1D encoder trained with a masked-autoencoder objective and a patch size of [20, 1]. Pretraining used 5,000,000 consented participants, sampled between September 2024 and September 2025. That corpus spans 100+ countries, all 50 U.S. states, and 20+ Fitbit and Pixel Watch models. It totals over two billion hours, or more than one trillion minutes. Four variants exist, each paired with a proportional data volume. Variant Parameters Encoder hidden / layers Proportional data Sensor-hours XXS 138,740 64 / 2 5K subjects 2×10⁶ XS 933,204 128 / 4 50K subjects 2×10⁷ S 7,290,068 256 / 8 500K subjects 2×10⁸ B 110,763,412 768 / 12 5M subjects 2×10⁹ Evaluation uses separate data. It covers 13,985 subjects across three prospective IRB-approved studies. Those are metabolic, cardiac and respiratory health (N = 1,655), sleep (N = 6,377), and mental health (N = 5,953). The 35 tasks cover cardiovascular (6), metabolic (8), mental health (8), sleep (3), demographics (4), and lifestyle (6). The Scaling Case With that setup, the first question is whether scale buys anything measurable. The research team swept four model sizes against four data volumes. SensorFM-B on the 5M corpus cuts reconstruction validation loss by 31% versus SensorFM-XXS. Generative loss drops 28% on average. Downstream, it gains ΔAUC = 0.09 on classification and Δr = 0.21 on regression. Across variants, B wins 33 of 35 tasks, and XXS ranks last on 33 of 35. The failure case is equally informative. SensorFM-B trained on only 5K subjects posts a 1.082 validation loss. That is worse than every smaller variant at the same volume. Pretraining was stopped early because the model overfit. https://arxiv.org/pdf/2605.22759 Consequently, all headline results assume data volumes scaled proportionally to capacity. Along that co-scaled diagonal, mean ROC AUC moves .664, .681, .710, .752. Mean Pearson r moves .386, .435, .536, .612. The above figure shows the trend has not saturated. AIM: Handling Missing Data as Signal Scaling alone does not explain those numbers. Real streams fragment during charging, off-wrist periods, and power-saving modes. Conventional methods either impute the gaps, injecting bias, or drop the windows, discarding data. SensorFM instead uses Adaptive and Inherited Masking (AIM), introduced by Xu et al. in LSM-2. The applied mask is the union of the inherited missingness mask and the artificial mask. Loss is computed only on artificially masked patches that had ground truth. Two-stage token masking, using token dropout and attention masking, keeps this efficient. Because the decoder learns to reconstruct ablated observations, imputation and forecasting come for free. Generative task Mean fill NN fill Linear interp. SensorFM-B Random imputation, 80% 0.915 1.020 0.854 0.215 Temporal interpolation, 60 min 0.904 0.943 0.777 0.468 Temporal extrapolation, 60 min 0.937 1.102 1.102 0.563 Signal imputation, 12/26 channels 1.025 1.025 1.025 0.170 Reconstruction MSE on the held-out test set, lower is better. Against the best baseline, SensorFM improves random imputation by 74.8%. Sensor signal imputation improves by 83.7%. Hands-On: Adapting the Embeddings Turning that representation into predictions is straightforward. The encoder stays frozen. Embeddings are aggregated per person, using the mean and standard deviation across days. Those reduce to 50 principal components. A linear head then trains under five-fold, person-independent cross-validation. Copy CodeCopiedUse a different Browser import numpy as np from sklearn.decomposition import PCA from sklearn.linear_model import LogisticRegression from sklearn.model_selection import StratifiedKFold from sklearn.metrics import roc_auc_score def person_level(emb, pid): “””Collapse day-level embeddings into one vector per participant.””” people = np.unique(pid) feats = [] for p in people: e = emb[pid == p] # (n_days, d) feats.append(np.concatenate([e.mean(axis=0), e.std(axis=0)])) return np.nan_to_num(np.stack(feats)), people # pandas std() is NaN at 1 day X, people = person_level(emb, pid) # emb: frozen SensorFM embeddings y = labels[people] # one label per participant aucs = [] for tr, te in StratifiedKFold(5, shuffle=True, random_state=0).split(X, y): pca = PCA(n_components=50).fit(X[tr]) # PCA-50, fit on the train fold only clf = LogisticRegression(max_iter=400) # paper: AdamW, lr 5e-3, wd 1e-4, 400 steps clf.fit(pca.transform(X[tr]), y[tr]) p = clf.predict_proba(pca.transform(X[te]))[:, 1] aucs.append(roc_auc_score(y[te], p)) print(np.mean(aucs)) This linear probe beats a supervised feature-engineered baseline on 34 of 35 tasks. Selected results follow. Task Metric Demos. only Feat. Eng. SensorFM-B Age r – .662 .920 Mental Health Med. ROC .594 .773 .819 PHQ-8 r .303 .354 .450 Insulin Resistance ROC .717 .710 .761 Hypertension Dx ROC .762 .747 .786 Framingham 30 Risk r .782 .592 .714 The last row is not an outlier. ASCVD and Framingham scores are calculated from demographic features. Demographic-only models therefore win by construction. The research team reports SensorFM best on 31 of 35 tasks, not all of them. Two caveats sit in the same tables. Demographics still help SensorFM on 22 of 30 tasks, though the lift shrinks with scale. In very-low-label regimes, demographic priors alone remain strong. The Agentic Classroom Even a linear probe needs per-task tuning. To automate that, the research team ran a ‘classroom’ of five LLM student agents. These span gemini-2.5 flash through gemini-3.1 pro preview. Agents generate, execute, score, and refine Python heads over 20 cycles, using unreduced embeddings. In total they ran 30,516 experiments. Agent-found heads beat the linear probe on 16 of 20 classification tasks, measured by F1. They also raised Pearson correlation on 12 of 15 regression tasks. Solution quality tracked the Artificial Analysis Intelligence Index. The winning solutions are conservative. Almost all reduced the embedding space to 50–100 dimensions. Linear models outnumbered non-linear ones, and ensembles appeared in under a quarter. Grounding a Personal Health Agent The final experiment tests SensorFM as a

Google Research Introduces SensorFM: A Wearable Health Foundation Model Pretrained on One Trillion Minutes of Sensor Data Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

The Download: Claude’s inner workings and OpenAI’s “super app”

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Anthropic found a hidden space where Claude puzzles over concepts The AI firm Anthropic has got the clearest glimpse yet at what’s really going on inside large language models as they answer questions or carry out tasks. What they found ranges from the mundane to the unnerving.  Researchers at the company built a tool called the Jacobian lens (or J-lens) and used it to uncover a hidden area, which they named the J-space, inside its flagship LLM, Claude. The J-space contains words related to the response a model is working on but may not ultimately produce. If Claude were a person (which it is not), you might say these hidden words reveal what’s on its mind before it actually speaks.  Read the full story on what they found. —Will Douglas Heaven The must-reads I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology. 1 OpenAI has unveiled its long-awaited “super app” ChatGPT Work blends its chatbot, coding tool, and new models. (Reuters $)+ It’s designed to do your work for you and with you. (Ars Technica)+ And arrived the same day as OpenAI’s GPT 5.6 models. (NYT $)+ It’s also developing a fully automated researcher. (MIT Technology Review) 2  Humanoids have performed teleoperated surgery on living animalsIn the world-first, they removed gallbladders from pigs. (Ars Technica)+ The human work behind humanoids is hidden. (MIT Technology Review) 3 SK Hynix has landed the largest US listing by a foreign companyThe South Korean chip giant raised $26.5 billion. (CNN)+ Demand for AI data centres has led its profits to skyrocket. (Guardian)+ But its jumbo share sale may be a sign of overheated times. (FT $)+ South Korea’s hottest bachelors are chip workers. (MIT Technology Review) 4 Tencent is leading a deal to unwind Meta’s $2 billion Manus acquisitionIt’s in talks to become the Chinese AI startup’s largest shareholder. (FT $)+ Tencent will reportedly buy Manus for no less ​than $2 billion. (Reuters $)+ Beijing had ordered Meta to unwind the acquisition. (Bloomberg $) 5 Resuscitated human retinas responded to light 10 hours after deathIt’s a big step towards eye transplants that restore vision. (New Scientist $)+ As is a new device that revives dead eyeballs. (MIT Technology Review) 6 Meta has started charging for AI accessA new version of Muse Spark has a paid tier for developers. (Quartz) + Meta also plans to start producing an AI chip in September. (Reuters $) 7 OpenAI and Google have sold AI models to blacklisted China groupsVia Singapore-based subsidiaries of Alibaba, Baidu and Tencent. (FT $) 8 A daughter tested an AI “death bot” of her fatherThe technology provided both comfort and unease. (New Yorker $) 9 An astronomer says the hunt for alien life needs more statisticsHe wants to replace speculation with mathematical frameworks. (Quanta) 10 Pokémon Go players turned Times Square into a giant battlefieldMore than 1,500 fans finally fulfilled the game’s 2016 launch promise. (Wired $)+ Pokémon Go is also training world models. (MIT Technology Review) Quote of the day “When we’re talking about AI, we love the hype, we get excited about it. The damn thing never actually lands in practice.” —Vijay Janapa Reddi, an engineering professor at Harvard University, tells Wired why he’s skeptical about grand plans for AI. One More Thing B.F. SKINNER FOUNDATION Why we should thank pigeons for our AI breakthroughs In 1943, psychologist B.F. Skinner led a secret government project to make bombs more precise. His idea: teach pigeons to guide missiles by pecking at targets on a screen inside a warhead. To train them, Skinner rewarded the birds with food when they made the right decisions, using trial and error to shape their behavior. Unsurprisingly, the military never deployed Skinner’s kamikaze pigeons. Yet his experiments convinced him that pigeons were “an extremely reliable instrument” for studying learning.   Decades later, those same principles would help power reinforcement learning, the technology behind some of today’s most advanced AI systems. Discover how pigeons inspired one of AI’s most powerful techniques. —Ben Crair We can still have nice things A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.) + Here’s a splendid selection of this year’s NSW architecture award winners.+ Photographers have captured the Strawberry Moon’s golden glow in stunning detail.+ Idiocracy is the film that best exemplifies the “American experience,” according to a new poll. Look back at the prescient comedy with this Screen Junkies trailer.+ Get ready for the weekend with this psychedelic house journey from Jamie xx b2b Caribou.

The Download: Claude’s inner workings and OpenAI’s “super app” Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

Four nuclear reactors hit a big milestone in the US

I was really looking forward to July 4, and not just because I love a poolside barbecue. This year the American holiday also marked a big symbolic deadline for US nuclear power. Last year the Trump administration set a goal to see three new microreactors achieve criticality, a technical milestone establishing that a reactor can sustain a chain reaction, by the nation’s 250th birthday. And just in time, four reactors did so. It was a lofty goal, and seeing not just three but four companies meet it is certainly a positive sign for emerging nuclear technologies at a time when the world is facing increased need to increase electricity supply and address climate change with emissions-free technologies. But achieving criticality doesn’t mean a reactor is ready to provide electricity for the grid (or at all, for that matter). Let’s untangle what this program’s success could mean for nuclear power in the US, and where these companies might go from here. The Reactor Pilot Program essentially opened a special door for prototype reactors to fast-track development. In August, the US Department of Energy selected 11 reactor projects for the program and offered them land and support from the national labs system. These are all microreactors; the large light-water reactors that dominate the grid today are tens or even hundreds of times their size.  Antares Nuclear was the first to achieve criticality, reaching the milestone in June in its Mark-0 test reactor. Reactors from Valar Atomics, Deployable Energy, and Aalo Atomics followed. (Aalo hit the mark in the early hours of July 4—an inspiring example of just barely meeting a deadline.) The speed with which these companies hit this milestone is impressive, especially in an industry known for massive projects that frequently blow past deadlines and stated budgets. (Valar, Antares, and Aalo were all founded in 2023, and Deployable started in 2025.) But reaching criticality and running a reactor that can produce electricity are two totally different things. All these reactors reached what’s called zero-power criticality. Basically, it’s a test of whether you can start a nuclear chain reaction, with no meaningful power coming from the reactor. “A zero-power-criticality test can be achieved without making real engineering progress on fuel or design,” Kathryn Huff, a former assistant secretary for nuclear energy and chair of the Department of Nuclear Engineering and Engineering Physics of the University of Wisconsin–Madison, said on an episode of the Catalyst podcast earlier this year. Now, with the completion of this program, the companies will need to continue their work to make power, which could involve some big technical challenges. In some cases they’ll need to add significant equipment, like the cooling systems to transfer the heat out of the reactor core. The companies are projecting aggressive timelines moving forward. Aalo says it’s already begun work on the second reactor and plans to produce 10 megawatts of electricity to power an on-site data center in 2027. Deployable Energy says it plans to deploy commercial reactors by 2028.  I tend to take timelines from startups, especially in nuclear, with a grain of salt. Not only are these remarkably complex technical machines, but companies often run into problems outside their own control, like regulatory challenges—which these new projects could soon face.  The Nuclear Regulatory Commission is in charge of civilian and commercial nuclear use in the US, and historically, the process to get nuclear reactors approved has been quite slow. The agency did propose a new framework for microreactor approvals earlier this year, which is designed to speed up the process—but it’s yet to be seen how quickly things will move. (And it’s worth noting here that some nuclear experts have questioned whether the agency under the Trump administration is loosening nuclear rules too much.) Some nuclear supporters aren’t applauding the microreactor milestone. Federal focus on the program is an “unhelpful diversion” from goals to meaningfully increase nuclear capacity, according to one analysis by Third Way, a public policy think tank. “Artificially accelerating project timelines is a short-term solution, not a long-term fix,” the memo reads.  Criticality is a big first step, but a lot will still have to happen for any of these microreactors to come online, much less for these small reactors to be a significant source of electricity for the grid.  This article is from The Spark, MIT Technology Review’s weekly climate newsletter. To receive it in your inbox every Wednesday, sign up here. 

Four nuclear reactors hit a big milestone in the US Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

Datalab Lift vs the Field: How a 9B Schema-First Extractor Compares with NuExtract3, LlamaExtract, Marker, and Docling

Datalab’s Lift is a focused document extraction tool with a specific promise: give it a PDF or image plus a JSON Schema, and it returns schema-shaped JSON directly. Instead of converting a document to Markdown first and then asking another model to extract fields, Lift reads rendered page images and attempts to emit the final structured object in a single pass. According to Datalab, Lift is a 9B vision model for structured JSON extraction from PDFs and images, supports schema-constrained decoding, and returns JSON that matches the user’s schema. That positioning matters because Lift is not mainly an OCR engine, not mainly a PDF-to-Markdown converter, and not a full enterprise document review platform. It is best understood as a schema-first document extractor: a model for turning visually complex documents into application-ready fields. First, the distinction that organizes everything: parsing vs. extraction Most document AI tools solve one of two different problems: Parsers turn documents into faithful intermediate representations: Markdown, HTML, JSON blocks, layout trees, tables, headings, reading order, and chunks for retrieval. Tools such as Docling, MinerU, Marker, Unstructured, PyMuPDF, OCRmyPDF, and Surya primarily fall into this category. Their output is document-shaped. Extractors turn documents into the fields an application actually needs. You define a schema — for example, invoice_number, vendor_name, total, due_date, or line_items[] — and the system tries to return those values directly. Lift, NuExtract3, LlamaExtract, Reducto Extract, Extend, Azure Content Understanding, and other cloud extraction APIs belong closer to this category. Their output is schema-shaped. That distinction matters because many production systems still follow a parse-then-extract pattern: convert a PDF to Markdown or structured text, then send that representation to an LLM with a schema. Lift’s bet is to collapse that workflow into a single visual extraction pass. That can reduce pipeline complexity, but only when the real goal is field extraction rather than faithful document reconstruction. The competitive map Lift sits at the intersection of several overlapping categories: Open-weight extraction VLMs such as NuExtract3 Frontier multimodal LLMs with structured-output modes Cloud document AI systems such as Azure, Google, and AWS Commercial extraction platforms such as Reducto, Extend, LlamaExtract, and Datalab’s own API Open-source document parsers such as Docling, MinerU, Marker, and Unstructured Structured-generation libraries such as XGrammar, Outlines, Instructor, BAML, and related JSON-output systems The important point is that not all of these tools are direct competitors. Some compete with Lift directly. Others are adjacent infrastructure. A parser like Docling is not trying to solve the same problem as Lift. A constrained-decoding library is not a document model at all. A commercial extraction platform may include extraction models, citations, review workflows, and compliance infrastructure. Lift is narrower: it is the raw schema-first extractor. Lift vs. NuExtract3: the closest open-weight comparison NuExtract3 is probably Lift’s closest open-weight competitor. NuMind describes NuExtract3 as a unified 4B vision-language reasoning model for document understanding, combining structured information extraction with image-to-Markdown conversion for documents such as scans, receipts, forms, invoices, contracts, and tables. Its Hugging Face model card lists it under an Apache-2.0 license. The contrast is straightforward. Lift is larger at 9B and, in Datalab’s own benchmark, reports stronger field accuracy than NuExtract3: 90.2% versus 81.5%. NuExtract3 is smaller, more permissively licensed, and also positioned as a Markdown-conversion model. So the practical decision is not only accuracy. If the priorities are permissive licensing, smaller local deployment, and a single model that can also convert documents to Markdown, NuExtract3 is attractive. If the priority is schema-first field extraction with Datalab’s reported speed-accuracy trade-off, Lift becomes more compelling. Lift vs. frontier multimodal LLMs A common alternative is to send the document to a frontier multimodal LLM and ask for structured output. In Datalab’s benchmark, Gemini Flash 3.5 slightly outperforms Lift on field accuracy and full-document accuracy, while Lift is much faster in the reported setup: 9.5 seconds median latency for Lift versus 28.1 seconds for Gemini Flash 3.5. That does not mean Lift is always better. Frontier models remain attractive when volume is modest, setup time matters more than infrastructure control, and cloud processing is acceptable. Lift’s advantage appears when latency, data residency, repeatable self-hosting, and large-volume cost control matter. Lift vs. cloud document AI platforms Azure AI Document Intelligence, Azure Content Understanding, Google Document AI, and AWS Textract are managed cloud services rather than just models. They provide enterprise infrastructure for document processing, including deployment controls, service reliability, monitoring, procurement processes, and integration with broader cloud ecosystems. Microsoft describes Azure Content Understanding as a way to transform unstructured data into structured, machine-readable information while preserving structural relationships. In Datalab’s benchmark, Azure Content Understanding reports lower field accuracy and higher latency than Lift, but it includes citations, which Lift’s open weights do not. Datalab’s own hosted API also adds per-field verification, citations, and confidence scores beyond the open model. This is the cloud tradeoff. Cloud platforms are usually easier to adopt within companies already standardized on Azure, Google Cloud, or AWS. They may also be stronger choices when enterprise governance matters more than raw speed. Lift’s counterargument is portability: teams can run the extraction model locally or through their own vLLM deployment rather than sending every document to a hosted API. For handwriting-heavy, low-quality scans, clinical forms, annotation-heavy documents, or regulated workflows requiring traceability, the cloud and managed platforms should be benchmarked directly against Lift rather than assumed inferior. Lift vs. commercial extraction platforms Reducto, Extend, LlamaExtract, Mindee, and Datalab’s own hosted API occupy a different layer of the market. They are not only extraction models; they are extraction systems. Their value is not limited to field accuracy. They add provenance, review workflows, schema management, confidence scoring, citations, deployment controls, and enterprise compliance. Reducto’s Extract product is positioned around schema-typed JSON extraction with optional citations, while its Parse product emphasizes typed blocks, bounding boxes, and confidence scores. LlamaExtract similarly advertises custom-schema extraction with granular citations and confidence scores. This is where Lift’s open model is intentionally thinner. The open weights prioritize fast, schema-first extraction. Datalab’s hosted API adds the production features

Datalab Lift vs the Field: How a 9B Schema-First Extractor Compares with NuExtract3, LlamaExtract, Marker, and Docling Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

NVIDIA Releases Nemotron-Labs-3-Puzzle-75B-A9B: A Compressed Hybrid MoE LLM Delivering 2.03x Server Throughput at Matched User Throughput

Large hybrid MoE models like Nemotron-3-Super are accurate but expensive to serve. Their active parameters, KV cache, and Mamba state cap how many users a node can hold at a given per-user token rate. NVIDIA AI team has released Nemotron-Labs-3-Puzzle-75B-A9B, a compressed variant of Nemotron-3-Super. The parent model has 120.7B total and 12.8B active parameters. The compressed model has 75.3B total and 9.3B active parameters. The deployment target was fixed before the architecture search began. Target one was 2x server throughput at 100 tokens per second per user. Target two was 8 concurrent 1M-token requests on a single H100. Three checkpoints on Hugging Face: BF16, FP8, and NVFP4. TL;DR 120.7B/12.8B active compresses to 75.3B/9.3B active, with the 88-block hybrid layout preserved. 8xB200 total throughput rises 1.60x to 2.14x over Super at matched NVFP4 and matched user throughput. Single-H100 1M-token concurrency goes 1 to 8, driven by a 70 GB to 44.5 GB weight drop. Iterative Puzzle beats single-step Puzzle by 0.57 average points at the same compression target. Arena-Hard-V2 (-4.2) and SWE-Bench (-2.6) are the real costs; RULER and AA-LCR barely move. Nemotron-Labs-3-Puzzle-75B-A9B Nemotron-3-Super is a hybrid Mamba-Transformer MoE model. Puzzle-75B-A9B preserves the parent’s block layout exactly. It has 88 blocks: 40 Mamba, 40 MoE, and 8 attention blocks. What changed is capacity inside those blocks: Quantity Super Puzzle-75B-A9B Ratio Total parameters 120.7B 75.3B 62.4% Active parameters 12.8B 9.3B 73.1% Mamba SSM state size 128 96 75% MoE routed expert intermediate size 2688 1280-2688 Mean 59.9% Activated routed experts per token 22 4-18 Mean 50% Active routed expert capacity (relative) 100% 8.7%-62.3% Mean 30.9% The number of routed experts, the shared expert size, and the MoE latent size are unchanged. Attention layers were left untouched. The proposed research’s stated reason is that Nemotron-3-Super is already very KV-cache efficient. Mamba layers were pruned uniformly, because inference frameworks do not support a different SSM state size per layer. https://arxiv.org/pdf/2607.04371 The result is not a uniformly scaled-down teacher. The above figure shows the allocation across depth. Puzzle preserved capacity in selected middle and late layers, and cut hard elsewhere. Benchmark and Performance The below table reports Pareto-optimal total throughput on a single 8xB200 node, with single-step decoding. Scenario (in/out) UT floor Super (tok/s) Puzzle-75B-A9B (tok/s) Boost 50K / 2K >= 100 5,128 8,210 1.60x 50K / 2K >= 125 3,784 6,412 1.69x 50K / 2K >= 150 2,532 4,523 1.79x 8K / 64K >= 100 20,939 42,601 2.03x 8K / 64K >= 125 13,074 27,918 2.14x 8K / 64K >= 150 8,522 18,047 2.12x Both models were served at matched NVFP4 weights, FP8 KV cache, and FP16 Mamba state. The gap therefore reflects compression, not a change in numeric format. The prefill-heavy 50K/2K regime gains least. The decode-heavy 8K/64K regime gains most. On a single 8xH100 node at UT = 100, the gains are smaller. They are 1.91x on 50K/2K and 1.82x on 8K/64K. Both models there use FP8 weights, FP8 KV cache, and FP32 Mamba state. On a single H100 at 1M context, the binding constraint flips from compute to memory. Super’s NVFP4 weights occupy about 70 GB of the 80 GB HBM budget. Each 1M-token request adds about 4 GB of KV cache. Effective concurrency is therefore 1. Puzzle-75B-A9B’s NVFP4 weights occupy about 44.5 GB. Attention layout is unchanged, so per-request KV cost is unchanged. Concurrency at 1M rises to 8. Aggregate decode throughput at that concurrency is roughly 4x Super’s single-request throughput. Prefill of a 990K-token prompt is about 1.2x faster. How Iterative Puzzle Works Puzzle is a decomposed neural architecture search framework, implemented here as Puzzletron. It defines a discrete search space of alternative layer implementations. Each alternative gets a quality score. A mixed-integer program then selects one alternative per layer under a deployment constraint. Three pruning techniques form the search space: Intermediate channel pruning: Channels inside each routed expert are ranked by contribution to the expert’s output. All experts within one MoE layer are pruned to a uniform size, for kernel compatibility. Top-k reduction: The number of experts a token is routed to varies per layer, up to the parent’s k=22. Mamba SSM pruning: The SSM state size drops from 128 to 96 channels. The SSM result is measured. Dropping 128 channels to 96 speeds the SSM kernel 1.2x to 1.3x during decode. This holds at batch sizes between 8 and 512. Channels were ranked by estimated contribution to the Mamba layer output. The estimate averaged over 67M tokens of validation data. Appendix A shows this beats random channel selection under aggressive pruning. The original formulation assumes replacement quality impacts are approximately additive. Each candidate block is scored inside the unmodified parent. That ignores higher-order interactions between replacements. Iterative Puzzle alternates bounded compression with short knowledge distillation recovery. It builds a sequence M0, M1, … MR instead of jumping to the target. Scores are recomputed against the current compressed model, not the original parent. Three stages were used: MoE weights to 75% of teacher capacity, Mamba SSM state to 75%. Healed for 24B tokens. MoE weights to 60% of teacher capacity. Healed for 43.2B tokens. Activated routed-expert budget to 50%, allocated heterogeneously. Healed for 52.8B tokens. https://arxiv.org/pdf/2607.04371 The above table compares this against a single-step Puzzle baseline at the same target. The three-step procedure averages 69.05 across ten benchmarks, against 68.48. Gains appear on MMLU-Pro, GPQA, HLE, AA-LCR, LiveCodeBench, SciCode, and RULER-256K. IFBench-Instruction fell 0.2 points and IFBench-Prompt fell 0.5. Recovery: Distillation, RL, and Verbosity Knowledge distillation ran on 30% pretraining data and 70% SFT data from Nemotron-3-Nano. During the Puzzle phase, KD used a 32K sequence length. Recovery then trained at 128K, and scaled to 512K. The budget was up to 100B tokens, with a 16M-token global batch, in Megatron-LM. RL post-training adopted Stage 2 of the Nemotron-3-Super RL pipeline, focused on software engineering. Phase 2.1 did single-step tool-use comparison. Phase 2.2 moved to end-to-end sandbox RL, where agents run up to 200 turns. Both phases used a KL penalty of 0. The team swept learning

NVIDIA Releases Nemotron-Labs-3-Puzzle-75B-A9B: A Compressed Hybrid MoE LLM Delivering 2.03x Server Throughput at Matched User Throughput Beitrag lesen »

AI, Committee, Nachrichten, Uncategorized

The Download: a nuclear landmark, and China eyes Nvidia chips

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. Four nuclear reactors hit a big milestone in the US —Casey Crownhart I was really looking forward to July 4, and not just because I love a poolside barbecue. This year the American holiday also marked a big symbolic deadline for US nuclear power. Last year the Trump administration set a goal to see three new microreactors achieve criticality, a technical milestone establishing that a reactor can sustain a chain reaction, by the nation’s 250th birthday. And just in time, not just three, but four reactors did so. It’s a positive sign for nuclear technologies at a time of increasing need for electricity and emissions-free energy sources. But achieving criticality doesn’t mean a reactor is ready to provide electricity for the grid (or at all, for that matter). Here’s what the milestone could mean for nuclear power in the US—and where the four companies might go next. This story is from The Spark, our weekly climate tech newsletter. Sign up to receive it in your inbox every Wednesday. The must-reads I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology. 1 China plans to let its top AI firms buy Nvidia H200 chipsAlibaba, ByteDance, and DeepSeek are set to get permission. (Information $)+ China had previously withheld approval despite US authorization. (Reuters $) 2 NATO is building a network to stop Russian attackers in their tracksIt will use sensors, drones, satellites, and AI to detect them. (Business Insider)+ Troops are donning odd camouflage to elude drones. (Economist $)+ The US wants cheaper drones as Iran’s wrecking its Reapers. (Ars Technica) 3 Researchers have a new idea to fight future El Niños: dimming the sunDeflecting solar energy could cool the ocean and mitigate the risks. (Wired $)+ But there could be unexpected consequences. (New Scientist $)+ And geoengineering as a field is getting a reality check. (MIT Technology Review) 4 Meta is patenting an AI device that records users to analyse emotionsIt ostensibly aims to tailor workout plans to the user’s mood. (404 Media)+ AI memory is privacy’s next frontier. (MIT Technology Review) 5 Chipmakers are going vertical as Moore’s Law slowsThey’re stacking transistors to keep chips advancing. (Economist $)+ IBM is betting on the technique. (MIT Technology Review) 6 Ivy League students suspected of AI cheating saw scores fall in personFrom 96% all the way down to 48%. (Ars Technica)+ AI giants want to take over the classroom. (MIT Technology Review) 7 A new study says parents’ phone addictions damage bonds with kidsIt can exacerbate “insecure attachment” for life. (Bloomberg $)+ And make children more anxious and avoidant. (Gizmodo) 8 A judge approved Musk’s $1.5 million Twitter settlement with the SECDespite what she called “serious misgivings” and “red flags.” (Reuters $)+ Musk was accused of skirting stock disclosure rules. (Fortune) 9 Shoebox-sized “detector satellites” could find nuclear bombs in spaceCubesats carrying the detector could sense a bomb’s radiation. (Space)+ Russia is suspected of developing space-based nukes. (Reuters $) 10 A World Cup match drove Google Search traffic to a new recordThe milestone came after Argentina’s comeback against Egypt. (CNBC) Quote of the day “I talk about it on Tic Tac.” —President Donald Trump tells the public where to find his insights on the dangers of communism, Gizmodo reports. One More Thing Robots are bringing new life to extinct species Paleontologists aren’t easily deterred by evolutionary dead ends or a sparse fossil record. And in the last few years, they’ve developed a new trick for turning back time and studying prehistoric animals: building experimental robotic models of them.  In the absence of a living specimen, an ambling, flying, swimming, or slithering automaton is the next best thing for studying the behavior of extinct organisms. Learning more about how they moved can in turn shed light on their lives, such as their historic ranges and feeding habits. Scientists can simply sit back and observe their behavior in different environments.  Read the full story on the rise of paleo-inspired robots—and four examples that are shedding light on creatures of yore. —Shi En Kim We can still have nice things A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.) + Georgia Hill’s monochrome artworks are filled with visual harmony.+ AI has salvaged text from a papyrus scroll burned to a crisp when Mount Vesuvius erupted 2,000 years ago.+ Rare images taken by a Japanese space probe show a near-Earth asteroid resembling a cuddly snowman.+ “Another One Bites the Bee Gees” smoothly merges two classic tracks with a 4/4 time signature into the perfect song for applying CPR.

The Download: a nuclear landmark, and China eyes Nvidia chips Beitrag lesen »

We use cookies to improve your experience and performance on our website. You can learn more at Datenschutzrichtlinie and manage your privacy settings by clicking Settings.

Privacy Preferences

You can choose your cookie settings by turning on/off each type of cookie as you wish, except for essential cookies.

Allow All
Manage Consent Preferences
  • Always Active

Save
de_DE