YouZum

Committee

AI, Committee, 新闻, Uncategorized

The Download: AI’s popularity paradox and EmTech Future 2026

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. People really hate AI, so why can’t they get enough? —Will Douglas Heaven Over the summer I talked to the CEO of Springboards, a startup building an LLM designed to come up with a wide variety of responses. He said something that’s been stuck in my head since: “We often say that we’re a self-loathing AI company. We don’t know if we really like what we’re doing.” My reply? “I guess that makes me a self-loathing AI journalist.” It was a joke! I love my job. But I do not love many of the things the technology I write about has become: warped by hype, steered by zealots, inescapable—and I’m far from alone. Around the world, a love/hate attitude toward AI is very much the vibe right now. Public sentiment is souring fast, with more people saying AI will have a negative impact than a positive one. At the same time, AI use is skyrocketing. So why do people hate AI but keep coming back for more? Here’s my theory. To stay up-to-date with the latest in AI, sign up to get The Algorithm, our weekly AI newsletter, in your inbox every Monday. EmTech Future 2026: when AI meets everything Last week, EmTech Future 2026 explored some of the biggest questions shaping technology right now: how AI is changing industries, where quantum is heading, what new energy systems could make possible, and how robotics are evolving. It also looked at what happens when these technologies start to converge. The full program is now available on demand. And today, we’re releasing two sessions exclusively to subscribers: a chat with Google Research’s Yossi Matias on how AI is reshaping biology, infrastructure, manufacturing and science, and a special panel with MIT Technology Review editors that takes you inside our newsroom. Watch the sessions and access the full EmTech Future 2026 program here. The must-reads I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology. 1 Trump has unveiled a “Super Intelligence Force” to oversee AIThe group will coordinate US AI policy and industry engagement. (NBC News)+ Trump named national intelligence chief Jay Clayton as its leader. (NPR)+ Elon Musk says he will rename SpaceXAI to SpaceXSI. (Reuters $)+ Trump has doubled down on voluntary AI safeguards. (Information $)+ Who’s liable when AI agents go rogue? (MIT Technology Review) 2 Zelensky asked Trump to block Russia and China’s Starlink rivalThe two countries are developing a satellite network for the battlefield. (FT $)+ Trump reportedly deferred the decision to Elon Musk and SpaceX. (TNW) 3 An AI version of a murder victim has upended his killer’s sentenceAn appeals court has ruled that the original deepfake of the victim “forgiving” his killer should never have been aired in court. (BBC)+ The original judge said he “loved” the footage and found it genuine. (NBC News)+ But the appeals court said it presented imagined thoughts as fact. (NYT $) 4 Americans are turning to hybrid cars as fuel prices soarSUVs and pickups are losing ground to more efficient vehicles. (NYT $)+ What’s next for EV batteries? (MIT Technology Review) 5 China’s digital trade “superweapon” has quietly fallen apartLOGINK’s partnerships have collapsed amid US scrutiny. (Reuters $)+ Chinese AI has divided the White House. (MIT Technology Review) 6 AI has learned to exploit the software checking its mathsDevelopers have added defenses against proof-checking. (New Scientist) 7 GPT-6 Astra couldn’t beat humans at StarCraft—so it cheatedIt downloaded the best human-made bot and ran that instead. (Verge+ Here’s why AI agents lie and cheat. (MIT Technology Review) 8 The solar system has been given a dramatically shorter lifespanNew simulations cut it from 100 billion years to just a few billion. (404 Media) 9 Forensic technologies exposed fresh evidence of Egyptian sacrificeThey revealed blunt force trauma that archaeologists previously thought was natural. (Ars Technica) 10 A new fossil shows dinosaurs found multiple ways to evolve flightThey developed similar flight adaptations in different sequences. (Nature) Quote of the day “We believe that the world should accept some bad things happening for the benefits of this technology.” —Sam Altman tells Politico that AI’s potential rewards justify its downsides. One more thing Inside the stealthy startup that pitched brainless human clones After operating in secrecy for years, R3 Bio, a California-based startup, suddenly revealed this spring that it had raised money to create nonsentient monkey “organ sacks” as an alternative to animal testing. But there is more to the story. And R3 doesn’t want that story told. MIT Technology Review discovered that founder John Schloendorn also pitched a startling, ethically charged vision: “brainless clones” that serve as backup human bodies. Find out all the details on the radical proposal.  —Antonio Regalado We can still have nice things A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.) + Trace the weird history of space food with this short documentary+ Meet the winner of Iowa’s annual hay bale toss, who threw one 13 feet 6 inches into the air.+ 40 filmmakers in 25 countries have captured the natural world entirely on Super 8 in a collective ode to our planet.+ This newsletter makes a compelling argument for us to spend more time doing nothing together.

The Download: AI’s popularity paradox and EmTech Future 2026 Read Post »

AI, Committee, 新闻, Uncategorized

Bringing predictive analytics to the agentic AI era 

In 2026, the question for enterprise AI is no longer whether predictive models can outperform statistical forecasts—that argument is settled. The big question now is how to enable predictive systems to act on their own conclusions without drifting from business intent. The frontier has moved from prediction to autonomous decision making, and the gap between leaders and laggards is widening accordingly. “Enterprises are done with a backward-looking point of view; they want to be more forward-thinking,” says Vishal Gupta, partner at research firm Everest Group. DOWNLOAD THE REPORT Intelligent analytics, powered by technologies like deep learning and generative AI, are making this possible. Real-time training allows AI to evolve continuously instead of waiting for quarterly refreshes. In addition, the data that newer predictive engines rely upon has expanded to encompass not just neat, numerical records but also messy, unstructured sources of insight-rich interactions. As a result, AI-powered analytics are moving enterprises from passive hindsight to pragmatic foresight. AI takes predictive analytics—a broad discipline that includes predictive modeling, data prep, analysis workflows, interpretation of results, and decision-making applications—to new heights. “In many ways I think the word ‘analytics’ is giving way to AI,” says Gupta. “Everything is becoming AI.” Download the report This content was produced by Insights, MIT Technology Review’s custom content arm, not its editorial staff. It was researched and written by humans, with any AI tools that may have been used limited to production processes under human oversight.

Bringing predictive analytics to the agentic AI era  Read Post »

AI, Committee, 新闻, Uncategorized

Connecting AI agents to enterprise knowledge

For all the data that AI systems continually amass and analyze, enterprise AI agents often suffer from a curious shortcoming: a lack of knowledge. More than data, knowledge is the understanding of what the data means in the context of individual organizations. AI agents need this understanding to reason about situations, make decisions, and ultimately take actions. Without sufficient knowledge, agents are prone to making flawed and unreliable decisions. A lack of knowledge, our research finds, is a major reason agentic AI use cases never make it to production. Competitive pressure is making it urgent to address this. Organizations need to deploy and scale more of their agentic projects to capture the efficiency gains AI promises. Falling short risks wasting the investment already sunk into these projects, and it cedes ground to rivals already putting their agents to work more effectively. DOWNLOAD THE REPORT The purpose of this report, which is based on a survey of 300 data, AI, and other technology executives, is threefold. First, it seeks to gauge organizations’ agentic knowledge capabilities (i.e., their ability to give AI agents a full contextual understanding of the data they ingest) across semantic knowledge, episodic memory, and procedural knowledge. Second, the report probes the challenges organizations face in improving access to knowledge and ultimately to getting more agent use cases into production. Third, it explores the measures organizations are taking to overcome these challenges. The key findings include the following: Data and knowledge weaknesses consistently stall AI agent progress. On average, only around a third (34%) of organizations’ agentic AI projects make it into production. Even high-tech firms struggle with this. Legacy data systems, security and privacy concerns, and a lack of knowledge and context are the key points of failure. Strong knowledge capabilities correlate with agent success. A small group of production leaders (organizations where on average 61% of agentic projects advance beyond pilot) have stronger knowledge capabilities than the rest, especially when it comes to semantics. This advantage tracks closely with their higher production rate. Fragmented data hugely complicates knowledge access. Data fragmentation (the inadequate sharing of data across systems) was most commonly cited as a top challenge to expanding agents’ access to knowledge (cited by 55%). Production leaders, by contrast, are more likely to see security and privacy concerns as a major concern (cited by 72% of this group). Most firms aim to strengthen the link between data and agents. Among steps that can yield higher quality agent decisions, executives expect the biggest impact to come from strengthening the structural foundation between the organization’s data and its AI agents. The experts we interviewed see a knowledge layer as a prime way to achieve this. Investment priorities to boost knowledge range from pipelines to knowledge graphs. To expand agent access to knowledge, organizations will prioritize investments in retrieval technologies, like ingestion pipelines, AI-ready APIs, and retrieval-augmented generation (RAG); in AI evaluation agents; and in knowledge graphs. Download the report This content was produced by Insights, MIT Technology Review’s custom content arm, not its editorial staff. It was researched and written by humans, with any AI tools that may have been used limited to production processes under human oversight.

Connecting AI agents to enterprise knowledge Read Post »

AI, Committee, 新闻, Uncategorized

Don’t be fooled—LLMs don’t reason

On an afternoon in Seoul in March 2016, I watched a program I helped build put a stone on the fifth line of a Go board in what looked like a gift to its human opponent. Move 37 in game two of the five-game match looked so absurd that some commentators thought it was a programming glitch. It wasn’t. AlphaGo won the game, ultimately triumphing 4-1 over Lee Sedol, one of the greatest professional Go players of all time. “I thought AlphaGo was based on probability calculation and that it was merely a machine,” Lee said afterwards. “But when I saw this move, I changed my mind. Surely, AlphaGo is creative.”  When Deep Blue defeated then reigning world chess champion Garry Kasparov in 1997, it did so by looking six to eight moves ahead per player and evaluating 200 million chess positions per second, using rules hard-coded by humans. Go is a vastly more complex game. A stone’s worth depends on how distant groups and territory unfold over dozens of moves. Computing even a fraction of the possible outcomes would take a supercomputer billions of years. To win, AlphaGo had to sense who was ahead at a glance and even invent moves no human had thought to play. That is why many accounts of AlphaGo’s match against Lee portray move 37 as a flash of pure machine intuition. But that is a misunderstanding. It was actually AlphaGo’s powers of reasoning that made this creative choice—and these are powers that today’s AI lacks. If we want future AI systems to produce trustworthy results and really novel insights in fields like science and medicine, we need to equip them with genuine reasoning capabilities of this kind. AlphaGo is made up of two systems. The first, its policy network, was trained to guess what move a strong human would play. This “intuitive” part regarded move 37 as nothing special—a play that had a roughly one in 10,000 chance of being made by an expert human player. What made AlphaGo choose it was the program’s search machinery, which looked beyond immediate plausibility and weighed the future consequences of proposed moves. It explicitly constructed and searched a game tree with thousands of branches, each representing a different possible future.  A well-known theory in the behavioral sciences, popularized by Daniel Kahneman, distinguishes between two modes of human thought: System 1 is fast, gut-level, effortless; system 2, slow, step-by-step, and deliberative. AlphaGo offered a striking machine analogue of that split. Its networks supplied the hunches—this move looks promising, this position looks won—and its search supplied the deliberation, testing those hunches against the moves and countermoves that would follow. As in human cognition, neither half works alone. Intuition alone would never have opted for move 37, and brute-force search would have struggled to sieve through all the many possible moves. This is strikingly different from the way today’s AI models work. A large language model picks the next token, over and over. That amounts to system 1 in action—fast, associative, and surprisingly good pattern completion across almost every subject people write about. Not long after ChatGPT debuted, the field realized that language fluency alone falls short of true usefulness. The apparent solution was to make models that deliberate: Instead of answering immediately, they can now generate intermediate steps that decompose a problem, carry forward partial results, and influence subsequent reasoning—a process known as chain of thought. The gains have proved real, above all in mathematics and coding. But unlike AlphaGo’s search, this does not introduce a genuinely separate reasoning mechanism: The intermediate reasoning is still produced by the same next-token prediction process, iterated for longer before the model commits to an answer. Three shortcomings prevent what chatbots do from qualifying as reasoning (in a way that a scientist might recognize). First, these models typically maintain no explicit, persistent, and inspectable epistemic state. There is no open ledger that lays out the hypotheses a model is considering, the confidence it has in various explanations, the evidence it’s weighing, and the unresolved questions it’s holding onto—all things that should be systematically revised as new information arrives. Second, they lack a clean separation between what the system knows and how it manipulates that knowledge. Knowledge and reasoning are inextricably interwoven in the weights of the neural network—there is no independent, explicitly represented set of beliefs. Third, while the chains of thought chatbots produce look like deliberation, research has demonstrated that the bots often concoct them after the fact, reaching an answer by one route but reporting another. This is a problem because in the high-stakes applications we all care about, such as medicine, engineering, and scientific research, it matters not only what a system concludes but also how it arrives at its conclusion. When mistakes happen—for example, in medical diagnosis and treatment—we need to be able to pinpoint what went wrong: Was the system’s reasoning at fault, did it draw on invalid evidence, or did it make incorrect assumptions?  This is why I recently left my position at Google DeepMind. I believe we need a fresh approach to machine reasoning—one that draws on AlphaGo’s architecture. AlphaGo maintains a record of what it knows about a given position: the game tree. This data structure contains all the variations, the possible futures, that AlphaGo has considered, each move and position being annotated with judgments made by its neural networks. As its reasoning progresses, AlphaGo updates the game tree and eventually synthesizes the information in it to decide which move to make.  Similarly, for general reasoning a system should maintain an epistemic state that represents what the system holds as settled, what it doubts, what it has ruled out, which questions stay open. Reasoning can then be understood as a sequence of moves that change the epistemic state to advance knowledge and reduce uncertainty: deducing consequences, breaking problems into parts, and—crucially—deciding what question to ask, calculation to perform, or experiment to run next. Of course, open-world reasoning is harder than playing a board

Don’t be fooled—LLMs don’t reason Read Post »

AI, Committee, 新闻, Uncategorized

A new contest pits competitors against each other in a race to biological youth

This week, I officially signed up for an unusual competition. One that rewards competitors for getting younger. I recently turned 40, and I don’t need reminding that both time and my chronological age only tick forward. But this game is focused on competitors’ biological ages—figures that are meant to provide a better way to measure the age-related health of our organs and bodies. Over a six-month period, around 500 of us will try to reverse our biological age as measured in a bunch of different ways. There’s even a leaderboard! The winners will include the person who shows the greatest difference between their chronological and biological age, as well as the person who manages to reverse their biological age the most. The competition is the brainchild of the neuroscientist and physician Christin Glorioso, who is also founder and CEO of NeuroAge Therapeutics. The company offers tools to track brain health and aging and is running a trial to find out if biological brain age can predict the onset of Alzheimer’s disease. Glorioso says she has several goals for the Younger contest. The first, she tells me, is to “explain to the world what aging clocks are.” Regular Checkup readers will be familiar with these tools, but for the uninitiated, they are basically designed to measure biological age. Many measure chemical signatures that form a layer on top of our DNA and seem to change with age. But others might involve looking at proteins or lipids in blood. Some are designed to measure functional health, while others predict when a person will die. There are more than a hundred clocks out there, and they probably each capture a specific aspect of the biological process of aging. These clocks are proving very useful for scientists, who use them to study aging and development in humans and many other species. But using them to estimate the biological age of an individual person is more controversial. They’re just not good enough for that yet. Part of the problem is that we don’t really understand what each clock is capturing. Glorioso hopes that data collected through the Younger contest might help answer that question. She’s hoping to generate “the world’s most comprehensive clock dataset.” Some longevity clinics try to get around the limits of biological age testing by using multiple clocks. That’s this competition’s approach too. As a standard competitor, I’ll be sending a blood spot sample to TruDiagnostic, a company that measures epigenetic chemical groups on DNA and offers to reveal an overall biological age as well as a person’s pace of aging and the biological ages of each of 11 organ systems, including the heart and brain. I’ll get a brain age score from NeuroAge once I complete the cognitive tasks on offer. I’ll also submit some physical measures like grip strength. And I’ll upload a series of selfies to an app developed by a team at Harvard that promises to tell me my face age. That’s exactly what it sounds like—an estimate of how old my face looks. I’m intrigued to see my scores, even though I know I shouldn’t put too much stock in them. The first time I took a test, four years ago, the company I used gave me a biological age that matched my chronological age, which was a little disappointing and, if I’m honest, a bit underwhelming. A year later, the same company told me I had a young heart but a relatively old brain, liver, and hormonal system. My lifestyle hasn’t changed much since then. Will the years have made much difference? (Ultra competitors—who pay $4,499 rather than the $999 cost of regular entry—are also offered a range of other blood tests and clocks, as well as MRI and DEXA scans. I’ve got complimentary press access to the standard package.) Glorioso is also hoping to gather information about the effects of some purported longevity approaches. During the competition, some participants will be offered red-light masks, access to a sauna, or other low-risk offerings that partner companies who are sponsoring the event to varying degrees might want to collect data on. “A lot of these companies just can’t afford to run [clinical] trials,” says Glorioso. She also sees the event as a public health initiative. A couple of years ago, David Sinclair, who studies aging at Harvard Medical School, and his colleagues estimated that if we could slow down aging in the general population and increase life expectancy by one year, it would save the US economy $38 trillion. The event officially kicks off in January, but around 120 people have already signed up, says Glorioso. Ultimately, she expects 500 participants. Each person’s six-month run starts as soon as they take their baseline measurements, whenever that may be. A handful of people have already started. “I think the majority of people are going to want to sign up after the holidays,” says Glorioso. “They’re not going to want to be trying to win an aging contest over Christmas and Hanukkah.” Glorioso took her own baseline measurements back in August. Those initial tests suggested that her biological age was around 10 years below her chronological age. That sounded pretty impressive to me until I looked at the leaderboard and saw that competitor @Fred had a biological age 28.8 years below his chronological age. The leaderboard is pretty sparse at the moment, as only seven people have logged their baseline measurements so far. Six of them have biological ages tracking low, but one 47-year-old has been given a biological age of 68.1. She’s competing publicly, so I can see the breakdown of her scores. The worst is for the speed at which she can stand from sitting in a chair—by that measure, she’s been given a biological age of 100. Hillary Lin, a longevity-focused physician in New York, has just started logging her baseline measurements for the competition. She tells me she’s taken biological age tests in the past and that they’ve tended to give scores below her chronological

A new contest pits competitors against each other in a race to biological youth Read Post »

AI, Committee, 新闻, Uncategorized

The Download: a biological de-aging contest and why LLMs don’t reason

This is today’s edition of The Download, our weekday newsletter that provides a daily dose of what’s going on in the world of technology. A new contest pits competitors against each other in a race to biological youth —Jessica Hamzelou This week, I officially signed up for an unusual competition. One that rewards competitors for getting younger. I recently turned 40, and I don’t need reminding that both time and my chronological age only tick forward. But this game is focused on competitors’ biological ages, figures that are meant to provide a better way to measure the age-related health of our organs and bodies. Over six months, around 500 of us will try to reverse our biological age using a bunch of different measures. There’s even a leaderboard! But is it even possible to measure whether someone is getting younger?  Read the full story on the controversy around biological age measurements and how I’ll test them myself. This story is from The Checkup, our weekly biotech newsletter. Sign up to receive it in your inbox every Thursday. Opinion: Don’t be fooled—LLMs don’t reason —Thore Graepel Ten years ago, I watched a program I helped build stun the world by beating Go champion Lee Sedol. AlphaGo won after making a move so strange that some commentators thought it was a programming glitch. It was AlphaGo’s powers of reasoning that made this creative choice—and these are powers that today’s AI lacks.  This is why I recently left my position at Google DeepMind. I believe we need a fresh approach to machine reasoning, one that draws on AlphaGo’s architecture. Here’s why today’s AI doesn’t really reason—and what it would take to change that. Thore Graepel is chair of machine learning at University College London. He was a core member of the AlphaGo team at DeepMind. The must-reads I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology. 1 OpenAI says rogue agents may have affected more than 100 organizationsThe company is searching 50 petabytes of data for incidents. (Reuters $)+ It says none of the incidents matched the Hugging Face attack. (Gizmodo)+ OpenAI has fired three workers for allegedly mishandling information. (BBC)+ California has subpoenaed OpenAI over its rogue AI agents. (Guardian)+ Who’s liable when AI agents go rogue? (MIT Technology Review) 2 A US man allegedly smuggled $300 million of Nvidia chips to ChinaHe’s been arrested in California on federal charges. (Reuters $)+ The chip smuggling cases expose Nvidia’s blind spots. (Bloomberg $)+ China plans to teach AI in every school by 2030. (WP $)+ But it already has an overuse problem. (NYT $)  3 Florida officials have found 11 Flock cameras with unknown ownersThey don’t know who installed them or who has their data. (WP $)+ Lawmakers are considering new regulations on Flock cameras. (Axios)+ Here’s what Flock’s defenders are missing. (MIT Technology Review) 4 Ukraine has developed an acoustic fence that can cut drone cablesAcoustic sensors detect drones before hooks trap their cables. (New Scientist $)+ Drone data from Ukraine is fueling a wild market. (MIT Technology Review) 5 A new AI “speech clock” can assess how fast you’re ageingIt uses hundreds of vocal features to estimate biological age. (Nature)+ Aging clocks aim to predict how long you’ll live. (MIT Technology Review) 6 “Underwater umbrellas” could help corals survive hotter oceansThe shades protected corals during intense heat stress. (Gizmodo) 7 Apple’s upcoming smart home camera reportedly won’t record videoIt will instead only give users text event descriptions. (Verge) 8 Retired humanoid robots are being trained to jump into molten steelA Terminator-style death protects IP. (IE) 9 A man faces years in prison after AI slop caused a crocodile panicOfficials spent days searching for his AI-generated crocodile. (Futurism) 10 Finally, a laser mosquito killer is entering the marketChinese startup Photon Matrix Lab plans to start shipments this month. (SCMP) Quote of the day “Those agents are doing exactly what they’ve been asked to do. They were supposed to be in sandboxes, but the sandboxes were leaky and horribly designed.” —Yann LeCun, a Turing Award winner and former Meta chief AI scientist, tells Fortune that human error can be the real culprit behind the recent wave of AI agents going rogue. One more thing NASA is building the first nuclear reactor-powered interplanetary spacecraft. How will it work? Just before Artemis II began its historic slingshot around the moon, NASA revealed an even grander space travel plan. By the end of 2028, the agency aims to fly a nuclear reactor-powered interplanetary spacecraft to Mars. A successful mission would herald a new era in spaceflight—and might just give the US the edge in the race against China. But the project remains shrouded in mystery. MIT Technology Review picked the brains of nuclear power and propulsion experts to find out how the nuclear-powered spacecraft might work. Here’s what we discovered. —Robin George Andrews We can still have nice things A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.) + Atlas Obscura has mapped out the oldest living things on Earth.+ Brain scans show that dogs understand our emotions better than we thought.+ Step into Springfield in miniature with this astonishing model featuring 76 locations from The Simpsons.+ Minnesota’s State Fair has unleashed a crop of gloriously weird new foods, from Pickle pie to mustache pretzels.

The Download: a biological de-aging contest and why LLMs don’t reason Read Post »

AI, Committee, 新闻, Uncategorized

Datalab Introduces OmniExtractBench to Fix Bias and Opacity in Extraction Benchmarks

Datalab has released OmniExtractBench, an open benchmark for structured document extraction. It tests how accurately a system fills a JSON schema from a PDF. The benchmark pools 620 documents from 4 existing benchmarks. One deterministic scorer grades all of them and explains each decision. The release lands while extraction vendors publish their own leaderboards. Datalab argues those leaderboards are hard to compare or audit. OmniExtractBench is its attempt at a shared yardstick. Is it deployable? Yes, the scorer installs from PyPI as omni-extract-bench (v0.1.7, Python 3.11+, SciPy only) under Apache 2.0. Rerunning vendors requires your own API keys and paid credits. What is OmniExtractBench? OmniExtractBench is a structured extraction benchmark built by Datalab. Each task gives a system a PDF and a JSON schema. The system returns JSON, which is scored value by value against a gold file. The code is on GitHub, and the data is on Hugging Face under CC BY 4.0. The 4 flaws it targets Datalab’s launch post names 4 recurring problems with existing extraction benchmarks: Bias: documents and scoring can favor the vendor that built the benchmark. Opaque harnesses: a low score may reflect a broken harness, not a weak model. Unclear scoring: readers cannot tell why a given document scored low. Narrow document variety: some suites hold only dense tables, others only clean, unscanned files. Where the 620 documents come from Suite Documents Upstream publisher Content ExtractBench 329 LlamaIndex Forms, filings, decks Internal 202 Datalab (synthetic) Dense scalar schemas, small documents LongExtractBench 47 micro1 (commissioned by Reducto) Very large tables LongArray-Extract 42 Extend Large tables with repeated scalars Regulatory filing forms are the largest category, at 88 documents. 128 documents are a single page. At the other end, 33 documents over 100 pages hold 40% of all pages. Datalab’s own synthetic suite is the second largest share. How the scorer works The scorer flattens prediction and gold JSON into addresses, which are paths to single values. It normalizes each value first, so “03/31/2024” matches “2024-03-31”. Tables are the hard part. Compared by position, one missed row shifts every row after it. We reran the scorer on a 100-row table missing its first row. Positional comparison scored 0%, while OmniExtractBench scored 99%. The fix is content-based pairing with the Hungarian algorithm. ExtractBench and LongArray-Extract already align rows this way. OmniExtractBench adds a verdict layer on top. 6 verdicts per value matched: paired, and the values agree. misread: paired, but the values differ. unfound: gold has a value, the prediction does not. fabricated: the schema allows it, gold is silent, the prediction fills it. invented_item: part of a predicted row that pairs with nothing. invented_field: an address the schema never declared. Accuracy is matched values over all verdicts. Precision divides matched values by predicted values. Recall divides them by gold values. The full rules are in the metric spec. The null rule Empty strings, None and whitespace count as omissions, so those addresses are dropped. Strings like “NA” or “-” remain real answers. This blocks a quiet exploit: padding a schema with empty optional fields to earn free matches. In our test, padded null fields added 0 verdicts. How it compares with other extraction benchmarks Benchmark Publisher Documents Row alignment Per-value explanation Scorer license Data license OmniExtractBench Datalab 620, from 4 sources Hungarian, by content Yes, 6 verdict types Apache 2.0 CC BY 4.0 ExtractBench LlamaIndex 370 Hungarian Per-field diffs, HTML report Apache 2.0 Apache 2.0 LongArray-Extract Extend 45, synthetic Hungarian Per-document score Not stated CC BY 4.0 LongExtractBench micro1 225, of which 50 public By row key Not stated MIT CC BY 4.0, labels only Sources linked on each benchmark name. Checked September 27, 2026. Who misses fields and who invents values Datalab scored 10 system configurations on the full corpus. Its accurate mode led at 93.85 accuracy. Datalab balanced (93.48) and Reducto deep_extract v2 (93.47) are effectively tied. Precision and recall then show how each system fails. Balanced: Datalab (both modes) and Reducto keep precision and recall within 0.6 points. Leans to misses: GPT 5.6-sol posts 95.11 precision but 84.99 recall. It loses 11.88% to unfound values. Gemini and Claude show the same pattern, less sharply. Leans to invented values: LlamaExtract has 93.13 recall but 86.57 precision, losing 9.03% to fabricated values. Extend loses 4.01% to invented items. Low on both: Mistral OCR 4.1 and Azure Content Understanding trail on both metrics, with recall lower still. How each system falls short of 100%, by verdict type. Source: Datalab. Run it yourself Copy CodeCopiedUse a different Browser uv pip install omni-extract-bench oeb score –pred pred.json –gt gold.json –schema schema.json –verdicts Install the [benchmark] extra and run oeb benchmark to rerun vendors. Runs are resumable, and each provider needs its own credentials. Datalab also suggests testing its playground on your own documents. Key Takeaways OmniExtractBench pools 620 documents from LlamaIndex, micro1, Extend and Datalab suites. A deterministic scorer gives every value 1 of 6 auditable verdicts. Content-based row pairing stops one missed row from zeroing a table. Dropping null addresses stops schema padding from inflating scores. Datalab accurate leads at 93.85; Datalab balanced and Reducto tie near 93.5. FAQ What does OmniExtractBench measure? It measures how accurately a system extracts values from a PDF into a JSON schema, scored per value. Is OmniExtractBench open source? Yes. The scorer is Apache 2.0 on GitHub and PyPI. The dataset is CC BY 4.0 on Hugging Face. Who built OmniExtractBench? Datalab built it. Datalab also maintains the open-source Marker and Surya document tools. Thanks to the Datalab team for the resources behind this article. Datalab supported and sponsored this content. The post Datalab Introduces OmniExtractBench to Fix Bias and Opacity in Extraction Benchmarks appeared first on MarkTechPost.

Datalab Introduces OmniExtractBench to Fix Bias and Opacity in Extraction Benchmarks Read Post »

AI, Committee, 新闻, Uncategorized

Redefining enterprise intelligence with autonomous AI

Enterprise AI is no longer a future ambition. It is in full operational flight. Model capabilities are advancing faster than most organizations can absorb, while the cost of performance continues to fall. Globally, AI investment is set to reach $2.5 trillion in 2026, up 44% from the previous year. For many enterprises, this investment has produced fragmentation. Intelligence can accumulate in silos so that sales agents are unaware of open support tickets, for instance, or marketing systems are personalizing content without visibility into what finance already knows about a customer. Each function may perform well in isolation, but the enterprise as a whole learns little and has less information to act upon. DOWNLOAD THE REPORT The shift from AI as a tool to AI as an operating model—what we call the “agentic shift” in this report—demands something more fundamental than better models or faster infrastructure. It requires connecting people, processes, and data in real time, along with the governance and control to act on that intelligence reliably. This means rethinking both architecture and operating models simultaneously. First, rebuilding data infrastructure for accessibility rather than volume. Second, replacing fixed tech stacks with composable architectures that can evolve as models and tools change. And, lastly, resolving questions of AI sovereignty, including where intelligence runs, who controls it, and how it operates across organizational and jurisdictional boundaries. Key findings include the following: Enterprise AI’s scaling problem is structural. Process-first companies are pulling ahead. Global AI spending is rising sharply and model capabilities are advancing faster than most organizations can integrate them. Yet the majority of enterprises are still not growing revenue through AI or fundamentally rethinking how they operate. The companies generating sustained returns share a common discipline. They treat process redesign as the work that precedes model selection, building for how the technology will evolve rather than retrofitting roles and workflows after deployment. For them, the agentic shift begins with the operating model. Data readiness, not data abundance, is what makes AI compoundable. Most enterprises discover too late that having data and having AI-ready data are very different things. A sovereign, composable foundation—one that queries and prepares data where it resides, without migration or centralization—can convert raw data estates into intelligence that AI agents can act upon. As data residency laws, multicloud environments, and structural complexity make centralization increasingly impractical, sovereign control over where models run and data lives is what keeps that adaptability intact. Download the report. This content was produced by Insights, MIT Technology Review’s custom content arm, not its editorial staff. It was researched and written by humans, with any AI tools that may have been used limited to production processes under human oversight.

Redefining enterprise intelligence with autonomous AI Read Post »

AI, Committee, 新闻, Uncategorized

NVIDIA Announces DGX Spark 64GB: A 1-PetaFLOP Grace Blackwell Desktop for Local AI Agents, Fine-Tuning, and Inference

NVIDIA announced a new 64GB configuration of DGX Spark — from Acer, ASUS, Dell, Gigabyte, HP and MSI — its GB10-powered desktop AI system. It gives developers a way to start with one system for local models and agents, then cluster two 64GB units for 128GB of memory across the cluster and more compute when workloads grow. The direct message is: Run open models and always-on agents on your own desk, then cluster DGX Spark system as the work grows – instead of on a metered API. The timing is not accidental. Agents burn tokens continuously through tool calls, retries, long context, and multi-step plans. Token consumption has grown 14x since early 2026. On a cloud API, every one of those tokens is billed. On owned hardware, there is no per-token fee. The 64GB model keeps the same GB10 Grace Blackwell superchip, NVIDIA CUDA accelerated AI software stack, and ConnectX-7 networking as the original — updated with 64GB of unified LPDDR5x instead of 128GB. NVIDIA positions that as enough for today’s most capable 30–35B class open models. NVIDIA continues to offer the 128GB DGX Spark for larger single-box workloads, and clustering 64GB units adds memory and compute together. What is Inside the Box GB10 pairs a Blackwell GPU with 5th-generation Tensor Cores and a 20-core Grace Arm CPU. The GPU delivers up to 1 petaFLOP of FP4 AI compute, with sparsity. Spec DGX Spark 64GB Superchip NVIDIA GB10 Grace Blackwell CPU 20-core Arm (10× Cortex-X925 + 10× Cortex-A725) AI compute Up to 1 petaFLOP FP4 (with sparsity) Memory 64GB LPDDR5x, coherent unified Memory bandwidth 273 GB/s Storage 1, 2, or 4TB NVMe M.2, self-encrypting Networking ConnectX-7 NIC, 200GbE; Wi-Fi 7, BT 5.3 Display 1× HDMI 2.1a OS NVIDIA DGX OS (Ubuntu-based) Size / weight 150 × 150 × 50.5 mm / 1.2 kg Max local model size Up to 100B parameters Availability Oct 23, 2026 — NVIDIA Marketplace, OEM partners, retail Source: NVIDIA specifications. Unified memory is the key design choice: The CPU and GPU share one pool over NVLink-C2C, at 5x the bandwidth of PCIe Gen 5. There is no copying weights between system RAM and VRAM. For agents, that means several models, their KV caches, and tool processes live in one address space. The software is ready on first boot: DGX OS ships with the NVIDIA AI stack, including PyTorch, Jupyter, and Ollama. NVIDIA NemoClaw installs with a single command. It adds privacy and security controls to OpenClaw agents. NVIDIA OpenShellTM, part of the NVIDIA Agent ToolkitTM, adds policy-based guardrails on top. NVIDIA NemotronTM models are optimized for the box. It runs on a standard wall outlet: No server room, no special cooling. That is important for an agent meant to run around the clock. Built-in networking for clustering: ConnectX-7 lets two DGX Spark 64GB systems cluster for 128GB of memory and more compute. NVIDIA Sync Cluster Assistant simplifies setup. Which Open Models Fit in 64GB Hardware is half the story. The other half is that 30B-class open models got good enough for agent work. Model Developer Type Footprint Role on a Spark Muse Glimmer Meta 29.6B dense, text + image, Apache 2.0 ~17GB (quantized) Main agent model Nemotron 3.5 Lightning NVIDIA 30B MoE (30B-A3B) NVFP4 checkpoint Fast executor for long-running agents Qwen3.8-27B Alibaba Qwen 27B dense ~13.5GB weights (4-bit) General agent and coding Footprints are weight-only estimates; KV cache and runtime overhead come on top. Muse Glimmer is the main model. Meta distilled it from Muse Spark, the model family behind the Meta AI assistant. It targets local agents: reliable tool calls, long multi-step tasks, and recovery from failures. Meta reports 51.2 on SWE-Bench Pro and 75.5 on MCP Atlas. Context runs to 131K tokens. It is also available as an NVIDIA NIM. Full BF16 Glimmer needs 55GB+, which leaves almost nothing for context. The ~17GB quantized build is the practical choice on 64GB. Larger models like DeepSeek V4 Flash need more than one box. NVIDIA’s own benchmarks run it on 4 64 GB clustered Sparks. 5 Things You Can Build on One Box 1. An always-on personal agent Install Hermes and point it at Muse Glimmer or Nemotron 3.5 Lightning. Give it tools: your GitHub repos, a test runner, an RSS feed of arXiv categories. Let it run overnight. By morning it has triaged new issues, reproduced a failing test, and drafted a pull request for review. It has also summarized the 30 papers you would never have opened. Your private notes, code, and email never leave the machine. 2. Fine-tune a coding model on your own repo QLoRA on a 70B model fits in 64GB. Train it on your codebase, internal docs, and past PR reviews. Then serve it locally as a coding assistant that knows your conventions. NVIDIA measured ~18,400 tokens/s on a single node for nanochat distributed fine-tuning.  3. A day-1 model evaluation bench A new open-weight model drops on Hugging Face. Pull it through Ollama or vLLM the same day. Run your own question set against it. Score accuracy, then measure time to first token (TTFT) and tokens per second. Compare it against your current model. There is no API bill for re-running the eval 50 times. 4. A multi-model agent team Unified memory lets several models share one pool. Run Bonsai 2 as a router, and Glimmer as the main reasoning agent. That is roughly 23GB of weights. The rest covers KV cache, the OS, and tool processes. When a problem exceeds local capacity, the agent can send a sanitized question to a larger cloud model. 5. Edge and robotics prototyping Fine-tune a vision transformer for a specific task, like spotting anomalies on a factory floor camera. Validate it locally with the same CUDA stack. Then deploy it to an NVIDIA Jetson device at the edge. When One Box is Not Enough: Clustering with NVIDIA Sync Every DGX Spark ships with ConnectX-7 at 200GbE. Clustering is a native feature, not an add-on. Setup Pooled memory AI compute (FP4) Connection 1

NVIDIA Announces DGX Spark 64GB: A 1-PetaFLOP Grace Blackwell Desktop for Local AI Agents, Fine-Tuning, and Inference Read Post »

We use cookies to improve your experience and performance on our website. You can learn more at 隱私權政策 and manage your privacy settings by clicking Settings.

Privacy Preferences

You can choose your cookie settings by turning on/off each type of cookie as you wish, except for essential cookies.

Allow All
Manage Consent Preferences
  • Always Active

Save
zh_CN