iCreatAI News
Back to main site
Skip to content
Only Papers#Google
  1. Artificial Analysis Articles60

    Multimodal Knowledge Agent (MKA) benchmark: testing knowledge work capabilities with complex visual files

    Artificial Analysis partnered with Google DeepMind to launch the Multimodal Knowledge Agent (MKA) benchmark, comprising 200 private real-world visual tasks across 10 industries in which agents work from dense visual files like architectural drawings, engineering schematics, and clinical scans to produce deliverables such as slide decks, spreadsheets, PDFs, Word documents, and marked-up images. Tasks are graded against expert rubrics averaging ~70 weighted criteria split into Regression and Climb checks, with the headline Climb WSR score, run in the open-source Stirrup agent harness with up to 250 turns and graded by GPT-6 Luna (medium) as an agentic judge. Claude Fable 5.2 (max) leads with 57% Climb WSR, followed by Gemini 4 Carbon (high) at 54% and Claude Opus 5.5 (max) at 53%, while Claude Fable 5.2 averages $31.97 per task versus $6.29 for Gemini 4 Carbon and $1.11 for GPT-6.1 Sol.

    Why it matters: The results offer a useful cost-performance and per-vertical breakdown for anyone choosing models for agentic knowledge work over complex visual files.

  1. Google DeepMind83

    Introducing AlphaProof Code: a breakthrough in verifying complex software at depth

    Google DeepMind researchers used AlphaProof Code, a multi-LLM agentic framework combining human expertise with AI agents, to formally verify key security properties of the actual code underlying the Signal protocol, generating over six million lines of Lean. The verification took four weeks, and when two previously fixed bugs were reintroduced into an isolated version of Signal's code, the system produced machine-checked proofs that the buggy versions were insecure. DeepMind is open-sourcing its formal verification artifacts.

    Why it matters: It reports a claimed first in formally verifying a widely deployed cryptographic protocol's implementation, with concrete details on method, timeline and bug-detection tests.

  1. Google Research71

    Detecting signs of hypertension using wearable sensors

    Google researchers describe AI-PPG-ACC-HTN, a multimodal AI system that uses smartwatch PPG and accelerometry data, without cuff calibration, to detect a persistent hypertensive state by aggregating 15-second waveform embeddings over multiple days alongside height. Validated against 24-hour ambulatory blood pressure monitoring in a 196-participant, five-site US study, it reached 65.8% sensitivity and 90.0% specificity for initial screening and 78.4% sensitivity, 90.9% specificity and 96.7% PPV for confirmatory testing among 48 participants with elevated office BP. The authors frame it as early feasibility research for passive opportunistic screening, not a replacement for clinical cuffs or a standalone diagnosis.

    Why it matters: It offers a concrete, clinically benchmarked example of cuffless hypertension screening and its limits, useful for readers tracking AI in consumer health devices.

  1. Hacker News AI80

    Open-weight AI models can exploit the patch gap

    Researchers found that GLM 5.3, a widely available open-weight model released by Z.ai in August, could autonomously build exploits against all six Firefox releases between September 17 and October 26 using only information available at each version's release, at a marginal cost of about $1,000 per version. Visiting the model-built webpage caused the browser to read a local file and send it to an attacker's server without further user interaction, and the attacks also relied on an unpublished vulnerability that Mozilla has since patched in Firefox 159.0 (released October 27, 2026). Similar attacks on Google Chrome did not succeed as of writing, and the authors expect the threat to worsen as open-weight cyber capabilities improve.

    Why it matters: Documents a concrete, low-cost autonomous exploit capability in a freely available model, with implications for release practices across open- and closed-source software.

  1. Artificial Analysis Articles60

    Announcing Artificial Analysis Intelligence Index v5

    Artificial Analysis released Intelligence Index v5, its biggest upgrade since v4, adding FrontierCode 2.0 and Terminal-Bench-Science and upgrading HLE-Diamond, AA-Omniscience v1.1 and CritPt v2, with 60% of the Index now based on private test sets or held-out answers. Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55), while the open weights gap widens from 3 points to 12. It also launched the Progress Index v1, which tracks model capability over time on one continuous scale.

    Why it matters: It details a major benchmark revision and new leaderboard results, useful for readers tracking how frontier and open-weight models are measured.

  1. Google Research65

    Empowering frontline maternal care with AI-assisted ultrasound

    Google researchers evaluated an AI model that estimates gestational age from standardized "blind sweep" ultrasounds performed by novice operators, reporting a mean absolute error of 4.18 days versus 4.48 days for expert sonographers across cohorts in Chicago and Nairobi. The model, minimally tuned on 120 Chicago participants and tested with no Nairobi data, achieved MAEs of 4.10 and 4.27 days respectively, as published in JAMA Network Open.

    Why it matters: It offers a concrete, peer-reviewed data point on whether AI-assisted ultrasound can generalize across hardware and clinical settings without expert sonographers.

  1. Google Research71

    Grounding AI agents in biological reality: Building blocks for autonomous wet labs

    Google researchers describe three projects aimed at connecting AI agents to real wet-lab experimentation: the VERID framework, a semantic digital twin of a lab workcell that tracks 3D state, runs fast virtual dry runs, blocks unsafe commands and logs synchronized video and actions; closed-loop aptamer design over three design-test cycles that raised on-target hit rates to 33.5% for myoglobin and 42.1% for α-thrombin; and agent-guided epitope excision for de novo binder design against FAP, which accelerated each folding cycle more than eightfold and, in a human–agent comparison at equal compute, nearly doubled the in-silico hit rate of a scientist working alone.

    Why it matters: It offers a concrete, example-rich account of how agents are being tied to physical lab hardware and closed experimental loops, including failure modes and safety safeguards.

  1. Google Research65

    Putting Earth AI to work: Geospatial agents for our planet's biggest challenges

    Google shares a technical report on its experimental Geospatial Reasoning agent, which connects Gemini to Earth AI foundation models and planet-scale data, and reports evaluations across four benchmarks, including two newly released ones (GeoKTools and GeoExpertQueries). The post describes early partner testing with organizations including WHO AFRO, People in Need, GiveDirectly, the Milken Institute and WPP, and announces expanded early access via Ask Google Earth and an experimental agent-to-agent API.

    Why it matters: It offers a concrete look at how a planning-based geospatial agent is evaluated and applied to real public health, disaster and infrastructure workflows.

  1. Google Research71

    Does better work always mean better workers?

    A three-month field experiment with 133 patent lawyers found that access to a Google Labs AI patent-writing assistant raised drafting scores by 0.34 SD at 10 days and 0.38 SD at 90 days, with gains concentrated in fewer poor scores rather than more excellent ones. On a later redlining task where AI was not allowed, the benefit appeared only for senior lawyers (0.45 SD), while juniors showed no discernible improvement and their scores bifurcated toward more very low and more good results. The authors argue that improving output and building durable professional judgment are different goals that may be in tension for junior professionals.

    Why it matters: Offers a rare blinded, months-long field test that separates AI-assisted output gains from unassisted skill development, with direct implications for how firms train junior professionals.

You have reached the end