iCreatAI News
Back to main site
Skip to content
Only Papers#Multimodal
  1. Artificial Analysis Articles60

    Multimodal Knowledge Agent (MKA) benchmark: testing knowledge work capabilities with complex visual files

    Artificial Analysis partnered with Google DeepMind to launch the Multimodal Knowledge Agent (MKA) benchmark, comprising 200 private real-world visual tasks across 10 industries in which agents work from dense visual files like architectural drawings, engineering schematics, and clinical scans to produce deliverables such as slide decks, spreadsheets, PDFs, Word documents, and marked-up images. Tasks are graded against expert rubrics averaging ~70 weighted criteria split into Regression and Climb checks, with the headline Climb WSR score, run in the open-source Stirrup agent harness with up to 250 turns and graded by GPT-6 Luna (medium) as an agentic judge. Claude Fable 5.2 (max) leads with 57% Climb WSR, followed by Gemini 4 Carbon (high) at 54% and Claude Opus 5.5 (max) at 53%, while Claude Fable 5.2 averages $31.97 per task versus $6.29 for Gemini 4 Carbon and $1.11 for GPT-6.1 Sol.

    Why it matters: The results offer a useful cost-performance and per-vertical breakdown for anyone choosing models for agentic knowledge work over complex visual files.

  1. Google Research71

    Detecting signs of hypertension using wearable sensors

    Google researchers describe AI-PPG-ACC-HTN, a multimodal AI system that uses smartwatch PPG and accelerometry data, without cuff calibration, to detect a persistent hypertensive state by aggregating 15-second waveform embeddings over multiple days alongside height. Validated against 24-hour ambulatory blood pressure monitoring in a 196-participant, five-site US study, it reached 65.8% sensitivity and 90.0% specificity for initial screening and 78.4% sensitivity, 90.9% specificity and 96.7% PPV for confirmatory testing among 48 participants with elevated office BP. The authors frame it as early feasibility research for passive opportunistic screening, not a replacement for clinical cuffs or a standalone diagnosis.

    Why it matters: It offers a concrete, clinically benchmarked example of cuffless hypertension screening and its limits, useful for readers tracking AI in consumer health devices.

  1. Google Research65

    Empowering frontline maternal care with AI-assisted ultrasound

    Google researchers evaluated an AI model that estimates gestational age from standardized "blind sweep" ultrasounds performed by novice operators, reporting a mean absolute error of 4.18 days versus 4.48 days for expert sonographers across cohorts in Chicago and Nairobi. The model, minimally tuned on 120 Chicago participants and tested with no Nairobi data, achieved MAEs of 4.10 and 4.27 days respectively, as published in JAMA Network Open.

    Why it matters: It offers a concrete, peer-reviewed data point on whether AI-assisted ultrasound can generalize across hardware and clinical settings without expert sonographers.

You have reached the end