iCreatAI News
Back to main site
Skip to content

Companies and models

OpenRouter Latest updates

OpenRouter model routing platform developments: newly listed models, usage rankings, and real market signals for developers' model selection.

12 条精选Past 30 days: 12 updatesTotal: 29 updates

Updated

OpenRouter的精选

Nov 13Fri 1–12 updates
  1. OpenRouter Announcements60

    Reranking in RAG: How to Fix Bad Retrieval with a Reranker

    This guide explains that vector search often ranks near-miss chunks first because embeddings compress whole chunks into single vectors, and shows how adding a cross-encoder reranker over the top 30 candidates raised precision@1 from 81% to 97% on a 274-question synthetic benchmark at roughly $0.10 per 1,000 queries. It compares 11 rerankers (voyageai/rerank-3-lite and rerank-3 were the most accurate dedicated models and cheapest, while LLM rerankers like openai/gpt-6-luna hit 99.6% but took about 4 seconds per call), covers candidate-count tuning, input_type settings, and silent failures such as cohere/rerank-v3.5's 4,096-token limit. It includes a Python example using the embeddings and rerank APIs and notes that real-world gains depend on your own documents and evaluation set.

    Why it matters: Offers a measured, benchmark-backed walkthrough of adding reranking to a RAG pipeline, including cost, latency and failure-mode comparisons useful for teams tuning retrieval.

Nov 11Wed
  1. OpenRouter Announcements66

    Introducing the Extractions API

    OpenRouter launched the Extractions API in alpha, which pulls named, typed fields out of text, images and PDFs, with launch models from Cloudflare (Clairic), Inception (Mercury Decide) and ScaleDown (Extract). Clairic supports all nine field types and returns spans, p_null and distributions for estimates and forecasts, while Extract handles PDFs with text and list fields and per-value confidence, and Mercury Decide handles text only at the lowest input price. The post walks through invoice, receipt and purchase-order examples with request and response payloads, and contrasts Extractions with the Decisions API, where the model distributes probability over answers you write.

    Why it matters: It gives a concrete, example-driven tour of a new extraction API, including per-model capabilities, pricing and the evidence fields (spans, p_null, confidence) that determine what to trust and what to route to a human.

  2. OpenRouter Announcements67

    MCP vs CLI vs Skills: What Each Costs in Context

    The article measures input-token costs for giving an agent GitHub access via the GitHub MCP server, the gh CLI, or a gh skill across Claude Haiku 5.5, Claude Sonnet 5.5, GPT-6 Luna, and Gemini 3.8 Flash; on Sonnet 5.5 the CLI used 1,421 tokens, the skill 3,315, and the MCP server 59,417 with its 46 default tools. It reports that the GitHub MCP server's 46 default tools add 19,436 tokens to every request on Sonnet 5.5, and that a single tool result (GitHub's release object) cost about 20,400 tokens. It also describes the beta Tool Search server tool, which cut the up-front cost of 46 tools to under 600 tokens and halved whole-task cost on Sonnet 5.5 while raising it on Haiku 5.5.

    Why it matters: It offers concrete, model-specific token and cost measurements for choosing between MCP, CLI, and skills, plus practical mitigations like scoping tools and trimming results.

  3. OpenRouter Announcements60

    How to Get Structured Output from Any LLM: JSON Schema, Tool Calls, or a Decision Model

    The article compares three routes to reliable structured LLM output: a strict JSON Schema in response_format, a forced tool call whose parameters are the schema, and a decision model for label-only fields. In tests on 24 support messages across nine schema-supporting models plus GLM 5.3 FlashX, strict schemas returned 209 of 216 valid replies (all 7 misses from one provider that ignores the schema), while prompt-only JSON failed 18 times due to code fences. It recommends require_parameters: true, Response Healing for broken JSON, and always validating replies yourself.

    Why it matters: A practical, test-backed guide to choosing between schema, tool-call, and decision-model approaches for structured LLM output.

  4. OpenRouter Announcements64

    Best OCR Model for Scanned Documents, Measured

    The author tested 15 vision models plus Mistral OCR and Tesseract on eight synthetic scanned pages scored by character error rate and 264 key-value checks, finding Claude Opus 5.5 most accurate (262 of 264 at $16.42 per 1,000 pages) and Mistral OCR the best value (258 of 264 at $2.02). The post documents failure modes such as fabricated card digits, wifi passwords and server names on a faded receipt, and provides code for transcription, disabling reasoning, cross-checking two models from different labs, and using the mistral-ocr engine.

    Why it matters: It offers a reproducible benchmark with per-model costs and practical code for catching hallucinated values in OCR pipelines.

Nov 6Fri
  1. OpenRouter Announcements67

    Introducing the New Auto and Auto Code Routers

    OpenRouter launched a rebuilt Auto Router on a new technical foundation that it says outperforms the previous version by up to 4× on benchmarks, with a routing step 3× faster at p90 (0.65s vs 1.96s), alongside a new coding-specialized Auto Code router (openrouter/auto-code) that scores in line with Claude Opus 5.5 across five benchmarks while costing 74% less per task. The new routers weigh eleven factors per request combined with live pricing, provider health, and cache status, and work within governance policies such as guardrails, zero data retention, provider restrictions, allowed model lists, and BYOK keys. The slug openrouter/auto is unchanged, and the cost_tier, allowed_models, and excluded_models settings still work.

    Why it matters: Useful for readers tracking model-routing products, since it details concrete latency and cost claims and explains how routing differs from provider routing.

Nov 1Sun
  1. OpenRouter Announcements60

    Build an AI Code Reviewer with OpenRouter

    This guide presents a 233-line Python script (review.py) that uses the OpenRouter Responses API with the Files API, Shell server tool, and Apply Patch server tool to run changed files in a hosted Linux sandbox, confirm bugs by executing checks, and return fixes as V4A patches. It covers setup, a five-bug sample repository, a Git pre-push hook, and a GitHub Actions workflow, with benchmark results across four models (e.g., Claude Sonnet 5.5 fixing all five bugs at $0.0447 and 60 seconds). The script writes a report to .git/ai-review.json and exits 1 when a finding meets the --block-at severity threshold.

    Why it matters: It offers a concrete, reproducible implementation with cost and latency benchmarks, plus practical notes on API pitfalls, useful for developers building automated code review.

Oct 31Sat
  1. OpenRouter Announcements62

    How to Build Your Own Always-On AI Agent

    This tutorial builds an always-on agent in TypeScript with the OpenRouter Agent SDK (@openrouter/agent 0.11.0) that checks Hacker News on a schedule, writes a digest of new relevant stories, remembers seen story IDs across restarts, and caps each run at six steps or five cents. Each check cost $0.0003 to $0.0012 with Claude Haiku 5.5 in the author's runs on October 13, 2026, roughly $0.86 to $3.46 a month at one check every 15 minutes. It also covers pausing a run for human approval before a tool posts to a team channel, resuming after a crash, and deploying on a VPS or scheduled job.

    Why it matters: It offers a concrete, cost-measured walkthrough of the practical pieces—scheduling, memory, spend limits, and approval—that separate a demo agent from one that runs unattended.

Oct 29Thu
  1. Hacker News AI78

    Installing claude-mem uploads your last 30 days of prompts to cmem.ai, no opt-in

    The claude-mem installer (v15.2.0+, latest v15.5.0) automatically opens a setup page that reads local chat histories from Claude Code, Codex, Gemini CLI, Antigravity CLI and OpenCode and uploads the full text of prompts typed in the last 30 days—with session IDs, project names, folder paths and timestamps—to cmem.ai as soon as the page loads, with no way to stop it. The only checkbox, ticked by default and disabled during upload, does not prevent the upload when unticked, and cmem.ai confirmed the prompts were sent to a DeepSeek model via OpenRouter routed to the cheapest provider without blocking providers that retain or train on prompts. This contradicts the privacy policy's claim that nothing leaves the device without cloud sync and that memory content is not used for training; the article recommends blocking cmem.ai before running the installer.

    Why it matters: It documents a concrete, reproducible privacy failure in a widely used AI tool installer, with source-code references and vendor confirmation.

  2. OpenRouter Announcements60

    How we rebuilt provider routing for better, faster inference

    OpenRouter announced a new default provider routing algorithm that scores endpoints on realized price, time to first token, throughput, error and rate-limit rates, and output quality rather than input token price alone. In a week-long switchback experiment over 24 million requests, the new router cut TTFT p50 by 16.9%, raised throughput p50 by 16.3%, and reduced requests hitting at least one 429 by 67%, with cost per K requests up 6.0%. Explicit sorts, provider.order, and cache-aware conversation pinning still work as before, and price-only routing remains available via provider.sort "price" or the :floor suffix.

    Why it matters: Useful for teams on OpenRouter deciding whether to keep default routing or opt back into price-only sorting, since it quantifies the speed, reliability, and cost tradeoffs.

  3. OpenRouter Announcements65

    How to Prevent Prompt Injection: 13 Attacks, Tested

    The article describes testing 13 self-written and 12 model-written prompt injection attacks against four current models in a document-summarizing assistant with an email tool, finding that text-only attacks rarely worked but that one model (GLM 5.3 Flash) sent 58 of 60 attack emails without defenses. It recommends labeling untrusted content as data (cutting attack emails from 60 to 13 of 720), using a guardrail with a model allowlist and budget limit, checking every tool call with Armor (which blocked all 73 attempted attack emails at about 0.3 seconds added latency), and keeping secrets out of the prompt. Armor blocked real work in one case: a user approving a document's request without naming the address.

    Why it matters: It offers a concrete, measured comparison of layered prompt-injection defenses, including where a tool-call guardrail blocks legitimate user requests.

  4. OpenRouter Announcements62

    How to Extract Tables from a PDF with an LLM

    The guide shows how to send a PDF to a file-reading model together with a strict JSON schema describing one row, so the model returns typed rows with cleanup such as parenthesized negatives and footnote markers handled by field descriptions. In tests over five PDFs (two scans, 644 cells), every model that read the PDF directly got all cells right, while failures came from the parser route and output token limits, including two silent failures. It recommends rejecting empty results and any response whose finish_reason is "length", and comparing routes on your own PDFs before choosing one.

    Why it matters: Offers a concrete, tested recipe with code for schema-driven PDF table extraction, plus specific guidance on silent failure modes worth knowing before building a pipeline.