{"id":261053,"date":"2026-04-11T18:19:29","date_gmt":"2026-04-12T01:19:29","guid":{"rendered":"https:\/\/messengerbot.app\/chatbot-arena-explained-how-llm-leaderboards-actually-rank-ai-models-in-2026\/"},"modified":"2026-04-13T13:17:56","modified_gmt":"2026-04-13T20:17:56","slug":"o-chatbot-arena-explicou-como-os-rankings-de-lideres-de-llm-realmente-classificam-modelos-de-ia-em-2026","status":"publish","type":"post","link":"https:\/\/messengerbot.app\/pt\/chatbot-arena-explained-how-llm-leaderboards-actually-rank-ai-models-in-2026\/","title":{"rendered":"Chatbot Arena Explicado: Como os Rankings de LLM Realmente Classificam Modelos de IA em 2026"},"content":{"rendered":"<input type=\"hidden\" value=\"\" data-essbisPostContainer=\"\" data-essbisPostUrl=\"https:\/\/messengerbot.app\/pt\/chatbot-arena-explained-how-llm-leaderboards-actually-rank-ai-models-in-2026\/\" data-essbisPostTitle=\"Chatbot Arena Explained: How LLM Leaderboards Actually Rank AI Models in 2026\" data-essbisHoverContainer=\"\"><p>If you work in AI long enough, you notice that almost every model launch eventually circles back to one screenshot: the Chatbot Arena leaderboard. OpenAI, Anthropic, Google, xAI, Meta, and a growing list of smaller labs all want a high placement there because it has become the public scorecard that technical buyers, developers, journalists, and power users actually look at when the marketing claims start piling up.<\/p>\n<p>If you still search for <strong>LMArena<\/strong> or <strong>lmarena<\/strong>, that is normal. The platform officially rebranded from LMArena to <strong>Arena<\/strong> on January 28, 2026, but the old names and the original <strong>Chatbot Arena<\/strong> label still dominate search behavior and industry shorthand. Arena says the platform now serves more than 5 million monthly users across 150 countries and processes about 60 million conversations a month, which helps explain why its rankings now carry more weight than a static PDF benchmark most people never open (<a href=\"https:\/\/arena.ai\/blog\/lmarena-is-now-arena\/\" target=\"_blank\" rel=\"noopener\">Arena rebrand note<\/a>; <a href=\"https:\/\/arena.ai\/about\" target=\"_blank\" rel=\"noopener\">About Arena<\/a>).<\/p>\n<p>As of April 11, 2026, the live Text Arena leaderboard shows <strong>5,781,909 votes across 339 models<\/strong>. That is not a lab-run demo set. That is a huge stream of real prompts, real side-by-side votes, and public rankings that change as models improve, regress, or simply get exposed to harder user behavior (<a href=\"https:\/\/arena.ai\/leaderboard\/text\" target=\"_blank\" rel=\"noopener\">Arena Text Leaderboard<\/a>).<\/p>\n<p>This guide is the part most benchmark coverage skips: <strong>how to read Chatbot Arena like an adult buyer instead of a fan account<\/strong>. I will break down the ranking method, what the Elo-style score really means, which models are currently on top, where the leaderboard is useful, and where it can quietly mislead you. If you want the broader software buying view after this, move next to our <a href=\"\/chatbot-comparison-2026-chatgpt-vs-claude-vs-gemini-vs-messenger-bot-vs-manychat\/\">complete chatbot platform comparison<\/a>.<\/p>\n<h2>What Chatbot Arena Is and Why It Became the Default LLM Benchmark in 2026<\/h2>\n<p>Chatbot Arena started as a research project created by UC Berkeley researchers and grew into a community-driven evaluation platform where people compare anonymous AI models side by side and vote for the better answer. That origin matters because Chatbot Arena is not just another vendor benchmark page with one company picking the test, picking the prompts, and grading its own homework. Arena&#8217;s own positioning is that it measures <em>real-world use<\/em>, not just lab performance, and that is exactly why the industry keeps returning to it (<a href=\"https:\/\/arena.ai\/about\" target=\"_blank\" rel=\"noopener\">About Arena<\/a>; <a href=\"https:\/\/arxiv.org\/abs\/2403.04132\" target=\"_blank\" rel=\"noopener\">Chatbot Arena paper<\/a>).<\/p>\n<p>In practice, and this is an inference from the public evidence rather than a formal claim by Arena, Chatbot Arena has become the <strong>default public LLM benchmark<\/strong> for three reasons. First, it is live. New prompts and votes arrive constantly instead of once per paper release. Second, it is comparative. Models do not get judged in isolation; they have to beat another model on the same prompt. Third, it is legible. A buyer can look at one public leaderboard and immediately see who is winning overall, who is winning in coding or vision, and how much confidence to place in the result.<\/p>\n<p>The platform also expanded far beyond plain chat. Arena now publishes separate or parallel leaderboards for text, code, vision, document handling, search, image generation, image editing, and video tasks. That broader scope is part of why the old name <strong>Chatbot Arena<\/strong> can be slightly misleading in 2026. It still matters for the keyword, but the platform has clearly evolved into a wider <strong>LLM leaderboard<\/strong> and multimodal evaluation system (<a href=\"https:\/\/arena.ai\/how-it-works\" target=\"_blank\" rel=\"noopener\">How Arena Works<\/a>).<\/p>\n<p>Another reason it became the default reference is credibility through scale. The original 2024 research paper described a platform with more than 240,000 votes at the time. By April 2026, the live text leaderboard alone shows nearly 5.8 million votes. That scale does not make the leaderboard perfect, but it does make it hard to dismiss as statistical trivia (<a href=\"https:\/\/arxiv.org\/abs\/2403.04132\" target=\"_blank\" rel=\"noopener\">Chatbot Arena paper<\/a>; <a href=\"https:\/\/arena.ai\/leaderboard\/text\" target=\"_blank\" rel=\"noopener\">Arena Text Leaderboard<\/a>).<\/p>\n<p>The useful mental model is simple: <strong>Chatbot Arena is closer to a rolling public election than a final exam<\/strong>. It tells you which models people prefer under live, messy, real prompts. That makes it incredibly valuable for product perception and real-world utility. It also means you should not treat it as the only truth.<\/p>\n<h2>How Chatbot Arena Actually Collects Its Rankings (Pairwise Blind Voting)<\/h2>\n<p>The ranking pipeline is much less mysterious than people make it sound. In Battle mode, a user enters one prompt, gets responses from two anonymous models, and votes for the better answer. Only votes cast while the identities are hidden count toward the official rankings. After the vote, the model names are revealed and the system can resample a new anonymous matchup for the next round (<a href=\"https:\/\/arena.ai\/how-it-works\" target=\"_blank\" rel=\"noopener\">How Arena Works<\/a>; <a href=\"https:\/\/arena.ai\/faq\" target=\"_blank\" rel=\"noopener\">Arena FAQ<\/a>).<\/p>\n<figure class=\"wp-block-image size-full in-content-visual\"><img decoding=\"async\" src=\"https:\/\/messengerbot.app\/wp-content\/uploads\/2026\/04\/chatbot-arena-support-1.png\" alt=\"LLM leaderboard explained\" title=\"\"><\/figure>\n<p>That anonymity matters a lot. If you show users &#8220;Claude&#8221; and &#8220;GPT&#8221; labels before they vote, you are not measuring answer quality anymore. You are measuring brand preference, tribal behavior, and launch-week hype. Arena explicitly says the models remain anonymous during voting for fairness and that votes after reveal do not change the public standings (<a href=\"https:\/\/arena.ai\/faq\" target=\"_blank\" rel=\"noopener\">Arena FAQ<\/a>).<\/p>\n<p>The second important detail is that Arena does not list every model instantly. Under the published policy, a model typically needs <strong>at least 1,000 votes<\/strong> and usually more before its rating is considered stable enough to appear on the public leaderboard. If a model was tested anonymously before public release, the score can appear as <strong>preliminary<\/strong> until enough fresh post-release votes come in. That one rule explains a lot of the launch-day confusion people have when they see a flashy screenshot and assume the ranking is fully settled (<a href=\"https:\/\/arena.ai\/blog\/policy\/\" target=\"_blank\" rel=\"noopener\">Arena Leaderboard Policy<\/a>).<\/p>\n<p>There is also a sampling policy underneath the scenes. Arena says at least one model in every battle must be publicly available, at least 20% of battles are between public models only, and stronger or more uncertain public models may be sampled more often so the system can keep the experience useful while reducing statistical uncertainty. Arena also states that it uses reweighting so the final scores stay unbiased despite that sampling design (<a href=\"https:\/\/arena.ai\/blog\/policy\/\" target=\"_blank\" rel=\"noopener\">Arena Leaderboard Policy<\/a>).<\/p>\n<p>Freshness is another reason Chatbot Arena stays relevant. Arena analyzed 355,575 battles from May to December 2024 and found that about <strong>75% of prompts collected each day were meaningfully different from any prompt on a previous day<\/strong>, while <strong>less than 1%<\/strong> appeared in popular benchmark datasets. That does not eliminate gaming forever, but it is much better than reusing the same closed set of benchmark questions until every frontier lab has trained around them (<a href=\"https:\/\/arena.ai\/blog\/freshness\/\" target=\"_blank\" rel=\"noopener\">Prompt freshness analysis<\/a>).<\/p>\n<p>One more practical point: users often resubmit the same prompt against new model pairs. Arena found that this behavior is common, especially with tester prompts like &#8220;how many r&#8217;s are in strawberry?&#8221; or simple greetings. The platform explicitly deduplicates those patterns when calculating final rankings, which is worth knowing because it shows the team is not blindly accepting every vote as equally informative (<a href=\"https:\/\/arena.ai\/blog\/freshness\/\" target=\"_blank\" rel=\"noopener\">Prompt freshness analysis<\/a>).<\/p>\n<p>So the short version is this:<\/p>\n<ol>\n<li>A user submits one real prompt.<\/li>\n<li>Two anonymous models answer that exact same prompt.<\/li>\n<li>The user votes for the better answer.<\/li>\n<li>The result feeds a Bradley-Terry ranking system.<\/li>\n<li>Models appear publicly only after ratings stabilize.<\/li>\n<\/ol>\n<p>That is why the leaderboard feels more alive than MMLU or older static benchmarks. It is built from head-to-head preference data instead of one-shot test accuracy.<\/p>\n<h2>What the Elo Score on the Leaderboard Really Measures<\/h2>\n<p>The score on the Chatbot Arena leaderboard looks like chess Elo, but technically Arena says it uses the <strong>Bradley-Terry<\/strong> model for pairwise comparison and then reports coefficients after a cosmetic transformation so they sit in an Elo-like range. In plain English, the score is a compact way of estimating how often one model tends to beat another in side-by-side human voting, given the prompts and votes the system has collected (<a href=\"https:\/\/arena.ai\/faq\" target=\"_blank\" rel=\"noopener\">Arena FAQ<\/a>; <a href=\"https:\/\/arena.ai\/blog\/extended-arena\/\" target=\"_blank\" rel=\"noopener\">Arena scoring note<\/a>).<\/p>\n<p>That means an Arena score is <strong>relative, not absolute<\/strong>. A 1504 model is not &#8220;objectively 1504-good&#8221; in some universal sense. It means that, inside Arena&#8217;s live evaluation pool, with Arena&#8217;s prompt distribution and Arena&#8217;s voting behavior, that model has performed strongly enough to earn that rating against the rest of the field.<\/p>\n<p>This is the mistake people make most often with the <strong>chatbot arena leaderboard<\/strong>. They read the number as if it were a certification mark. It is not. It is a dynamic estimate of preference strength in pairwise battles. If the prompt mix changes, the model pool changes, or the user base changes, the score can move even if the underlying model has not.<\/p>\n<p>The little uncertainty marker matters too. On the live text leaderboard, you see scores such as <strong>1504+\/-5<\/strong> or <strong>1492+\/-5<\/strong>. Practically, that tells you the rating is an estimate, not a fixed constant. When two models are separated by a tiny gap and their uncertainty bands are close, you should read that as a close race rather than a dramatic gap in capability. A ten-point swing near the top is usually a much smaller story than social media makes it sound like.<\/p>\n<p>Arena&#8217;s research emphasizes two benchmark qualities that matter here: <strong>agreement with human preference<\/strong> and <strong>separability<\/strong>. In other words, a good benchmark should match what people actually prefer and should separate models with enough confidence that small differences are not just noise. That is why vote count and confidence are as important as raw rank (<a href=\"https:\/\/arena.ai\/blog\/arena-hard\/\" target=\"_blank\" rel=\"noopener\">Arena-Hard pipeline<\/a>).<\/p>\n<p>If you want one sentence to remember, use this one: <strong>the Elo-style score measures expected head-to-head human preference in Arena, not total AI value in every context<\/strong>.<\/p>\n<h2>How to Read a Chatbot Arena Leaderboard Without Getting Misled<\/h2>\n<p>Here is the part that trips up even experienced AI buyers: there is no single Chatbot Arena view that answers every question. Arena now has an overview page, a text leaderboard, a separate code leaderboard, a separate vision leaderboard, and other task-specific boards. If you are reading only one screenshot on X, you are usually missing the context that makes the rank meaningful (<a href=\"https:\/\/arena.ai\/leaderboard\/\" target=\"_blank\" rel=\"noopener\">Arena Overview<\/a>).<\/p>\n<figure class=\"wp-block-image size-full in-content-visual\"><img decoding=\"async\" src=\"https:\/\/messengerbot.app\/wp-content\/uploads\/2026\/04\/chatbot-arena-support-2.png\" alt=\"AI model benchmarks\" title=\"\"><\/figure>\n<p>Start with <strong>which arena you are actually looking at<\/strong>. The text leaderboard covers open-ended text tasks such as math, coding, creative writing, instruction following, and longer queries. Code Arena is different. It evaluates agentic coding tasks with multi-step reasoning and tool use. Vision Arena is different again. It evaluates models on visual reasoning. A model that looks average in Text Arena may still be exceptional in Code Arena or Vision Arena, and vice versa (<a href=\"https:\/\/arena.ai\/leaderboard\/text\" target=\"_blank\" rel=\"noopener\">Text Arena<\/a>; <a href=\"https:\/\/arena.ai\/leaderboard\/code\" target=\"_blank\" rel=\"noopener\">Code Arena<\/a>; <a href=\"https:\/\/arena.ai\/leaderboard\/vision\/overall\" target=\"_blank\" rel=\"noopener\">Vision Arena<\/a>).<\/p>\n<p>Next, look at <strong>votes<\/strong>. A score backed by 41,585 votes is telling you something sturdier than a score backed by 1,046 votes. That does not mean the smaller sample is useless, but it does mean you should be more cautious about declaring a permanent winner. This matters especially for newly released or preliminary models, where early enthusiast traffic can skew prompt mix and sentiment.<\/p>\n<p>Then check the <strong>preliminary<\/strong> label. Arena uses it when a model was evaluated before or around release and still needs more fresh public votes. If you ignore that label, you end up treating a provisional standing like a settled ranking. That is bad reading, not bad benchmarking (<a href=\"https:\/\/arena.ai\/blog\/policy\/\" target=\"_blank\" rel=\"noopener\">Arena Leaderboard Policy<\/a>).<\/p>\n<p>After that, pay attention to the columns most people skip: <strong>price<\/strong> and <strong>context<\/strong>. The live text leaderboard currently shows listed API price per million input and output tokens for many models. That is extremely useful because it stops the conversation from turning into &#8220;best model wins&#8221; fantasy. In the real world, a model that sits slightly lower on the <strong>llm leaderboard<\/strong> but costs half as much can be the better deployment choice.<\/p>\n<p>If you are mostly comparing product feel rather than raw model IDs, you should also separate <strong>API models<\/strong> from <strong>consumer apps<\/strong>. <code>claude-opus-4-6-thinking<\/code>, <code>gpt-5.4-high<\/code>, and <code>gemini-3.1-pro-preview<\/code> are model endpoints or benchmark entries, not simple one-click consumer products. If what you really want is &#8220;Which tools feel best to use day to day?&#8221; our guide to <a href=\"\/ai-like-chatgpt-12-alternatives-clones-and-open-source-models-compared-in-2026\/\">AI models that feel like ChatGPT<\/a> is the better comparison lens.<\/p>\n<p>My rule of thumb for reading Arena is blunt:<\/p>\n<ul>\n<li>If the gap is small, treat it as a close race.<\/li>\n<li>If the vote count is small, treat it as provisional even without the label.<\/li>\n<li>If the model is only strong in one category, do not promote it to universal winner.<\/li>\n<li>If price, latency, privacy, or tool use matter, do not stop at rank.<\/li>\n<\/ul>\n<p>That one habit will save you from about 80% of leaderboard discourse online.<\/p>\n<h2>Which Models Are Currently Top of Chatbot Arena in April 2026<\/h2>\n<p>As of April 11, 2026, the live Text Arena leaderboard was last updated on April 10, 2026 and shows the following top ten overall text models. I am using Arena&#8217;s own live scores, vote counts, and listed API prices here, not recycled screenshots from secondary blogs (<a href=\"https:\/\/arena.ai\/leaderboard\/text\" target=\"_blank\" rel=\"noopener\">Arena Text Leaderboard<\/a>).<\/p>\n<table>\n<thead>\n<tr>\n<th>Rank<\/th>\n<th>Model<\/th>\n<th>Score<\/th>\n<th>Votes<\/th>\n<th>Listed API Price<\/th>\n<th>What Stands Out<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>1<\/td>\n<td>claude-opus-4-6-thinking<\/td>\n<td>1504+\/-5<\/td>\n<td>16,278<\/td>\n<td>$5 \/ $25 per 1M tokens<\/td>\n<td>Current overall text leader and also category leader across several text views<\/td>\n<\/tr>\n<tr>\n<td>2<\/td>\n<td>claude-opus-4-6<\/td>\n<td>1496+\/-5<\/td>\n<td>17,416<\/td>\n<td>$5 \/ $25 per 1M tokens<\/td>\n<td>Very close to the top without the thinking variant label<\/td>\n<\/tr>\n<tr>\n<td>3<\/td>\n<td>muse-spark<\/td>\n<td>1493+\/-10<\/td>\n<td>3,268<\/td>\n<td>N\/A<\/td>\n<td>High rank, but still marked preliminary and backed by a much smaller sample<\/td>\n<\/tr>\n<tr>\n<td>4<\/td>\n<td>gemini-3.1-pro-preview<\/td>\n<td>1492+\/-5<\/td>\n<td>20,531<\/td>\n<td>$2 \/ $12 per 1M tokens<\/td>\n<td>Strong balance of rank, vote volume, and price efficiency<\/td>\n<\/tr>\n<tr>\n<td>5<\/td>\n<td>gemini-3-pro<\/td>\n<td>1486+\/-4<\/td>\n<td>41,585<\/td>\n<td>$2 \/ $12 per 1M tokens<\/td>\n<td>Huge vote volume and very stable placement near the top<\/td>\n<\/tr>\n<tr>\n<td>6<\/td>\n<td>grok-4.20-beta1<\/td>\n<td>1486+\/-7<\/td>\n<td>9,689<\/td>\n<td>N\/A<\/td>\n<td>Essentially tied on score with Gemini 3 Pro, but with less sample depth<\/td>\n<\/tr>\n<tr>\n<td>7<\/td>\n<td>gpt-5.4-high<\/td>\n<td>1484+\/-7<\/td>\n<td>9,681<\/td>\n<td>$2.50 \/ $15 per 1M tokens<\/td>\n<td>Still highly competitive, especially when math performance matters<\/td>\n<\/tr>\n<tr>\n<td>8<\/td>\n<td>grok-4.20-beta-0309-reasoning<\/td>\n<td>1478+\/-6<\/td>\n<td>9,781<\/td>\n<td>$2 \/ $6 per 1M tokens<\/td>\n<td>Cheaper output than several frontier peers while staying in the top ten<\/td>\n<\/tr>\n<tr>\n<td>9<\/td>\n<td>gpt-5.2-chat-latest-20260210<\/td>\n<td>1477+\/-5<\/td>\n<td>15,704<\/td>\n<td>$1.75 \/ $14 per 1M tokens<\/td>\n<td>Not the highest rank, but still very strong and cheaper than some top-five models<\/td>\n<\/tr>\n<tr>\n<td>10<\/td>\n<td>grok-4.20-multi-agent-beta-0309<\/td>\n<td>1476+\/-6<\/td>\n<td>10,112<\/td>\n<td>$2 \/ $6 per 1M tokens<\/td>\n<td>Close enough to the pack that price and use case matter more than rank alone<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The headline is not just &#8220;Anthropic is winning.&#8221; The more useful reading is that <strong>the top band is crowded<\/strong>. Claude Opus 4.6 Thinking is clearly on top right now, but Gemini 3.1 Pro Preview, Gemini 3 Pro, GPT-5.4 High, and several xAI models are close enough that procurement, latency, tool access, and ecosystem fit can easily outweigh a few leaderboard points.<\/p>\n<p>The price column makes that even clearer. Gemini 3.1 Pro Preview is listed at <strong>$2 \/ $12 per million tokens<\/strong> while Claude Opus 4.6 Thinking is listed at <strong>$5 \/ $25<\/strong>. If you are shipping a high-volume feature, that gap matters. So does the fact that Gemini 3 Pro has more than <strong>41,000 votes<\/strong> on the board, which gives its rank extra stability compared with smaller-sample entrants near the top.<\/p>\n<p>There is also a consumer-product trap here. The model ID topping Chatbot Arena is not necessarily the exact package you buy inside a consumer chat app. For example, ChatGPT Plus is a <strong>$20\/month<\/strong> plan, Claude Pro is <strong>$20\/month or $17\/month when billed annually<\/strong>, and Google AI Pro is <strong>$19.99\/month<\/strong>. Those subscriptions bundle model access, tool caps, file features, and interface features that the raw leaderboard score does not capture (<a href=\"https:\/\/help.openai.com\/en\/articles\/6950777-what-is-chatgpt-plus\" target=\"_blank\" rel=\"noopener\">ChatGPT Plus pricing<\/a>; <a href=\"https:\/\/www.anthropic.com\/pricing\" target=\"_blank\" rel=\"noopener\">Claude pricing<\/a>; <a href=\"https:\/\/gemini.google\/subscriptions\/\" target=\"_blank\" rel=\"noopener\">Google AI Pro pricing<\/a>).<\/p>\n<p>That is why a smart buyer reads this section in two layers. Layer one: who wins the public preference battles right now? Layer two: what do those wins cost, and in what product form can you actually buy or deploy them?<\/p>\n<h2>Chatbot Arena vs MMLU vs Other Benchmarks: When Each One Matters<\/h2>\n<p>Chatbot Arena is powerful, but it should not replace every other benchmark in your evaluation stack. Different benchmarks answer different questions. If you use the wrong benchmark for the wrong decision, you get false confidence fast.<\/p>\n<table>\n<thead>\n<tr>\n<th>Benchmark<\/th>\n<th>What It Measures Best<\/th>\n<th>When It Matters Most<\/th>\n<th>Where It Falls Short<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Chatbot Arena<\/td>\n<td>Live human preference in pairwise battles<\/td>\n<td>Choosing general-purpose chat models, comparing frontier releases, tracking real-world preference<\/td>\n<td>Does not directly measure latency, safety policy fit, uptime, or your own production workflows<\/td>\n<\/tr>\n<tr>\n<td>MMLU<\/td>\n<td>Broad academic and professional knowledge on 57 multiple-choice tasks<\/td>\n<td>Checking knowledge breadth and reasoning across standardized subjects<\/td>\n<td>Static and close-ended; weak proxy for actual chat usefulness or product quality<\/td>\n<\/tr>\n<tr>\n<td>HumanEval \/ live coding tests<\/td>\n<td>Code generation correctness on defined tasks<\/td>\n<td>Evaluating code output quality in isolated programming problems<\/td>\n<td>Misses workflow issues like debugging, tool use, repo navigation, and long sessions<\/td>\n<\/tr>\n<tr>\n<td>SWE-Bench style tests<\/td>\n<td>Repo-level software engineering on real issues<\/td>\n<td>Judging agentic coding systems and practical developer automation<\/td>\n<td>Not a great proxy for writing, ideation, support chat, or general assistant behavior<\/td>\n<\/tr>\n<tr>\n<td>Vision or multimodal benchmarks<\/td>\n<td>Image understanding, visual reasoning, OCR, diagrams, captioning<\/td>\n<td>Document AI, multimodal support agents, visual workflows<\/td>\n<td>Cannot tell you much about pure text chat quality by itself<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>MMLU is the clearest contrast. The original MMLU paper introduced a test covering <strong>57 tasks<\/strong> across subjects like math, history, computer science, and law. That makes it useful for measuring broad knowledge and test-style reasoning. It does <strong>not<\/strong> tell you whether a model is pleasant to work with, follows ambiguous instructions well, writes naturally, or handles messy real prompts better than a rival (<a href=\"https:\/\/arxiv.org\/abs\/2009.03300\" target=\"_blank\" rel=\"noopener\">MMLU paper<\/a>).<\/p>\n<p>Arena&#8217;s own research explicitly criticizes traditional benchmarks for being static or close-ended, and it singles out MMLU as an example of a multiple-choice benchmark that does not fully satisfy the needs of live chatbot evaluation. Arena-Hard was built to improve separability, freshness, and agreement with human preference precisely because those are the areas static chat benchmarks struggle with most (<a href=\"https:\/\/arena.ai\/blog\/arena-hard\/\" target=\"_blank\" rel=\"noopener\">Arena-Hard pipeline<\/a>).<\/p>\n<p>So when should you use each?<\/p>\n<ul>\n<li>Use <strong>Chatbot Arena<\/strong> when you care about real-world prompt handling and comparative human preference.<\/li>\n<li>Use <strong>MMLU<\/strong> when you want a standardized knowledge snapshot across many subjects.<\/li>\n<li>Use <strong>coding benchmarks<\/strong> when shipping developer tools or agentic coding systems.<\/li>\n<li>Use <strong>vision benchmarks<\/strong> when images, OCR, documents, or diagrams are core to the job.<\/li>\n<\/ul>\n<p>The strongest evaluation stack is usually a mix: Chatbot Arena for live preference, one or two task benchmarks for your exact workload, and then your own production tests on company data.<\/p>\n<h2>Hidden Gotchas in the Chatbot Arena Rankings (Sample Size, Category Gaps)<\/h2>\n<p>Chatbot Arena is useful because it is live. That is also the source of several traps.<\/p>\n<p><strong>Gotcha one: sample size can fool you.<\/strong> If Model A is ahead of Model B by a handful of points but has far fewer votes, the apparent lead may be real or it may be a temporary effect of who tested it and what prompts they used. Arena&#8217;s policy explicitly waits for ratings to stabilize, but even after listing, lower-sample models should be read with more caution than entrenched models with tens of thousands of votes (<a href=\"https:\/\/arena.ai\/blog\/policy\/\" target=\"_blank\" rel=\"noopener\">Arena Leaderboard Policy<\/a>).<\/p>\n<p><strong>Gotcha two: prompt mix changes the game.<\/strong> Arena&#8217;s freshness analysis found that about 75% of daily prompts are fresh, which is excellent for contamination resistance. But that same freshness means the leaderboard is always reacting to new user behavior. A model can surge because it handles a wave of hard reasoning prompts well, or slip because the community starts stress-testing a weakness it previously avoided (<a href=\"https:\/\/arena.ai\/blog\/freshness\/\" target=\"_blank\" rel=\"noopener\">Prompt freshness analysis<\/a>).<\/p>\n<p><strong>Gotcha three: some categories are stronger than others.<\/strong> Arena has many categories now, but no category set perfectly matches your workload. For example, a support automation team might care more about refusal behavior, retrieval grounding, multilingual consistency, and policy compliance than about creative writing rank. A coding team might care far more about Code Arena than Text Arena. If your workload is narrow, the overall score can be too broad to guide a purchase.<\/p>\n<p><strong>Gotcha four: pre-release access muddies interpretation.<\/strong> Arena openly works with labs to test unreleased models under anonymous labels. That is good for transparency compared with private vendor bake-offs, but it also means launch-week discourse can mix public models, anonymous pre-release variants, and preliminary scores in ways casual readers misunderstand (<a href=\"https:\/\/arena.ai\/faq\" target=\"_blank\" rel=\"noopener\">Arena FAQ<\/a>; <a href=\"https:\/\/arena.ai\/blog\/policy\/\" target=\"_blank\" rel=\"noopener\">Arena Leaderboard Policy<\/a>).<\/p>\n<p><strong>Gotcha five: duplicated tester prompts still exist.<\/strong> Arena&#8217;s own analysis says duplicate prompts often come from greetings, tester prompts, or one user repeating the same question across multiple battles. The platform deduplicates and downweights patterns like this, but if a certain launch attracts a swarm of identical stress tests, short-term movement can reflect community behavior as much as broad capability (<a href=\"https:\/\/arena.ai\/blog\/freshness\/\" target=\"_blank\" rel=\"noopener\">Prompt freshness analysis<\/a>).<\/p>\n<p>The takeaway is not &#8220;ignore Chatbot Arena.&#8221; The right takeaway is: <strong>treat Arena as a live market signal with methodology, not as a timeless truth table<\/strong>.<\/p>\n<h2>How Businesses Should Use Chatbot Arena When Picking an LLM<\/h2>\n<p>If you are choosing an LLM for production, Chatbot Arena is best used as a <strong>starting filter<\/strong>, not a final procurement decision. It tells you which models humans currently prefer in open-ended tasks. That is valuable. It does not tell you whether the model fits your security posture, your budget, your latency target, your vendor risk tolerance, or your integration stack.<\/p>\n<p>The cleanest business workflow I know looks like this:<\/p>\n<ol>\n<li><strong>Use Chatbot Arena to build the shortlist.<\/strong> Do not evaluate 20 models if the public evidence already says only 5 are in serious contention.<\/li>\n<li><strong>Filter by modality.<\/strong> Text, code, vision, document, and search models behave differently.<\/li>\n<li><strong>Filter by economics.<\/strong> Use the listed API price and your expected token volume to eliminate bad fits early.<\/li>\n<li><strong>Run your own workload tests.<\/strong> Support, sales, research, coding, summarization, extraction, and drafting all stress different weaknesses.<\/li>\n<li><strong>Check operational fit.<\/strong> Rate limits, region support, privacy controls, tool use, and ecosystem integration matter as much as leaderboard position.<\/li>\n<\/ol>\n<p>Here is a quick buyer-oriented example using current Arena-listed text prices:<\/p>\n<table>\n<thead>\n<tr>\n<th>Model<\/th>\n<th>Text Arena Rank<\/th>\n<th>Listed API Price<\/th>\n<th>When It Looks Attractive<\/th>\n<th>Main Tradeoff<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>claude-opus-4-6-thinking<\/td>\n<td>#1<\/td>\n<td>$5 \/ $25 per 1M tokens<\/td>\n<td>Premium workloads where quality matters more than spend<\/td>\n<td>Expensive at scale<\/td>\n<\/tr>\n<tr>\n<td>gemini-3.1-pro-preview<\/td>\n<td>#4<\/td>\n<td>$2 \/ $12 per 1M tokens<\/td>\n<td>Strong frontier performance with better cost efficiency<\/td>\n<td>Preview status can matter for risk-sensitive buyers<\/td>\n<\/tr>\n<tr>\n<td>gpt-5.4-high<\/td>\n<td>#7<\/td>\n<td>$2.50 \/ $15 per 1M tokens<\/td>\n<td>Organizations already standardized on OpenAI tooling<\/td>\n<td>Not the top-ranked text model right now<\/td>\n<\/tr>\n<tr>\n<td>gpt-5.2-chat-latest-20260210<\/td>\n<td>#9<\/td>\n<td>$1.75 \/ $14 per 1M tokens<\/td>\n<td>Reasonable cost-to-rank balance for general chat products<\/td>\n<td>Smaller context than several 1M-token rivals<\/td>\n<\/tr>\n<tr>\n<td>gemini-3-flash<\/td>\n<td>#11<\/td>\n<td>$0.50 \/ $3 per 1M tokens<\/td>\n<td>High-volume tasks where cost dominates<\/td>\n<td>Lower rank than premium frontier models<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>This is where the leaderboard becomes commercially useful. The rank tells you where quality sits. The price tells you what that quality costs. Everything after that is your own business math.<\/p>\n<p>If you are shopping for consumer-facing chat tools rather than raw model endpoints, broaden the lens after the shortlist stage. Our <a href=\"\/chatgpt-alternatives-2026-12-ai-tools-that-match-or-beat-chatgpt-free-and-paid\/\">ChatGPT alternatives buyer guide<\/a> is better for product-level tradeoffs such as interface, files, memory, search, and bundled tools. Chatbot Arena is still useful there, but it is only one input.<\/p>\n<p>For businesses building actual customer-facing automation, you also need to separate <strong>model selection<\/strong> from <strong>channel automation<\/strong>. A high-ranking LLM does not automatically give you Messenger flows, lead capture, human handoff, website chat, or comment-to-DM automation. That is why platform comparisons still matter after you finish reading the leaderboard.<\/p>\n<h2>Chatbot Arena Category Leaderboards: Coding, Math, Creative Writing, Vision<\/h2>\n<p>Arena is easiest to misunderstand at the category level, because there are <strong>two different category ideas<\/strong> on the site. Inside the main Text Arena, you can view categories such as Coding, Math, Creative Writing, Instruction Following, and Hard Prompts. Separately, Arena also runs whole standalone leaderboards like Code Arena and Vision Arena. Those are related, but they are not interchangeable (<a href=\"https:\/\/arena.ai\/leaderboard\/\" target=\"_blank\" rel=\"noopener\">Arena Overview<\/a>).<\/p>\n<p>On the current Arena Overview, <strong>claude-opus-4-6-thinking<\/strong> is ranked <strong>#1 overall<\/strong> and also <strong>#1 in Coding, Math, and Creative Writing<\/strong> inside the text-category view. Right behind it, <strong>gpt-5.4-high<\/strong> is ranked <strong>#2 in Math<\/strong>, while <strong>gemini-3.1-pro-preview<\/strong> is ranked <strong>#2 in Creative Writing<\/strong> and <strong>#3 in Math<\/strong>. That is a much better way to read the leaderboard than just repeating the overall rank (<a href=\"https:\/\/arena.ai\/leaderboard\/\" target=\"_blank\" rel=\"noopener\">Arena Overview<\/a>).<\/p>\n<table>\n<thead>\n<tr>\n<th>View<\/th>\n<th>Current Leader<\/th>\n<th>Notable Runners-Up<\/th>\n<th>What It Actually Tells You<\/th>\n<\/tr>\n<\/thead>\n<tbody>\n<tr>\n<td>Text Coding category<\/td>\n<td>claude-opus-4-6-thinking (#1)<\/td>\n<td>claude-opus-4-6 (#2), gpt-5.4-high (#3)<\/td>\n<td>How models perform on coding-flavored prompts inside general text battles<\/td>\n<\/tr>\n<tr>\n<td>Text Math category<\/td>\n<td>claude-opus-4-6-thinking (#1)<\/td>\n<td>gpt-5.4-high (#2), gemini-3.1-pro-preview (#3)<\/td>\n<td>How models handle math-heavy text prompts<\/td>\n<\/tr>\n<tr>\n<td>Text Creative Writing category<\/td>\n<td>claude-opus-4-6-thinking (#1)<\/td>\n<td>gemini-3.1-pro-preview (#2), gemini-3-pro (#3)<\/td>\n<td>Human preference on tone, style, and open-ended writing<\/td>\n<\/tr>\n<tr>\n<td>Code Arena overall<\/td>\n<td>claude-opus-4-6-thinking (1548)<\/td>\n<td>claude-opus-4-6 (1542), glm-5.1 (1530)<\/td>\n<td>Agentic coding with multi-step reasoning and tool use<\/td>\n<\/tr>\n<tr>\n<td>Vision Arena overall<\/td>\n<td>claude-opus-4-6-thinking (1302)<\/td>\n<td>muse-spark (1293, preliminary), claude-opus-4-6 (1289), gemini-3-pro (1288)<\/td>\n<td>Visual reasoning over image inputs<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>The separate Code Arena is especially important for technical teams. As of April 9, 2026, Code Arena shows <strong>231,158 votes across 60 models<\/strong>, with Claude Opus 4.6 Thinking at <strong>1548+11\/-11<\/strong>, Claude Opus 4.6 at <strong>1542+10\/-10<\/strong>, and GLM-5.1 at <strong>1530+20\/-20<\/strong>. That ranking is more relevant for serious coding agents than the text leaderboard&#8217;s generic coding slice (<a href=\"https:\/\/arena.ai\/leaderboard\/code\" target=\"_blank\" rel=\"noopener\">Code Arena<\/a>).<\/p>\n<p>Vision is the same story. As of April 10, 2026, Vision Arena shows <strong>756,611 votes across 111 models<\/strong>, with Claude Opus 4.6 Thinking at <strong>1302+\/-14<\/strong>, Meta&#8217;s Muse-Spark at <strong>1293+\/-17<\/strong> with a preliminary label, Claude Opus 4.6 at <strong>1289+\/-14<\/strong>, and Gemini 3 Pro at <strong>1288+\/-8<\/strong>. If your product handles receipts, screenshots, charts, or support images, that board is far more relevant than the main text ranking (<a href=\"https:\/\/arena.ai\/leaderboard\/vision\/overall\" target=\"_blank\" rel=\"noopener\">Vision Arena<\/a>).<\/p>\n<p>This is also where Chatbot Arena becomes more useful than a one-line headline. It helps you choose the right <strong>kind<\/strong> of strength. If your team writes code all day, a model&#8217;s creative-writing rank is interesting but secondary. If your product drafts marketing copy, the creative-writing category may matter more than the coding board. Category reading is where the leaderboard becomes a tool instead of entertainment.<\/p>\n<h2>What Chatbot Arena Does NOT Tell You About an LLM<\/h2>\n<p>The most dangerous mistake is treating Chatbot Arena as a complete buying decision. It is not.<\/p>\n<p>Chatbot Arena does <strong>not<\/strong> directly tell you:<\/p>\n<ul>\n<li>Latency under your production traffic<\/li>\n<li>Reliability, uptime, and rate-limit behavior<\/li>\n<li>How well the model works with your proprietary data or retrieval stack<\/li>\n<li>Safety policy fit for your specific industry<\/li>\n<li>How cleanly it integrates with your orchestration, logging, or compliance tooling<\/li>\n<li>Whether the consumer app experience is better than the API ranking suggests<\/li>\n<li>Total cost after tool calls, retries, caching, and human review<\/li>\n<\/ul>\n<p>It also does not rank full <strong>chatbot platforms<\/strong>. That matters for MessengerBot readers because deploying an LLM into a real customer channel is not the same thing as winning an Arena battle. A business that needs Facebook Messenger automation, lead capture, comment triggers, live handoff, and campaign logic still needs a platform decision after the model decision. That is why the leaderboard is upstream of product selection, not a substitute for it.<\/p>\n<p>If you want to test the market without paying first, use our roundup of the <a href=\"\/best-free-ai-chatbots-in-2026-15-tools-you-can-use-without-paying-a-cent\/\">best free AI chatbots<\/a>. If you want the broader channel-and-platform decision, use the <a href=\"\/chatbot-comparison-2026-chatgpt-vs-claude-vs-gemini-vs-messenger-bot-vs-manychat\/\">complete chatbot platform comparison<\/a> you saw earlier. Arena helps you read the model race. It does not finish the software buying process for you.<\/p>\n<p>The practical way to use Chatbot Arena is this: trust it for <strong>direction<\/strong>, verify it with <strong>your own workload<\/strong>, and combine it with <strong>cost, governance, and deployment fit<\/strong> before you sign anything.<\/p>\n<p>If your next step is moving from model rankings to an actual messaging deployment stack, compare your channel needs against product features, then <a href=\"\/pricing\/\">View MessengerBot Pricing<\/a> to see where MessengerBot fits on the platform side.<\/p>\n<section class=\"faq-section\">\n<h2>Frequently Asked Questions<\/h2>\n<h3>What is Chatbot Arena and who runs it?<\/h3>\n<p>Chatbot Arena is a public AI evaluation platform where users compare two anonymous models side by side and vote for the better answer. It was created by researchers from UC Berkeley and is now operated as Arena, formerly called LMArena, by Arena Intelligence. In 2026 it functions as one of the most watched public LLM leaderboards because it combines live prompts, large-scale human voting, and public rankings.<\/p>\n<h3>How does Chatbot Arena actually rank AI models?<\/h3>\n<p>Chatbot Arena ranks models through pairwise blind voting. A user enters one prompt, two anonymous models answer it, and the user votes for the better response. Arena then feeds those results into a Bradley-Terry rating system, which is similar to Elo for pairwise competitions. Models usually need at least 1,000 votes and often more before Arena considers the score stable enough for public listing.<\/p>\n<h3>What does the Elo score mean on the Chatbot Arena leaderboard?<\/h3>\n<p>The Elo-style score is a relative estimate of how often a model tends to win side-by-side battles against other models in Arena. It is not an absolute intelligence score and it does not measure every production factor that matters to a business. A higher score means the model is winning more human-preference comparisons in Arena&#8217;s live prompt environment.<\/p>\n<h3>Which AI model is #1 on Chatbot Arena in 2026?<\/h3>\n<p>As of April 11, 2026, the live Text Arena leaderboard lists claude-opus-4-6-thinking at #1 with a score of 1504+\/-5. That answer can change as new votes arrive and new models launch, so the safest habit is to check the live leaderboard date before quoting a rank.<\/p>\n<h3>Is Chatbot Arena a good benchmark for picking a business chatbot?<\/h3>\n<p>It is a good starting benchmark, but not a complete buying framework. Chatbot Arena is excellent for identifying which models humans currently prefer in real side-by-side use. It does not tell you enough about latency, privacy, integrations, compliance, human handoff, or full chatbot-platform features. Businesses should use Arena to build a shortlist, then test the finalists on their own workflows and deployment requirements.<\/p>\n<\/section>\n<p>  <script type=\"application\/ld+json\">\n  {\n    \"@context\": \"https:\/\/schema.org\",\n    \"@type\": \"FAQPage\",\n    \"mainEntity\": [\n      {\n        \"@type\": \"Question\",\n        \"name\": \"What is Chatbot Arena and who runs it?\",\n        \"acceptedAnswer\": {\n          \"@type\": \"Answer\",\n          \"text\": \"Chatbot Arena is a public AI evaluation platform where users compare two anonymous models side by side and vote for the better answer. It was created by researchers from UC Berkeley and is now operated as Arena, formerly called LMArena, by Arena Intelligence.\"\n        }\n      },\n      {\n        \"@type\": \"Question\",\n        \"name\": \"How does Chatbot Arena actually rank AI models?\",\n        \"acceptedAnswer\": {\n          \"@type\": \"Answer\",\n          \"text\": \"Chatbot Arena uses pairwise blind voting. A user enters one prompt, two anonymous models answer it, and the user votes for the better response. Arena then uses a Bradley-Terry rating system, similar to Elo, to estimate model strength from those pairwise comparisons.\"\n        }\n      },\n      {\n        \"@type\": \"Question\",\n        \"name\": \"What does the Elo score mean on the Chatbot Arena leaderboard?\",\n        \"acceptedAnswer\": {\n          \"@type\": \"Answer\",\n          \"text\": \"The Elo-style score is a relative estimate of how often a model tends to win side-by-side battles against other models in Arena. It reflects human preference in Arena's live prompt environment, not an absolute intelligence score or a complete production-readiness score.\"\n        }\n      },\n      {\n        \"@type\": \"Question\",\n        \"name\": \"Which AI model is #1 on Chatbot Arena in 2026?\",\n        \"acceptedAnswer\": {\n          \"@type\": \"Answer\",\n          \"text\": \"As of April 11, 2026, the live Text Arena leaderboard lists claude-opus-4-6-thinking at number one with a score of 1504 plus or minus 5.\"\n        }\n      },\n      {\n        \"@type\": \"Question\",\n        \"name\": \"Is Chatbot Arena a good benchmark for picking a business chatbot?\",\n        \"acceptedAnswer\": {\n          \"@type\": \"Answer\",\n          \"text\": \"Yes, as a starting point. Chatbot Arena is useful for identifying which models humans currently prefer in real side-by-side use, but businesses should still test the finalists on their own workflows, costs, privacy needs, integrations, and deployment requirements before choosing a business chatbot stack.\"\n        }\n      }\n    ]\n  }\n  <\/script><\/p>\n<section class=\"mb-related-reading\" style=\"margin-top: 3em; border-top: 1px solid #e6e6e6; padding-top: 1.5em;\">\n<h2>Related Reading From MessengerBot.app<\/h2>\n<ul>\n<li><a href=\"\/no-code-chatbot-builder-in-2026-the-best-visual-drag-and-drop-platforms\/\">No Code Chatbot Builder in 2026: The Best Visual Drag-and-Drop Platforms Ranked<\/a><\/li>\n<li><a href=\"\/automated-marketing-software-in-2026-the-best-platforms-for-small-business\/\">Automated Marketing Software in 2026: The Best Platforms for Small Business, Eco<\/a><\/li>\n<li><a href=\"\/ai-voice-chat-in-2026-best-voice-based-chatbots-how-they-work-and-whether\/\">AI Voice Chat in 2026: Best Voice-Based Chatbots, How They Work, and Whether The<\/a><\/li>\n<li><a href=\"\/manychat-in-2026-the-complete-guide-to-pricing-features-templates-and\/\">ManyChat in 2026: The Complete Guide to Pricing, Features, Templates, and Whethe<\/a><\/li>\n<\/ul>\n<\/section>\n<span class=\"et_bloom_bottom_trigger\"><\/span>","protected":false},"excerpt":{"rendered":"<input type=\"hidden\" value=\"\" data-essbisPostContainer=\"\" data-essbisPostUrl=\"https:\/\/messengerbot.app\/pt\/chatbot-arena-explained-how-llm-leaderboards-actually-rank-ai-models-in-2026\/\" data-essbisPostTitle=\"Chatbot Arena Explained: How LLM Leaderboards Actually Rank AI Models in 2026\" data-essbisHoverContainer=\"\"><p>If you work in AI long enough, you notice that almost every model launch eventually circles back to one screenshot: the Chatbot Arena leaderboard. OpenAI, Anthropic, Google, xAI, Meta, and a growing list of smaller labs all want a high placement there because it has become the public scorecard that technical buyers, developers, journalists, and [&hellip;]<\/p>\n","protected":false},"author":14928,"featured_media":261050,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":"","footnotes":"","rank_math_title":"Chatbot Arena 2026: How LLM Leaderboards Work","rank_math_description":"Chatbot Arena is the most cited LLM benchmark in 2026. Here is how it works, how to read the leaderboard, and what rankings really mean.","rank_math_focus_keyword":"chatbot arena explained","rank_math_canonical_url":"","rank_math_robots":"","rank_math_facebook_title":"","rank_math_facebook_description":"","rank_math_twitter_title":"","rank_math_twitter_description":""},"categories":[31],"tags":[],"class_list":["post-261053","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/posts\/261053","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/users\/14928"}],"replies":[{"embeddable":true,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/comments?post=261053"}],"version-history":[{"count":5,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/posts\/261053\/revisions"}],"predecessor-version":[{"id":262358,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/posts\/261053\/revisions\/262358"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/media\/261050"}],"wp:attachment":[{"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/media?parent=261053"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/categories?post=261053"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/messengerbot.app\/pt\/wp-json\/wp\/v2\/tags?post=261053"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}