Artificial Analysis
Artificial Analysis
OP-4.65%
APT-4.04%
BCH-2.68%
DOT-3.00%
SHIB-2.72%
FIL-4.83%
DOGE-4.02%
HBAR-3.86%
NEAR-3.79%
ATOM-0.84%
BTC-2.49%
SOL-3.96%
ARB-2.52%
AVAX-3.54%
TON-0.45%
XRP-3.11%
ICP-4.09%
ETH-2.14%
LINK-2.20%
LTC-3.15%
TRX-0.06%
ADA-2.95%
Anthropic launches their first Haiku model in 11 months - Claude 4.5 Haiku jumps 35 points in Artificial Analysis Intelligence Index to become relevant again Claude 4.5 Haiku is 3x cheaper per token than Claude 4.5 Sonnet. Running the Artificial Analysis Intelligence Index costs $262 with Haiku vs. $817 with Sonnet (~3x more) - full cost breakdown in the thread below. There is a stronger case for 4.5 Haiku’s intelligence/cost positioning than 3.5 Haiku, but there is a competitive field of cheaper alternatives with similar intelligence that may make more sense for developers without a reason to need a Claude model specifically - including gpt-oss-120b (reasoning high, ~$75) and Grok 4 Fast (~$40). Claude 4.5 Haiku is the most cost-effective way to access ‘Claude’ but is not the most cost effective model for its level of intelligence. Key benchmarking results: ➤🧠 Model Intelligence: In reasoning mode, Claude 4.5 Haiku scores 55 on the Artificial Analysis Intelligence Index. This is 8 points lower than Claude 4.5 Sonnet (Thinking) and 4 points lower than Claude 4.1 Opus (Thinking). Claude 4.5 Haiku (Thinking) places marginally ahead of Gemini 2.5 Flash (Reasoning, 54) but behind other reasoning models such as Qwen3 235B 2507 (57), DeepSeek V3.2 Exp (57), and GLM 4.6 (56) ➤📈 Intelligence Uplift: Anthropic released Claude 3.5 Haiku in November 2024, ~11 months before the release of Claude 4.5 Haiku. Claude 4.5 Haiku is a significant improvement in intelligence compared to Claude 3.5 Haiku, scoring 67% on GPQA Diamond in reasoning mode (compared to 41% for Claude 3.5 Haiku) ➤⚙️ Notable Strengths: In reasonign mode, Claude 4.5 Haiku performs well in long-context reasoning (70% on AA-LCR, behind only GPT-5 High) and coding (43%, matching GPT-5 High and Gemini 2.5 Pro) ➤⚡ Non-Reasoning Performance: In non-reasoning mode, Claude 4.5 Haiku scores 42 on the Artificial Analysis Intelligence Index. This places the model in line with GPT-5 (minimal, 43) but behind Gemini 2.5 Flash (non-reasoning, 47) ➤💲 Pricing: Claude 4.5 Haiku is priced at $1/$5 per 1M input/output tokens, which makes it 3x cheaper compared to Claude 4.5 Sonnet (priced at $3/$15 per 1M input/output tokens) ➤⚙️ Token Efficiency: Anthropic’s Claude models continue to be more token-efficient than all other reasoning models. For Claude 4.5 Haiku (Thinking) -evaluated with a maximum reasoning budget of 64k tokens - we see the model use 39M output tokens to run the Artificial Analysis Intelligence Index. Its token usage is lower than Claude 4.5 Sonnet (42M) but higher than Claude 4.1 Opus (30M) in thinking mode Key model details: ➤📏 Context Window: 200K tokens. This is equivalent to Claude 4.5 Sonnet ➤🌐 Availability: Claude 4.5 Haiku is available via Anthropic‘s API, Google Vertex and Amazon Bedrock. Claude 4.5 Haiku is also available via Claude, and Claude Code
Gallery 1
Claude 4.5 Haiku uses more tokens to run the Artificial Analysis Intelligence Index than Claude 4.1 Opus in reasoning mode and marginally fewer output tokens than Claude 4.5 Sonnet (Thinking). When comparing amongst Anthropic models, Claude 4.5 Haiku (Thinking) sits below Claude 4.1 Opus (Thinking) and Claude 4.5 Sonnet (Thinking) on the intelligence vs. output tokens frontier
Gallery 1
Gallery 2
Claude 4.5 Haiku is a significant intelligence uplift compared to Claude 3.5 Haiku. Compared to Claude 3.5 Haiku, there is a +26 p.p. and +24 p.p. increase in GPQA-Diamond scores for Thinking and Non-Thinking modes, respectively. Claude 3.5 Haiku is a non-reasoning model, and it was released ~11 months prior to the release of Claude 4.5 Haiku
Gallery 1
Claude 4.5 Haiku is on the frontier for Anthropic models when looking at the trade-off between intelligence and cost to run the Artificial Analysis Intelligence Index. This makes Claude 4.5 Haiku a valid alternative to Claude 4.5 Sonnet for users who want to access ‘Claude’ at a cheaper price point
Gallery 1
Individual results across all benchmarks in our Artificial Analysis Intelligence Index. We have run all these benchmarks independently and like-for-like across all models
Gallery 1
Compare Claude 4.5 Haiku to other models on Artificial Analysis:
Sourced fromtwitter
34.08K
289
The content on this page is provided by third parties. Unless otherwise stated, OKX is not the author of the cited article(s) and does not claim any copyright in the materials. The content is provided for informational purposes only and does not represent the views of OKX. It is not intended to be an endorsement of any kind and should not be considered investment advice or a solicitation to buy or sell digital assets. To the extent generative AI is utilized to provide summaries or other information, such AI generated content may be inaccurate or inconsistent. Please read the linked article for more details and information. OKX is not responsible for content hosted on third party sites. Digital asset holdings, including stablecoins and NFTs, involve a high degree of risk and can fluctuate greatly. You should carefully consider whether trading or holding digital assets is suitable for you in light of your financial condition.