ai.canshu.com
中文
VRAM Calculator Advisor & TCO API Pricing Compare Models Leaderboard GPUs

Search models, GPUs, and tools

↑↓ Navigate · Enter Open · ★ Watchlist prioritized ai.canshu.com
Meta
Open-Weight Meta · llama-3.1-8b-instruct · Text

Llama-3.1-8B-Instruct Official Specifications, Pricing & Benchmarks

Llama-3.1-8B-Instruct (llama-3.1-8b-instruct) by Meta, released 2024-07-23, featuring 131,072 context window, 16,384 max output tokens, and Text input.

📋 Llama-3.1-8B-Instruct Official API & System Card Specifications

Verified against official Meta developer documentation & pricing

API Model ID: llama-3.1-8b-instruct

1. Identity & Capabilities

API Spec
API Model ID
llama-3.1-8b-instruct
Release Date
2024-07-23
Weight License
Open-Weight (API Spec)
Native Reasoning
—
Function Calling & JSON Schema
✅ 原生支持
Batch API 异步批处理
✅ Supported (50% off)

2. Context, Output & Modalities

Limits
Max Context Window
131,000 tokens (131K)
Max Output Tokens
16,384 tokens
Input Modalities
Text
Output Modalities
Text
Direct China Access
🌐 Global / OpenRouter
Deployment Mode
Open-Weight + Cloud API

3. Official Pricing & Cache

USD / 1M
Input / 1M Tokens
$ 0.02
Cached Input / 1M
$ 0.004 -80%
Output / 1M Tokens
$ 0.04

🎛️ Official Sampling & Reasoning Parameters

Recommended generation settings & API parameter constraints

Standard Generation Config
temperature=0.7 top_p=0.95 max_tokens=16,384

📊 Llama-3.1-8B-Instruct Full Benchmark Scorecard

16 public benchmarks · ranks among 154 models · synced 2026-11-20

⚔️ Compare head-to-head

Source: ZeroEval / llm-stats.com (✓ = third-party verified, others vendor-reported).

Closest Self-Hostable Open-Weight Alternatives to Llama-3.1-8B-Instruct

Open-weight models with full HuggingFace weights for private GPU / Mac deployment

Compare with these →

Frequently Asked Questions

Is Llama-3.1-8B-Instruct open-source or proprietary?

Llama-3.1-8B-Instruct (llama-3.1-8b-instruct) is a proprietary commercial model by Meta. Weights and internal layer dimensions are undisclosed; it is accessed via cloud API.

What are the context limit and API pricing of Llama-3.1-8B-Instruct?

Llama-3.1-8B-Instruct supports 131K input context and 16,384 max output tokens, priced at $0.02/1M input ($0.004/1M cached) and $0.04/1M output.