ai.canshu.com
中文
VRAM Calculator Advisor & TCO API Pricing Compare Models Leaderboard GPUs

Search models, GPUs, and tools

↑↓ Navigate · Enter Open · ★ Watchlist prioritized ai.canshu.com
Alibaba Qwen
Open-Weight Alibaba Qwen · Dense 27B · Text+Image+Video · BF16

Qwen3.5-27B Architecture Parameters, Benchmarks & VRAM

Qwen3.5 27B native multimodal dense model with hybrid linear attention; fits comfortably inside 24GB GPUs with generous context headroom.

🧬 Qwen3.5-27B Architecture & Tensor Specifications

Verified directly against HuggingFace (Qwen/Qwen3.5-27B) config.json & Model Card

HF Class: Qwen3_5ForConditionalGeneration

1. Backbone & Dimensions

qwen3_5
Total / Active Params
27B (Dense)
Hidden Size (d_model)
5,120
FFN Intermediate Size
17,408
Activation / Norm
SiLU (SwiGLU) · ε=1e-6
Native Tensor Dtype
BF16

2. Attention & Layer Layout

HYBRID
Num Hidden Layers
64 Layers (16 Global KV)
Hidden Layer Layout
64 Hybrid Layers: 16 × [3 × Gated DeltaNet Linear + 1 × Gated Full Attention]
Attention Heads (Q / KV)
24 Q / 4 KV (6:1 GQA)
Head Dimension
256
Linear / KV Compression
Gated DeltaNet: 16 QK / 48 V heads (dim=128) · Only 16 layers allocate KV cache
Vision Encoder / MTP
ViT 27L · MTP 1L

3. Context, RoPE & Tokenizer

Tokenizer
Native Context Length
262,144 tokens
Max Extended Context
1,010,000 tokens
RoPE Configuration
mRoPE (θ=10,000,000 · partial=0.25 · section=[11,11,10] · YaRN 4x→1M)
Vocab Size
248,320 (Untied)
Special Token IDs
BOS: 248044 · EOS: [248046,248044] · PAD: 248044
Language Support
201 languages & dialects

📋 Qwen3.5-27B Official API & System Card Specifications

Verified against official Alibaba Qwen developer documentation & pricing

API Model ID: Qwen/Qwen3.5-27B

1. Identity & Capabilities

API Spec
API Model ID
Qwen/Qwen3.5-27B
Release Date
2026-02-23
Weight License
Open-Weight (API Spec)
Native Reasoning
✅ Supported
Function Calling & JSON Schema
✅ 原生支持
Batch API 异步批处理
✅ Supported (50% off)

2. Context, Output & Modalities

Limits
Max Context Window
256,000 tokens (256K)
Max Output Tokens
66,000 tokens
Input Modalities
Text + Image + Video
Output Modalities
Text
Direct China Access
✅ Direct CN + RMB
Deployment Mode
Open-Weight + Cloud API

3. Official Pricing & Cache

CNY / 1M
Input / 1M Tokens
¥ 0.6
Cached Input / 1M
¥ 0.6
Output / 1M Tokens
¥ 4.8
Tiered Pricing Notes
SiliconFlow: Open-weight cloud hosting on SiliconFlow

🏆 Official Benchmark Results

Sourced from official System Card / Model Card & technical reports

Arena Elo ~1452 AA Index 44
📚 Knowledge
MMLU-Pro 86.1 %

A more robust and challenging multi-task language understanding benchmark that extends MMLU by expanding multiple-choice options from 4 to 10, eliminating trivial questions, and focusing on reasoning-intensive tasks.

📚 Knowledge
MMLU-Redux 93.2 %

An improved version of the MMLU benchmark featuring manually re-annotated questions to identify and correct errors in the original dataset. Provides more reliable evaluation metrics for language models by addressing dataset quality issues found in the original MMLU.

📚 Knowledge
C-Eval 90.5 %

C-Eval is a comprehensive Chinese evaluation suite designed to assess advanced knowledge and reasoning abilities of foundation models in a Chinese context.

🧠 Reasoning
GPQA Diamond 85.5 %

PhD-level Google-proof science reasoning questions

🧠 Reasoning
HMMT Feb 25 92 %
💻 Coding
SWE-bench Verified 72.4 %

A verified subset of 500 software engineering problems from real GitHub issues, validated by human annotators for evaluating language models' ability to resolve real-world coding issues by generating patches for Python codebases.

💻 Coding
LiveCodeBench v6 80.7 %

LiveCodeBench is a holistic and contamination-free evaluation benchmark for large language models for code.

🤖 Agentic
BFCL-V4 68.5 %

Berkeley Function Calling Leaderboard V4 (BFCL-V4) evaluates LLMs on their ability to accurately call functions and APIs, including simple, multiple, parallel, and nested function calls across diverse programming scenarios.

👁️ Multimodal
MMMU 82.3 %

MMMU (Massive Multi-discipline Multimodal Understanding) is a benchmark designed to evaluate multimodal models on college-level subject knowledge and deliberate reasoning.

👁️ Multimodal
VideoMME (w/ sub) 87 %

The first-ever comprehensive evaluation benchmark of Multi-modal LLMs in Video analysis. Features 900 videos (254 hours) with 2,700 question-answer pairs covering 6 primary visual domains and 30 subfields.

🎛️ Official Sampling & Reasoning Parameters

Recommended generation settings & API parameter constraints

Thinking Mode (General & Agent)
temperature=1 top_p=0.95 top_k=20 min_p=0 presence_penalty=1.5 max_tokens=32,768

💡 Strip <think> blocks from multi-turn history; use up to 81,920 tokens for competition tasks.

Thinking Mode (Precise Coding)
temperature=0.6 top_p=0.95 top_k=20 min_p=0 presence_penalty=0 max_tokens=32,768

💡 Tuned for precise software engineering & WebDev without presence penalty.

Instruct / Non-Thinking (General)
temperature=0.7 top_p=0.8 top_k=20 min_p=0 presence_penalty=1.5 max_tokens=32,768

📊 Qwen3.5-27B Full Benchmark Scorecard

82 public benchmarks · ranks among 154 models · synced 2026-11-20

⚔️ Compare head-to-head

🤖 Agents & Tools 11 items

t2-bench #9/12 79%

t2-bench is a benchmark for evaluating agentic tool use capabilities, measuring how well models can select, sequence, and utilize tools to solve complex tasks. It tests autonomous planning and execution in multi-step scenarios.

BFCL-V4 #7/10 68.5%

Berkeley Function Calling Leaderboard V4 (BFCL-V4) evaluates LLMs on their ability to accurately call functions and APIs, including simple, multiple, parallel, and nested function calls across diverse programming scenarios.

AndroidWorld_SR #3/3 64.2%

AndroidWorld Success Rate (SR) benchmark - A dynamic benchmarking environment for autonomous agents operating on Android devices.

BrowseComp-zh #6/7 62.1%

A high-difficulty benchmark purpose-built to comprehensively evaluate LLM agents on the Chinese web, consisting of 289 multi-hop questions spanning 11 diverse domains including Film & TV, Technology, Medicine, and History.

WideSearch #9/13 61.1%

WideSearch is an agentic search benchmark that evaluates models' ability to perform broad, parallel search operations across multiple sources. It tests wide-coverage information retrieval and synthesis capabilities.

BrowseComp #40/54 61%

BrowseComp is a benchmark comprising 1,266 questions that challenge AI agents to persistently navigate the internet in search of hard-to-find, entangled information.

TIR-Bench #2/4 59.8%

A tool-calling and multimodal interaction benchmark for testing visual instruction following and execution reliability.

OSWorld-Verified #23/26 56.2%

OSWorld-Verified is a verified subset of OSWorld, a scalable real computer environment for multimodal agents supporting task setup, execution-based evaluation, and interactive learning across Ubuntu, Windows, and macOS.

Seal-0 #2/5 47.2%

Seal-0 is a benchmark for evaluating agentic search capabilities, testing models' ability to navigate and retrieve information using tools.

VITA-Bench #5/8 41.9%

VITA-Bench evaluates AI agents on real-world virtual task automation, measuring their ability to complete complex multi-step tasks in simulated environments.

DeepPlanning #7/7 22.6%

DeepPlanning evaluates LLMs on complex multi-step planning tasks requiring long-horizon reasoning, goal decomposition, and strategic decision-making.

📐 Math 13 items

MMLU-Redux #9/15 93.2%

An improved version of the MMLU benchmark featuring manually re-annotated questions to identify and correct errors in the original dataset. Provides more reliable evaluation metrics for language models by addressing dataset quality issues found in the original MMLU.

HMMT 2025 #8/11 92%

Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds.

HMMT25 #5/9 89.8%

Harvard-MIT Mathematics Tournament 2025 - A prestigious student-organized mathematics competition for high school students featuring two tournaments (November 2025 at MIT and February 2026 at Harvard) with individual tests, team rounds, and guts rounds.

MathVista-Mini #2/7 87.8%

MathVista-Mini is a smaller version of the MathVista benchmark that evaluates mathematical reasoning in visual contexts.

DynaMath #2/8 87.7%

A multimodal mathematics and reasoning benchmark focused on dynamic visual problem solving.

MMLU-Pro #13/39 86.1%

A more robust and challenging multi-task language understanding benchmark that extends MMLU by expanding multiple-choice options from 4 to 10, eliminating trivial questions, and focusing on reasoning-intensive tasks.

MathVision #11/20 86%

MATH-Vision is a dataset designed to measure multimodal mathematical reasoning capabilities.

MMMLU #15/20 85.9%

Multilingual Massive Multitask Language Understanding dataset released by OpenAI, featuring professionally translated MMLU test questions across 14 languages including Arabic, Bengali, German, Spanish, French, Hindi, Indonesian, Italian, Japanese, Korean, Portuguese, Swahili…

MMLU-ProX #6/13 82.2%

Extended version of MMLU-Pro providing additional challenging multiple-choice questions for evaluating language models across diverse academic and professional domains. Built on the foundation of the Massive Multitask Language Understanding benchmark framework.

PolyMATH #5/9 71.2%

Polymath is a challenging multi-modal mathematical reasoning benchmark designed to evaluate the general cognitive reasoning abilities of Multi-modal Large Language Models (MLLMs).

SuperGPQA #8/16 65.6%

SuperGPQA is a comprehensive benchmark that evaluates large language models across 285 graduate-level academic disciplines.

Humanity's Last Exam #23/69 48.5%

Humanity's Last Exam (HLE) is a multi-modal academic benchmark with 2,500 questions across mathematics, humanities, and natural sciences, designed to test LLM capabilities at the frontier of human knowledge with unambiguous, verifiable solutions.

CodeForces #7/8 0.8

A competitive programming benchmark using problems from the CodeForces platform. The benchmark evaluates code generation capabilities of LLMs on algorithmic problems with difficulty ratings ranging from 800 to 2400.

👁️ Multimodal 39 items

VLMsAreBlind #3/6 96.9%

A vision-language benchmark that probes blind spots and brittle reasoning in multimodal models.

V* #4/7 93.7%

A visual reasoning benchmark evaluating multimodal inference under challenging spatial and grounded tasks.

AI2D #3/7 92.9%

AI2D is a dataset of 4,903 illustrative diagrams from grade school natural sciences (such as food webs, human physiology, and life cycles) with over 15,000 multiple choice questions and answers.

MMBench-V1.1 #3/6 92.6%

Version 1.1 of MMBench, an improved bilingual benchmark for assessing multi-modal capabilities of vision-language models through multiple-choice questions in both English and Chinese, providing systematic evaluation across diverse vision-language tasks.

OCRBench #4/5 89.4%

OCRBench: Comprehensive evaluation benchmark for assessing Optical Character Recognition (OCR) capabilities in Large Multimodal Models across text recognition, scene text VQA, and document understanding tasks.

OmniDocBench 1.5 #9/16 88.9%

OmniDocBench 1.5 is a comprehensive benchmark for evaluating multimodal large language models on document understanding tasks, including OCR, document parsing, information extraction, and visual question answering across diverse document types.

VideoMME w sub. #4/8 87%

The first-ever comprehensive evaluation benchmark of Multi-modal LLMs in Video analysis. Features 900 videos (254 hours) with 2,700 question-answer pairs covering 6 primary visual domains and 30 subfields.

MLVU #6/7 85.9%

A comprehensive benchmark for multi-task long video understanding that evaluates multimodal large language models on videos ranging from 3 minutes to 2 hours across 9 distinct tasks including reasoning, captioning, recognition, and summarization.

RealWorldQA #11/13 83.7%

RealWorldQA is a benchmark designed to evaluate basic real-world spatial understanding capabilities of multimodal models.

VideoMME w/o sub. #2/4 82.8%

Video-MME is a comprehensive evaluation benchmark for multi-modal large language models in video analysis. It features 900 videos across 6 primary visual domains with 30 subfields, ranging from 11 seconds to 1 hour in duration, with 2,700 question-answer pairs.

MMMU #5/16 82.3%

MMMU (Massive Multi-discipline Multimodal Understanding) is a benchmark designed to evaluate multimodal models on college-level subject knowledge and deliberate reasoning.

VideoMMMU #10/14 82.3%

Video-MMMU evaluates Large Multimodal Models' ability to acquire knowledge from expert-level professional videos across six disciplines through three cognitive stages: perception, comprehension, and adaptation.

LingoQA #2/4 82%

A benchmark for multimodal spatial-language understanding and visual-linguistic question answering.

MMStar #5/8 81%

MMStar is an elite vision-indispensable multimodal benchmark comprising 1,500 challenge samples meticulously selected by humans to evaluate 6 core capabilities and 18 detailed axes.

CC-OCR #5/6 81%

A comprehensive OCR benchmark for evaluating Large Multimodal Models (LMMs) in literacy. Comprises four OCR-centric tracks: multi-scene text reading, multilingual text reading, document parsing, and key information extraction.

SlakeVQA #2/3 80%

A semantically-labeled knowledge-enhanced dataset for medical visual question answering. Contains 642 radiology images (CT scans, MRI scans, X-rays) covering five body parts and 14,028 bilingual English-Chinese question-answer pairs annotated by experienced physicians.

CharXiv-R #25/41 79.5%

CharXiv-R is the reasoning component of the CharXiv benchmark, focusing on complex reasoning questions that require synthesizing information across visual chart elements.

MMMU-Pro #30/44 75%

A more robust multi-discipline multimodal understanding benchmark that enhances MMMU through a three-step process: filtering text-only answerable questions, augmenting candidate options, and introducing vision-only input settings.

MVBench #5/7 74.6%

A comprehensive multi-modal video understanding benchmark covering 20 challenging video tasks that require temporal understanding beyond single-frame analysis.

LVBench #11/15 73.6%

LVBench is an extreme long video understanding benchmark designed to evaluate multimodal models on videos up to two hours in duration. It contains 6 major categories and 21 subcategories, with videos averaging five times longer than existing datasets.

MMVU #4/7 73.3%

MMVU (Multimodal Multi-disciplinary Video Understanding) is a benchmark for evaluating multimodal models on video understanding tasks across multiple disciplines, testing comprehension and reasoning capabilities on video content.

ScreenSpot Pro #7/10 70.3%

ScreenSpot-Pro is a novel GUI grounding benchmark designed to rigorously evaluate the grounding capabilities of multimodal large language models (MLLMs) in professional high-resolution computing environments.

Hallusion Bench #1/6 70%

A comprehensive benchmark designed to evaluate image-context reasoning in large visual-language models (LVLMs) by challenging models with 346 images and 1,129 carefully crafted questions to assess language hallucination and visual illusion.

PMC-VQA #2/3 62.4%

A medical visual question answering benchmark built on biomedical literature and medical figures.

MedXpertQA #2/6 62.4%

A comprehensive benchmark to evaluate expert-level medical knowledge and advanced reasoning, featuring 4,460 questions spanning 17 specialties and 11 body systems.

ERQA #11/13 60.5%

Embodied Reasoning Question Answering benchmark consisting of 400 multiple-choice visual questions across spatial reasoning, trajectory reasoning, action reasoning, state estimation, and multi-view reasoning for evaluating AI capabilities in physical world interactions.

BabyVision #12/15 44.6%

A benchmark for early-stage visual reasoning and perception on child-like vision tasks.

ODinW #7/7 41.1%

Object Detection in the Wild (ODinW) benchmark for evaluating object detection models' task-level transfer ability across diverse real-world datasets in terms of prediction accuracy and adaptation efficiency.

Nuscene #2/3 15.2%

A multimodal benchmark for scene understanding and reasoning over the nuScenes autonomous driving domain.

CountBench #2/7 1

CountBench evaluates object counting capabilities in visual understanding.

RefCOCO-avg #5/6 0.9

RefCOCO-avg measures object grounding accuracy averaged across RefCOCO, RefCOCO+, and RefCOCOg benchmarks.

EmbSpatialBench #2/6 0.8

EmbSpatialBench evaluates embodied spatial understanding and reasoning capabilities.

RefSpatialBench #4/7 0.7

RefSpatialBench evaluates spatial reference understanding and grounding.

MMLongBench-Doc #3/6 0.6

MMLongBench-Doc evaluates long document understanding capabilities in vision-language models.

SimpleVQA #13/13 0.6

SimpleVQA is a visual question answering benchmark focused on simple queries.

ZEROBench-Sub #1/5 0.4

ZEROBench-Sub is a subset of the ZEROBench benchmark.

SUNRGBD #2/3 0.4

SUNRGBD evaluates RGB-D scene understanding and 3D grounding capabilities.

Hypersim #2/3 0.1

Hypersim evaluates 3D grounding and depth understanding in synthetic indoor scenes.

ZEROBench #10/13 0.1

ZEROBench is a challenging vision benchmark designed to test models on zero-shot visual understanding tasks.

Source: ZeroEval / llm-stats.com (✓ = third-party verified, others vendor-reported).

⚡ Qwen3.5-27B Interactive VRAM & Token Speed Calculator

Concurrency (Batch):
Dense 27B·64L (d=5120)·24Q/4KV·Ctx 256K·Text+Image+Video
Runnable Models →
GPUs
32 GB VRAM·1792 GB/s·Safe Usable 31.4 GB
Smooth Fit19.33 / 31.4 GB~75.7 tok/s
3. Weight Quantization
4. Per-Request Context16K (16,384 tok)
Verified: 2026-11-20·Roofline bandwidth/compute estimate (Batch=1)
Smooth Fit
19.33/ 31.4 GB usable

Physical 32 GB · Load 61.7%

Theoretical Decode Speed
~75.7tokens/s

Actual speed varies ~±25% by runtime

Max Context at Batch=1
195K/ 256K

Enable Q8/Q4 KV quantization to scale batch concurrency

Weights: 16.37 GBKV Cache (1×16K): 1.34 GBOverhead: 1.63 GB
🚀 Blazing Fast (Instant CoT)~6.6s for a 500-token response
Reference Launch CLI:
OLLAMA_CONTEXT_LENGTH=16384 ollama run qwen3.5:27b

RTX 5090 Fits Qwen3.5-27B · Cost & TCO

Approx. $2,199 (~$69/GB VRAM) · 575W TDP

📊 Qwen3.5-27B Quantization VRAM Breakdown (16K Context)

Quantization Bits/Weight Weights KV Cache (16K) Total VRAM Quality Note
FP16 / BF16 16 bpw 54 GB 1.34 GB 57.72 GB Lossless Full Precision
FP8 / Q8_0 8.5 bpw 28.69 GB 1.34 GB 31.9 GB 99.9% Near-Lossless
GGUF Q6_K 6.56 bpw 22.14 GB 1.34 GB 25.22 GB Ultra High Quality
GGUF Q5_K_M 5.69 bpw 19.2 GB 1.34 GB 22.23 GB High Balanced Quality
Q4_K_M / AWQ 4.85 bpw 16.37 GB 1.34 GB 19.33 GB Sweet Spot (Recommended)
GGUF IQ4_XS 4.25 bpw 14.34 GB 1.34 GB 17.27 GB Compact 4-bit
GGUF Q3_K_M 3.91 bpw 13.2 GB 1.34 GB 16.1 GB Moderate Perplexity Loss
GGUF Q2_K 3.15 bpw 10.63 GB 1.34 GB 13.48 GB Extreme Compression

🖥️ GPU & Apple Silicon Compatibility for Qwen3.5-27B (Q4_K_M)

Frequently Asked Questions

What are the exact architecture parameters of Qwen3.5-27B?

Qwen3.5-27B uses Qwen3_5ForConditionalGeneration with 64 layers (64 Hybrid Layers: 16 × [3 × Gated DeltaNet Linear + 1 × Gated Full Attention]), hidden_size=5120, 24 Q heads / 4 KV heads (head_dim=256), and vocab_size=248,320.

How much VRAM does Qwen3.5-27B require?

At 4-bit quantization (Q4_K_M, 16K context), Qwen3.5-27B requires 19.33 GB VRAM. Full FP16 requires 57.72 GB.