WizardLM-2 8x22B
ActiveWizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...
Overview
WizardLM-2 8x22B is Microsoft AI's most advanced Wizard model. It demonstrates highly competitive performance compared to leading proprietary models, and it consistently outperforms all existing state-of-the-art opensource models. It is...
History
WizardLM-2 8x22B became available via the Microsoft API on 2024-04-16.
Training & availability
Training data has a knowledge cutoff of 2024-04-30 — information about events after that date is unlikely to appear in the model's responses. Microsoft has not released the underlying model weights — access is via their hosted API only.
Capabilities
-
Context window: 65K tokens.
-
Input modalities: text.
Recommended for: cheap.
Limitations
-
The knowledge cutoff is 23 months old — this model will not know about recent events, releases, or API changes.
-
The context window (65K tokens) is modest by 2026 standards — unsuitable for processing long documents in a single request.
-
Text-only — cannot process images, audio, or video inputs.
Pricing
- Input: $0.6200 per 1M tokens
- Output: $0.6200 per 1M tokens
Use the cost calculator above to estimate monthly spend for your workload.
Quick start
Minimal example using the OpenRouter API. Copy, paste, replace the key.
from openai import OpenAI
client = OpenAI(
base_url="https://openrouter.ai/api/v1",
api_key="sk-or-...",
)
resp = client.chat.completions.create(
model="microsoft/wizardlm-2-8x22b",
messages=[{"role": "user", "content": "Explain quantum computing in one sentence."}],
)
print(resp.choices[0].message.content)Cost calculator
Estimate your monthly bill. Presets are typical workload sizes.
Providers & performance
1 providerMulti-provider inference routes for this model — sorted by throughput. Latency is time-to-first-token; throughput is output tokens per second. Data from OpenRouter, measured over the last 30 minutes.
| Provider | Throughput | Latency (TTFT) | Input $ / 1M | Output $ / 1M | Context | Quant | Supports |
|---|---|---|---|---|---|---|---|
| Novita | 10tok/s | 965ms | $0.62 | $0.62 | 66K | bf16 | — |
Integrations & tooling support
- Tool calling
- Not supported
- Structured outputs
- Not supported
Price vs quality
Priced low — good for high-volume tasks. Quality tier pending more benchmark coverage.
- Quality percentile
- —
- Effective price
- $0.62/1M
- Pricing breakdown
- $0.62/1M in
$0.62/1M out
Community ratings
Rate WizardLM-2 8x22B
Sign in to rate and review.
Comments
Sign in to leave a comment.