UkisAI Swift 1.5 — blue and periwinkle diamond mosaic

Swift 1.5 Qwen3.8-27B

Swift 1.5 Qwen3.8-27B is UkisAI's reasoning-efficient derivative of Qwen3.8-27B. It uses 58.5% fewer thinking tokens while scoring 0.35% higher than the base, for a 9.18× speed-up on several tasks.

Demo

We gave the base Qwen3.8-27B and Swift 1.5 27B the same prompt: create a little 3D planet globe a boy scout can walk around while camping, with biomes to explore, small enough to be fun to go around.

The base model took 104.6 minutes to build its game. Swift 1.5 took 11.39 minutes. Play both games here.

Training approach

Starting from Swift 1.0, we scaled up reinforcement learning (RL) and on-policy distillation (OPD) to recover and improve performance, with a focus on long-horizon agent work and coding tasks.

Swift 1.5 keeps the Swift 1.0 recipe, which penalizes the reasoning markers that trigger overthinking, and uses the standard Qwen3.8 interface with text, image, and video support.

Benchmark results

The results below compare Qwen3.8-27B, the foundation base model, Swift 1.0, the first UkisAI adaptation, and Swift 1.5. All three use the same saved evaluation protocols, and every score is a final five-repeat aggregate. Mean-token columns report reasoning tokens per trial; Terminal-Bench sums reasoning across agent calls.

Qwen3.8-27B, Swift 1.0 and Swift 1.5 · five runs per model · BF16
BenchmarkFinal scoreMean tokens
Qwen3.8Swift 1.5Swift 1.0Qwen3.8Swift 1.5Swift 1.0
General reasoning
GPQA-Diamond88.28%88.59%88.28%15,0148,7178,856
C-Eval90.00%90.92%90.62%1,492819804
IFBench73.53%72.07%71.80%8,0524,9554,657
ERQA67.45%65.40%66.30%4,1371,9062,045
Mathematics
AIME 202698.67%96.00%94.00%22,01413,20316,143
HMMT November 202599.33%97.33%96.00%22,03214,95715,189
Coding
LiveCodeBench v676.76%81.71%81.55%11,1848,4488,391
Agent tasks
Terminal-Bench 2.1*69.21%72.13%52,26543,733

* Note: Terminal Bench 2.1 score of Swift 1.5 is misleading at first glance. It falls in the -38.7% token usage range. Swift has fewer overthinking errors leading to early task failures, leading to longer pursuit of task and higher scores, albeit increasing token usage averages.

Swift 1.5 scores above Swift 1.0 on six of the seven benchmarks reported for both, and above the base model on GPQA-Diamond, C-Eval, LiveCodeBench, and Terminal-Bench 2.1, where it solves 72.13% of tasks against the base model's 69.21%.

Swift 1.5 thinking-token change compared with Qwen3.8-27B
BenchmarkThinking-token change
MeanMedian
General reasoning
GPQA-Diamond↓ 41.9%↓ 58.5%
C-Eval↓ 45.1%↓ 16.9%
IFBench↓ 38.5%↓ 47.3%
ERQA↓ 53.9%↓ 56.2%
Mathematics
AIME 2026↓ 40.0%↓ 48.5%
HMMT November 2025↓ 32.1%↓ 47.8%
Coding
LiveCodeBench v6↓ 24.5%↓ 46.3%
Agent tasks
Terminal-Bench 2.1↓ 16.3%↓ 0.1%

Swift 1.5 uses 25–54% fewer thinking tokens than the base model on every question benchmark, with the largest savings on ERQA and C-Eval and the smallest on LiveCodeBench. On Terminal-Bench 2.1 it uses 16.3% fewer reasoning tokens on average, with the median almost unchanged.

Benchmark methodology and reproduction settings

Serving configuration

BF16 · vLLM 0.27.1 · Qwen3 reasoning parser · context 262,144. Thinking is enabled at xhigh. Sampling: temperature=1.0, top_p=0.95, top_k=20, min_p=0, presence_penalty=0, repetition_penalty=1.

Benchmark configurations

Averages over five seeds (0–4) per model. Terminal-Bench uses five trials per task, with the base model and Swift 1.5 served at context 131,072 on the same Harbor build; Swift 1.0 was not evaluated on it.

BenchmarkOutput cap
GPQA-Diamond100,000
C-Eval16,384
IFBench81,920
ERQA100,000
AIME 2026250,000
HMMT November 2025250,000
LiveCodeBench v632,768
Terminal-Bench 2.1Agent/task limits

Mean reduction is computed from the base and Swift 1.5 token means; median reduction compares their median token counts.

Reasoning effort

Qwen3.8's reasoning_effort setting lets users choose how much the model thinks. For Swift 1.5 to be useful across these settings, it needs to reduce thinking while keeping accuracy close to the base, so we tested xhigh, medium, and low. Thinking-token savings persist at every level; at low, Swift 1.5 scores above the base while using about 29% fewer thinking tokens.

GPQA-Diamond at each reasoning effort · five runs per model
Reasoning effortQwen3.8Swift 1.5Mean thinking reduction
Xhigh88.28%88.59%↓ 41.9%
Medium84.14%82.22%↓ 24.8%
Low84.04%84.85%↓ 28.7%

Quantized models

Available Swift 1.5 27B formats are grouped below. The benchmark table after this list covers only the three INT4 exports evaluated under the stated protocol; it does not report results for the other formats.

These results evaluate the merged Swift 1.5 checkpoint and three INT4 exports on GPQA-Diamond (198 questions), IFBench (300 prompts), and AIME 2026 (30 problems). Each model completed the full datasets with one sample per prompt, seed 0, and zero request errors. This is a single-seed evaluation, separate from the five-repeat BF16 results above.

INT4 exports of Swift 1.5 against saved Qwen references · one sample per prompt, seed 0
Benchmark / quantizationQwen base accuracySwift 1.5 accuracyMean token reductionMedian token reduction
GPQA-DiamondAWQ INT486.36%88.38%↓ 51.5%↓ 64.4%
GPQA-DiamondAutoRound INT486.36%89.39%↓ 50.5%↓ 57.8%
GPQA-DiamondAWQ + GPTQ INT486.36%90.91%↓ 45.8%↓ 64.4%
IFBenchAWQ INT472.00%72.00%↓ 36.9%↓ 49.3%
IFBenchAutoRound INT472.00%69.33%↓ 29.3%↓ 39.2%
IFBenchAWQ + GPTQ INT472.00%70.00%↓ 31.8%↓ 52.7%
AIME 2026AWQ INT470.00%86.67%↓ 29.2%↓ 36.2%
AIME 2026AutoRound INT476.67%83.33%↓ 17.7%↓ 32.4%
AIME 2026AWQ + GPTQ INT476.67%83.33%↓ 22.4%↓ 34.0%

The Qwen base columns use saved seed-0 runs. Quantization recipes and serving settings differ from the new Swift 1.5 runs, so these are reference comparisons rather than a controlled measurement of the Swift adaptation; the token reductions are recomputed from those same reference samples. For AIME, truncated responses count as incorrect in both columns. The AMD Quark INT4 and FP8 exports have separate sanity evaluations; completed results on these three benchmarks are not available for them.

Quantized evaluation settings and BF16 reference

Serving: vLLM 0.29.0, tensor parallelism 1, eager execution, BF16 activations, context 131,072, template-default thinking without an effort override. The AWQ + GPTQ export uses an FP8 KV cache; BF16, AWQ, and AutoRound use the automatic KV dtype.

Sampling: temperature 1, top-p 0.95, top-k 20, min-p 0, presence penalty 0, repetition penalty 1, seed 0. Output caps: GPQA 100,000, IFBench 81,920, AIME 32,768. IFBench uses official strict prompt-level scoring.

GPQA token counts cover re-tokenized reasoning; IFBench and AIME count the full generated response. Statistics include all responses, including truncations; medians use the midpoint of the two central values when the sample count is even.

Saved Qwen references: W4A16 for GPQA and IFBench; Qwen AWQ for the AWQ AIME row; Qwen W4A16 for the AutoRound and AWQ + GPTQ AIME rows, so the latter is a W4A16 reference for AutoRound, not an AutoRound base run. The new runs do not reproduce the original software stack.

Swift 1.5 BF16 and its INT4 exports under the single-seed protocol
ModelGPQA-DiamondIFBench strictAIME 2026
Swift 1.5 BF1691.41%72.00%86.67%
AWQ INT488.38%72.00%86.67%
AutoRound INT489.39%69.33%83.33%
AWQ + GPTQ INT490.91%70.00%83.33%

These single-seed results do not establish quality parity or replace the broader multi-seed evaluation. Verified counts, token statistics, settings, and evidence hashes are in the model card.

Run Swift 1.5

Swift 1.5 is served through an OpenAI-compatible API at ukisai.com/api/swift/v1, free for research and without an API key; the model id is swift. To run it yourself, serve the full model with vLLM or SGLang, using a build that supports Qwen3.8, and adjust tensor parallelism and context length to your GPU memory.

vLLM configuration
vllm serve ukisai/Swift-1.5-Qwen3.8-27b \
  --dtype bfloat16 \
  --tensor-parallel-size 1 \
  --max-model-len 262144 \
  --reasoning-parser qwen3 \
  --enable-auto-tool-choice \
  --tool-call-parser qwen3_coder \
  --port 8000
SGLang configuration
python -m sglang.launch_server \
  --model-path ukisai/Swift-1.5-Qwen3.8-27b \
  --dtype bfloat16 \
  --tp-size 1 \
  --context-length 262144 \
  --reasoning-parser qwen3 \
  --tool-call-parser qwen3_coder \
  --port 8000
UkisAI API
curl https://ukisai.com/api/swift/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"model": "swift", "messages": [{"role": "user", "content": "Hello, Swift."}]}'
Optional MTP decoding
# vLLM
--speculative-config '{"method":"mtp","num_speculative_tokens":3}'

# SGLang
--speculative-algorithm EAGLE --speculative-num-steps 3 \
  --speculative-eagle-topk 1 --speculative-num-draft-tokens 4

For hardware-specific options, see the vLLM recipe or SGLang recipe. The published weights include the base model's MTP head for self-speculative decoding; the model card has the full instructions.

License

Swift 1.5 is a derivative of Qwen3.8-27B (Apache License 2.0). UkisAI's contribution, including the adapted weights, is licensed under the Swift Open License v1.0. Personal, research, educational, evaluation, and commercial use are free for individuals and organizations with gross annual revenue, including affiliates, of up to US$1 million. Above that threshold, commercial use requires a separate Swift Enterprise License. Nothing in the Swift Open License limits rights in Qwen3.8-27B itself under Apache 2.0.

Contact us for enterprise licensing.

Acknowledgements

We acknowledge the NVIDIA Innovation Lab, Amazon Web Services, and Google Cloud for providing compute credits and infrastructure support for Swift's development, training, and evaluation.