Flint Is Fast, But Qwen 3.8 27B Still Wears the Local Crown

Qwen Vs Flint
https://inferencecafe.com/

In this article, we examine how the newly released open-weight model Flint compares with the leading local models in the 27B–35B range — and whether Qwen 3.8 27B is still the king, or if Flint has taken the crown.

The two models are chasing different crowns

Qwen3.8-27B is a dense 27B-class model from Alibaba. It is a native vision-language model with configurable thinking, a 262K-token native context window, and YaRN scaling toward 1M tokens. It is built to be a general local powerhouse: coding, documents, images, video, research, and agentic work. Its Q4_K_M build is about 17 GB, with 32 GB of RAM as the comfortable tier. On Apple Silicon, hands-on testing has put it around 14 tok/s in stock local runtimes, though speculative-decoding setups can roughly double that. (, , )

Recursive Flint is a 39.8B-total-parameter mixture-of-experts model with only about 2.5B active parameters per token. It is text-only, coding-agent focused, Apache 2.0, and built to feel fast on local hardware. Recursive claims more than 125 tok/s on an M4 Pro MacBook Pro and more than 150 tok/s on a 64GB NVIDIA RTX Spark; community stock llama.cpp runs measured about 79.6 tok/s on an M4 Pro and 92.4 tok/s on an M5 Pro, while Recursive’s rec engine reached 126.6 tok/s and 144.9 tok/s on those same classes of machines. (, , )

 
SpecificationQwen3.8-27BRecursive Flint
ArchitectureDense 27B-class, hybrid attentionMoE, 39.8B total / ~2.5B active
ModalityText, images, videoText only
FocusGeneral local AI + coding agentsFast local coding agents
Context262K native, up to 1M with YaRN262K documented
LicenseApache 2.0Apache 2.0
Practical RAMQ4 around 17 GB; 32 GB recommended4-bit around 23 GB; 32 GB modest, 48 GB for rec/full context
Speed on Apple Silicon~14 tok/s stock; ~28–34 tok/s with speculative decoding~80–92 tok/s stock; ~127–145 tok/s with rec

Benchmarks: Qwen still wins the heavy ones

The important caveat first: most numbers here are vendor-reported. Qwen’s card is Alibaba’s own table; Flint’s card is Recursive’s own table. Qwen does have more third-party validation — VentureBeat reported an Artificial Analysis Intelligence Index of 52 and Agentic Index of 51 at launch — while Flint is still too new for a comparable independent benchmark suite. (, )

Using Recursive’s own six-test comparison, the pattern is clear: Flint wins the instruction-following tests, but Qwen wins the heavier coding tests. † marks scores measured by Recursive rather than the model developer.

BenchmarkFlint BF16Qwen3.8-27BWinner
SWE-bench Verified74.275.6†Qwen
Terminal-Bench 2.154.973.0Qwen
LiveCodeBench v680.390.3Qwen
IFBench89.279.5Flint
IFEval95.194.6†Flint
SWE-bench Pro v2†89.794.9Qwen, with caution

Source: and .

The SWE-bench Pro v2 row needs an asterisk: it is Recursive’s own measurement on its own harness, not the public SWE-bench Pro leaderboard. Qwen’s official public SWE-bench Pro score is 61.7, and Recursive does not publish a directly comparable public SWE-bench Pro score for Flint. So the safest reading is: Qwen leads on Terminal-Bench, LiveCodeBench, and SWE-bench Verified; Flint leads on IFBench/IFEval; the internal Pro v2 row should not be used to declare a winner. (, )

That is why the honest verdict is not “Flint killed Qwen.” It is: Flint beat the small MoE field, but Qwen 3.8 27B still beats Flint on the hardest shared coding tests. TechCrunch’s summary matches that: on Recursive’s own six-test average, only Qwen3.8 27B scored higher than Flint. ()

Speed is where Flint changes the conversation

Per token, Flint is dramatically faster. A dense 27B model reads most of its weights for every token; Flint reads only a small slice. That is the entire point of the MoE design.

On a 48GB-class Apple Silicon machine, Qwen3.8-27B is commonly around 14 tok/s in stock local runtimes. Flint is around 80–92 tok/s in stock llama.cpp, and 127–145 tok/s with Recursive’s rec engine. That is roughly 6–10× faster per token, depending on which engine you count. For an agent that makes dozens of tool calls, that difference is not cosmetic. It can turn a five-minute loop into a one-minute loop. (, , )

But speed comes with trade-offs. Flint’s weakest benchmark is Terminal-Bench, where the model has to operate a real terminal. Recursive also says Flint may need more guidance than larger closed coding models, and LLMCheck notes tool-call markup issues in some MLX runs. Qwen3.8-27B is slower per token, but it is more rounded: stronger terminal/agentic scores, stronger LiveCodeBench, stronger vision/document abilities, and broader validation. (, )

For home users

If you have 24–32 GB of RAM, Qwen3.8-27B is still the easier recommendation. The Q4 build is around 17 GB, it runs in Ollama/LM Studio/llama.cpp, and it can do coding, general chat, images, documents, and research. It is not fast, but it is capable. On 16 GB, you can squeeze Qwen down to 2-bit or 1-bit, but I would not use those quants for agentic coding; Unsloth’s own guidance is blunt that very low-bit builds are not for tool calling. ()

If you have 48 GB or more, Flint becomes very interesting. It is the better “fast private coding agent” candidate: quick enough to iterate, private enough for local repos, and open under Apache 2.0. I would still keep Qwen installed for harder terminal work, multimodal tasks, and anything where the cost of a wrong answer is high.

For business local AI users

For business use, Qwen3.8-27B remains the safer default. It has the stronger public coding profile, multimodal support for documents and screenshots, a larger validation footprint, and more predictable behavior across general knowledge, coding, and agentic tasks. If your workload includes document understanding, image/video input, compliance-sensitive local inference, or higher-stakes code changes, Qwen is the better primary model.

Flint is a strong secondary engine for routine coding loops: test generation, refactors, small bug fixes, repository exploration, and fast drafting where a human reviews the diff. I would not make it the only production coding model yet. Run both on your own repositories, measure pass rate and wall-clock time, and pay special attention to tool-call reliability.

Bottom line

No, Flint did not dethrone Qwen 3.8 27B. It took the speed and efficiency crown, and it is now the most interesting sub-50B MoE coding model for local agents. But Qwen3.8-27B is still the overall king in this size class because it wins the heavier shared coding benchmarks, supports vision, has broader validation, and is more useful as a general local model.

The practical answer is not “pick one forever.” It is: Qwen for capability, Flint for velocity.

And because both models are open-weight, any machine that can run one can usually run the other. That makes it a win-win for users: install both, and reach for Flint when speed matters or Qwen when capability and accuracy matter for the problem at hand.

References