Computalis

The Engineering Behind AI

Computalis explains the AI models, coding agents, developer tools, and infrastructure changing how software is built; with evidence-led breakdowns, comparisons, and practical analysis. www.computalis.cc

Épisodes

  1. -2 j

    Ox Alpha: Frontier Coding Model or Anonymous Free Preview?

    Ox Alpha landed on OpenRouter on August 20, 2026 with almost the perfect recipe for developer attention: free access, a million-token context window, explicit positioning for coding and long-horizon agent work, and no public developer behind it. That combination is naturally compelling. Free models spread quickly. Million-token context invites ambitious repository-scale use cases. Anonymous launches create curiosity. But mystery also removes the usual anchors developers rely on when deciding whether a model belongs anywhere near a production workflow. With Ox Alpha, the interesting question is not simply whether it is “good.” It is whether the evidence supports the much stronger claims developers are already tempted to make about it. So it helps to separate four things: what OpenRouter actually verifies, what the published benchmarks really measured, what public forensic work can tell us about the model’s origin, and what happens to the code you send through the endpoint. What we actually know from OpenRouter OpenRouter describes Ox Alpha as a reasoning model built for coding, sustained agentic work, and production workloads. Its configured limits are impressive: 1,048,576 context tokens and up to 131,072 completion tokens. It accepts text, images, and video, returns text, and supports tool calling and structured JSON output. Those numbers matter. They tell us what the endpoint is configured to accept and expose. What they do not tell us is whether the model reasons reliably across a million-token repository, whether its coding ability is genuinely frontier-class, or who built the model underneath the endpoint. That last point matters more than it might seem. OpenRouter is the routing layer. According to the listing, the actual endpoint is developed and operated by an anonymous third party. So even before looking at benchmarks, Ox Alpha already presents an unusual trust structure: known router, unknown operator, unknown model provenance. That is not automatically disqualifying. But it raises the standard of evidence we should demand everywhere else. The first benchmark looked great — because it was tiny One of the earliest results circulating around Ox Alpha was an 8/10 score on DeepSWE. An 80% result sounds impressive until you attach the sample size. With only ten tasks, every individual task moves the score by ten percentage points. That makes the result useful as a smoke test, but almost useless as evidence for a serious frontier ranking. A later public run is much more informative. It completed all 113 DeepSWE tasks using pier 0.3.1, stock mini-swe-agent behavior, Docker environments, a shared bash tool, and one attempt per task. Ox Alpha solved 66 of 113 tasks, for a reported resolve rate of 58.4% and a Wilson confidence interval of 49.2% to 67.1%. That headline still hides something important. On 90 of the 113 tasks, Ox Alpha reached at least 90% of the target tests. In other words, many failures were not catastrophic. The model often got surprisingly close. But 11 tasks reportedly died after repeated missing tool calls. That distinction is useful, but it should not be used to excuse the benchmark score. In an agentic coding task, tool use is part of the job. If the model repeatedly fails to invoke the required tool, that failure belongs in the result even if its underlying reasoning might have been stronger than the binary score suggests. That is exactly why agent benchmarks are valuable: they measure the whole system behavior, not merely whether the model can produce plausible-looking code. Raw coding performance makes the “frontier” label harder to defend DeepSWE evaluates an agentic workflow. To understand whether Ox Alpha is also unusually strong as a plain code generator, we need a different kind of measurement. One public LiveCodeBench release_v6 run removed the agent, tools, and scaffold entirely. The setup used greedy decoding, temperature zero, one answer per problem, and a twenty-second local test timeout. The result was 49 solved problems out of 175, or 28.0% pass@1. The difficulty split makes the pattern clearer: * Easy: 22/43 * Medium: 16/52 * Hard: 11/80 KernelBench adds another small signal: five clean correct results across ten canonical GPU-kernel cells, each using one unlimited agent session. None of these benchmarks are directly comparable. Different harnesses, environments, budgets, and evaluation methods matter enormously. But taken together, they make one conclusion difficult to avoid: Ox Alpha looks considerably more convincing inside some longer agent trajectories than it does as a raw code generator. That does not make the model bad. It simply makes “frontier coding model” a much stronger claim than the current evidence can support. The origin story is getting clearer — but it is not solved Anonymous models inevitably trigger fingerprinting attempts, and Ox Alpha has attracted several. The strongest public work so far focuses on structural properties rather than writing style. That is the right approach. Style can be altered by prompting, fine-tuning, system messages, and sampling. Tokenizers and protocol behavior are harder to disguise accidentally. In one reproducible comparison, Ox Alpha and a GLM-5.3 reference produced identical baseline-adjusted token deltas across 24 discriminating strings. The same study reports 8/8 matching protocol signatures against the GLM comparison, versus 3/8 for MiMo-V2.5. That is strong evidence of a shared or compatible tokenizer, chat-template, and protocol family. It is not proof that Ox Alpha is literally a specific GLM checkpoint. A related checkpoint, fine-tune, distillation, quantization, routing layer, or compatible serving stack could preserve much of the same observable surface. The safe conclusion is therefore narrower: Ox Alpha appears structurally very close to the tested GLM family, but the exact model and operator remain unconfirmed. There is also some evidence supporting the advertised context capacity. A separate public test reports 3/3 successful needle retrieval at 934,221 measured prompt tokens. That is useful because it demonstrates that the endpoint can retrieve information near the upper end of its advertised context range. But it proves capacity, not deep reasoning quality. Finding three needles inside a very large prompt is not the same thing as understanding a million-token software repository, tracking dependencies across it, and making correct architectural decisions. Those are very different claims. The real problem is not performance. It is proprietary code. For experimentation, Ox Alpha is interesting. For private repositories, the situation changes completely. OpenRouter says its own prompt logging is disabled by default. But OpenRouter is not the final destination of the request. The prompt is still sent to the upstream model provider. The Ox Alpha page says that provider retains prompts. OpenRouter’s provider information also identifies Stealth as a provider that retains prompts and may train on them, while another public summary on the model page indicates retained prompts are not used for training. That discrepancy alone should make a developer stop and read the governing terms rather than rely on a badge or summary table. The Stealth EULA is broader. It gives the provider rights over submitted user content for purposes including training, evaluation, and improvement, and requires the user to confirm that they possess every right, permission, consent, and authorization necessary to submit that material. The EULA also makes clear that access is temporary and can disappear with or without notice. Now combine the facts: * the operator is unknown; * prompts are retained upstream; * public summaries do not appear perfectly consistent; * the governing license is broad; * and the endpoint has no guaranteed continuity. For proprietary repositories, that is enough. The benchmark discussion almost becomes secondary. A free coding model can be excellent and still be an unacceptable place to send confidential source code. So, is Ox Alpha actually worth using? Yes — with the right boundary. Ox Alpha is clearly capable enough to deserve attention. The full DeepSWE run is much more interesting than the original ten-task result, its long-context behavior appears real at least at the retrieval level, and the structural fingerprinting work gives researchers something concrete to investigate. But the current public evidence does not establish that Ox Alpha is a frontier model across coding tasks. More importantly, the current trust and data situation makes it a poor dependency for proprietary work. The sensible use case today is experimentation: public benchmarks, open-source repositories, synthetic projects, disposable sandboxes, and tasks where the submitted data carries no confidentiality requirement. I would not send it proprietary source code, customer data, secrets, regulated information, or anything covered by contractual confidentiality. There are three things that would materially change that verdict: * Disclose the operator. * Make the data terms stable, explicit, and suitable for confidential code. * Show repeated controlled benchmark results across multiple harnesses and attempts. Until then, Ox Alpha is best treated as what the evidence currently supports: a capable, technically interesting, unusually opaque coding model — worth testing, but not yet worth trusting with your private repository. Sources * DeepSWE: Can Language Models Learn to Solve Real-World Software Engineering Tasks? * Ox Alpha DeepSWE Evaluation — Full 113-Task Run * Ox Alpha Independent Benchmarks — LiveCodeBench and Additional Tests * Ox Alpha KernelBench Results * Ox Alpha Black-Box Fingerprinting Study * Ox Alpha Public Identification and Long-Context Testing * OpenRouter — Ox Alpha Model Page * OpenRouter — Provider Directory and Data Policies * OpenRouter — Stealth Program End User License Agreement * Op

À propos

Computalis explains the AI models, coding agents, developer tools, and infrastructure changing how software is built; with evidence-led breakdowns, comparisons, and practical analysis. www.computalis.cc