catalog: add Recursive Flint (MLX INT4 and GGUF UD-Q4_K_XL)

Merged
SI
6d ago
+146-17

Adds Recursive Flint, a 40B-total / 2.5B-active MoE coding model (Apache-2.0), as two catalog rows that share the flint merge key.

IdBackendArtifactSize
mlx-flint-int4MLXRecursiveSI/flint-int4 (11 files)22.6 GB
flint-ud-q4_k_xlllama.cppunsloth/flint-GGUF UD-Q4_K_XL25.1 GB

Both are mirrored into runanywhere/decision-models-stable-fork (mlx/flint-int4/ and gguf/flint/). Every URL is pinned to its upload commit, and every weight file carries its SHA-256. The MLX checksums come from the checkpoint's own flint-int4.json, and I checked them against the uploaded files.

The golden outputs for models list --all (plain and --json) each gain the one merged flint row and change nothing else.

MLX needs mlx-swift-lm 3.31.13, which is in runanywhere-sdks#1150. Built against that branch through WALLY_SDK_SWIFT_PATH, wally models show mlx-flint-int4 resolves all 11 files. I haven't run a generation through wally yet, so the MLX row is untested end to end. The GGUF row lists and downloads, but it can't load until the C++ kit's llama.cpp supports Flint's architecture. The new kit pins will land in this PR once that kit is released, so don't merge before then.

ctest passes (6/6, including the golden corpus) and cargo fmt --check is clean.


Summary by cubic

Adds Recursive Flint, a 40B-total / 2.5B-active MoE coding model (Apache-2.0), as two catalog rows sharing the flint merge key: MLX INT4 and GGUF UD-Q4_K_XL. Bumps the cpp-desktop kit to 0.20.42, which adds llama.cpp Flint support so the GGUF row can now load, and regenerates sys bindings and version goldens.

The MLX row is untested end to end; no generation was run through wally.

Summary by CodeRabbit

  • New Features

    • Added the Recursive Flint 40B-A2.5B INT4 language model to the catalog.
    • Added MLX and GGUF model formats with download metadata, checksums, and a 262,144-token context window.
    • The model is available through the MLX/llama.cpp backend and is initially marked as not downloaded.
  • Chores

    • Updated desktop kit and macOS release references to version 0.20.42.