Step-3.7-Flash-OptiQ-3.7bpw-mlx

lemuralabs/Step-3.7-Flash-OptiQ-3.7bpw-mlx is an Apple-Silicon MLX affine mixed-precision OptiQ tensor-format quantization of stepfun-ai/Step-3.7-Flash.

No fine-tuning, distillation, or retraining was applied. The upstream StepFun checkpoint was downloaded and verified locally. OptiQ stream/Frobenius sensitivity was used to allocate mixed bit widths at a 3.7 BPW target, then eligible text and vision .weight tensors were converted with MLX affine quantization. Tokenizer, chat template, custom Step3.7 Python modules, and non-quantized control tensors are preserved from the source release.

Public Lemura Labs Step-3.7-Flash Variants

Compatibility Status

This upload is a standard MLX affine safetensors bundle, but it is not yet a drop-in mlx_lm.load(...) or mlx_vlm.load(...) model.

At conversion time, vanilla mlx-lm 0.31.3 and mlx-vlm 0.5.0 did not register model_type: step3p7. This repository is therefore intended for MLX runtime authors, loader implementers, and researchers who want a verified Step-3.7-Flash OptiQ tensor bundle. Native inference will require Step3p7 model-class support in MLX/MLX-LM/MLX-VLM or a compatible custom loader.

Model Details

Quantization Recipe

OptiQ allocation summary:

The achieved BPW is the OptiQ allocation target over quantized weights. The on-disk bundle also includes MLX affine scale/bias tensors, passthrough tensors, tokenizer/config/custom code, and index metadata.

Files

• model-00001.safetensors to model-00024.safetensors: text/model shards in MLX affine mixed-precision tensor format.
• model-vit-00001.safetensors and model-vit-00002.safetensors: vision encoder shards in MLX affine mixed-precision tensor format.
• model.safetensors.index.json: rewritten safetensors index for quantized triplet tensors.
• optiq_allocation.json: OptiQ per-layer bit allocation.
• mlx_quantization_manifest.json: conversion manifest with quantized/passthrough tensor counts and tensor-level metadata.
• config.json: upstream config with added MLX OptiQ quantization metadata.
• configuration_step3p7.py, modeling_step3p7.py, processing_step3.py, vision_encoder.py: upstream custom Step3.7 code.
• tokenizer.json, tokenizer_config.json, special_tokens_map.json, chat_template.jinja: upstream tokenizer and prompt assets.

Tensor Inspection

Until Step3p7 support lands in an MLX runtime, use MLX tensor loading for inspection or custom loader development:

import mlx.core as mx

tensors = mx.load("model-00002.safetensors")
prefix = "model.layers.3.moe.down_proj"

print(tensors[prefix + ".weight"].shape, tensors[prefix + ".weight"].dtype)
print(tensors[prefix + ".scales"].shape, tensors[prefix + ".scales"].dtype)
print(tensors[prefix + ".biases"].shape, tensors[prefix + ".biases"].dtype)

Representative local validation for that 3-bit tensor returned:

Limitations

• This is a tensor-format MLX affine mixed-precision conversion, not a complete native Step3p7 MLX inference implementation.
• Current vanilla mlx-lm and mlx-vlm releases need Step3p7 architecture support before this can be used as a normal one-line load/generate model.
• The OptiQ allocation has not been benchmarked for downstream quality after conversion.
• Multimodal prompt plumbing depends on future Step3p7 loader/runtime support.
• Behavior, benchmark scores, and deployment claims come from the upstream StepFun release; this quantization has not been independently re-benchmarked.

Credits

Thank you to both sides of this release:

License: Apache-2.0, following the upstream StepFun release.