mirror of
https://github.com/ollama/ollama.git
synced 2026-05-13 14:27:00 +00:00
03aee88186
* mlx: Support NVIDIA TensorRT Model Optimizer import * x/create: support FP8 safetensors import Decode HF F8_E4M3 safetensors with block scale companions into MLX-importable tensor blobs, including compressed-tensors weight_scale metadata, packed NVFP4 layouts, and mixed-precision tensor headers. Use that source-precision metadata during create quantization: default FP8-sourced imports to mxfp8, allow source FP8 to target MLX low-bit formats, preserve source-quantized NVFP4 layouts, selectively keep or promote tensors based on their source precision, and detect quantized dtype from mixed-precision safetensors manifests. * review comments |
||
|---|---|---|
| .. | ||
| client | ||
| create.go | ||
| create_test.go | ||
| dtype.go | ||
| gemma4.go | ||
| gemma4_test.go | ||
| imagegen.go | ||
| qwen35.go | ||