ollama/convert
Daniel Hiltgen 56c735d871 runner: Remove CGO engines, use llama-server exclusively for GGML models
Remove the vendored GGML and llama.cpp backend, CGO runner, Go model
implementations, and sample.  llama-server (built from upstream llama.cpp via
FetchContent) is now the sole inference engine for GGUF-based models.
(Safetensor based models continue to run on the new MLX engine.)  This allows
us to more rapidly pick up new capabilities and fixes from llama.cpp as they
come out.

On windows this now requires recent AMD driver versions to support ROCm v7 as
llama.cpp currently does not support building against v6.
2026-04-20 08:44:02 -07:00
..
sentencepiece chore(all): replace instances of interface with any (#10067) 2025-04-02 09:44:27 -07:00
testdata convert: import support for command-r models from safetensors (#6063) 2025-01-15 16:31:22 -08:00
convert_bert.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_commandr.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_deepseek2.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_deepseekocr.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_gemma2_adapter.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_gemma2.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_gemma3.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_gemma3n.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_gemma4_test.go Add support for gemma4 (#15214) 2026-04-02 11:33:33 -07:00
convert_gemma4.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_gemma.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_glm4moelite.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_glmocr.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_gptoss.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_lfm2_test.go model: improvements to LFM architectures (#14368) 2026-02-23 14:38:10 -08:00
convert_lfm2_vl_test.go model: improvements to LFM architectures (#14368) 2026-02-23 14:38:10 -08:00
convert_lfm2_vl.go model: improvements to LFM architectures (#14368) 2026-02-23 14:38:10 -08:00
convert_lfm2.go model: improvements to LFM architectures (#14368) 2026-02-23 14:38:10 -08:00
convert_llama4.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_llama_adapter.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_llama.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_mistral_causal.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_mistral.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_mixtral.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_mllama.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_nemotron_h_test.go models: add nemotronh architecture support (#14356) 2026-02-22 15:09:14 -08:00
convert_nemotron_h.go models: add nemotronh architecture support (#14356) 2026-02-22 15:09:14 -08:00
convert_nomicbert.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_olmo.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_phi3.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_qwen2.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_qwen3.go Add experimental MLX backend and engine with imagegen support (#13648) 2026-01-08 16:18:59 -08:00
convert_qwen3next_test.go model: support for qwen3.5 architecture (#14378) 2026-02-24 20:08:05 -08:00
convert_qwen3next.go model: support for qwen3.5 architecture (#14378) 2026-02-24 20:08:05 -08:00
convert_qwen3vl.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_qwen25vl.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
convert_test.go Add support for gemma4 (#15214) 2026-04-02 11:33:33 -07:00
convert.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
json_compat_test.go models: add nemotronh architecture support (#14356) 2026-02-22 15:09:14 -08:00
json_compat.go models: add nemotronh architecture support (#14356) 2026-02-22 15:09:14 -08:00
reader_safetensors.go Add support for gemma4 (#15214) 2026-04-02 11:33:33 -07:00
reader_test.go convert: convert bf16 vision weights to fp16 (#12324) 2025-09-17 17:43:17 -07:00
reader_torch.go llama4 2025-04-25 16:59:20 -07:00
reader.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00
sentencepiece_model.proto all: fix typos in documentation, code, and comments (#7021) 2024-12-10 12:58:06 -08:00
tensor_test.go fix tensor merge (#13053) 2025-11-13 15:32:34 -08:00
tensor.go fix tensor merge (#13053) 2025-11-13 15:32:34 -08:00
tokenizer_spm.go parsers/renderers: functiongemma (#13521) 2025-12-18 07:55:37 -08:00
tokenizer_test.go model: support for qwen3.5 architecture (#14378) 2026-02-24 20:08:05 -08:00
tokenizer.go runner: Remove CGO engines, use llama-server exclusively for GGML models 2026-04-20 08:44:02 -07:00