LocalAI v2.29.0. Source highlight: I am thrilled to announce the release of LocalAI v2.29.0! This update focuses heavily on refining our container image strategy, making default images leaner and providing clearer options for users needing specific features or hardware acceleration. We've also added support for new models like Qwen3,
vLLM v0.8.5. Source highlight: This release features important multi-modal bug fixes, day 0 support for Qwen3, and xgrammar's structure tag feature for tool calling.
Ollama v0.6.7. Source highlight: Qwen 3: Qwen3 is the latest generation of large language models in Qwen series, offering a comprehensive suite of dense and mixture-of-experts (MoE) models.
Ollama v0.6.6. Source highlight: IBM Granite 3.3: 2B and 8B models with 128K context length that have been fine-tuned for improved reasoning and instruction-following capabilities.
Hugging Face Transformers v4.51.3. Source highlight: A mix of bugs were fixed in this patch; very exceptionally, we diverge from semantic versioning to merge GLM-4 in this patch release.
vLLM v0.8.4. Source highlight: This release includes important accuracy fixes for Llama4 models, if you are using it, we highly recommend you to update.
vLLM v0.8.3. Source highlight: We are excited to announce Day 0 Support for Llama 4 Scout and Maverick (#16104). Please see our blog for detailed user guide.
Hugging Face Transformers v4.51.0. Source highlight: Llama 4, developed by Meta, introduces a new auto-regressive Mixture-of-Experts (MoE) architecture.This generation includes two models:
Ollama v0.6.3. Source highlight: New sliding window attention optimizations for Gemma 3, improving inference speed and memory allocation for long context windows.
vLLM v0.8.0. Source highlight: We have now enabled V1 engine by default (#13726) for supported use cases. Please refer to V1 user guide for more detail. We expect better performance for supported scenarios. If you'd like to disable V1 mode, please specify the environment variable `VLLM_USE_V1=0`, and send us a GitHub issue sharin