LocalAI v3.3.0 — Release Notes & Engineering Impact

<h1 align="center"> <br> <img height="300" src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png"> <br> <br> 🚀 LocalAI 3.3.0 </h1> ## What’s New in LocalAI 3.3.0 🎉 - Object detection! From 3.3.0, now LocalAI supports with a new API - also fast object detection! Just install the `rfdetr-base` model - See [the documentation](https://localai.io/features/object-detection/) to learn more - Backends now have defined mirrors for download - this helps when primary registries fails during download - Bug fixes: worked hard into squashing bugfixes in this release! Ranging from container images to backends and installation scripts ## The Complete Local Stack for Privacy-First AI <table> <tr> <td width="30%" valign="top" align="center"> <a href="https://github.com/mudler/LocalAI"> <img src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png" width="200" alt="LocalAI Logo"> <h3>LocalAI</h3> </a> </td> <td width="70%" valign="top"> <p>The free, Open Source OpenAI alternative. Acts as a drop-in replacement REST API compatible with OpenAI specifications for local AI inferencing. No GPU required.</p> <p><em>Link:</em> <a href="https://github.com/mudler/LocalAI">https://github.com/mudler/LocalAI</a></p> </td> </tr> <tr> <td width="30%" valign="top" align="center"> <a href="https://github.com/mudler/LocalAGI"> <img src="https://raw.githubusercontent.com/mudler/LocalAGI/refs/heads/main/webui/react-ui/public/logo_2.png" width="200" alt="LocalAGI Logo"> <h3>LocalAGI</h3> </a> </td> <td width="70%" valign="top"> <p>A powerful Local AI agent management platform. Serves as a drop-in replacement for OpenAI's Responses API, supercharged with advanced agentic capabilities and a no-code UI.</p> <p><em>Link:</em> <a href="https://github.com/mudler/LocalAGI">https://github.com/mudler/LocalAGI</a></p> </td> </tr> <tr> <td width="30%" valign="top" align="center"> <a href="https://github.com/mudler/LocalRecall"> <img src="https://raw.githubusercontent.com/mudler/LocalRecall/refs/heads/main/static/localrecall_horizontal.png" width="200" alt="LocalRecall Logo"> <h3>LocalRecall</h3> </a> </td> <td width="70%" valign="top"> <p>A RESTful API and knowledge base management system providing persistent memory and storage capabilities for AI agents. Designed to work alongside LocalAI and LocalAGI.</p> <p><em>Link:</em> <a href="https://github.com/mudler/LocalRecall">https://github.com/mudler/LocalRecall</a></p> </td> </tr> </table> ## Thank you! ❤️ A massive **THANK YOU** to our incredible community and our sponsors! LocalAI has over **34,100 stars**, and LocalAGI has already rocketed past **900+ stars**! As a reminder, LocalAI is real FOSS (Free and Open Source Software) and its sibling projects are community-driven and not backed by VCs or a company. We rely on contributors donating their spare time and our sponsors to provide us the hardware! If you love open-source, privacy-first AI, please consider starring the repos, contributing code, reporting bugs, or spreading the word! 👉 **Check out the reborn LocalAGI v2 today:** [https://github.com/mudler/LocalAGI](https://github.com/mudler/LocalAGI) ## Full changelog :point_down: <details> <summary> :point_right: Click to expand :point_left: </summary> ## What's Changed ### Bug fixes :bug: * fix(backend gallery): intel images for python-based backends, re-add exllama2 by @mudler in https://github.com/mudler/LocalAI/pull/5928 ### Exciting New Features 🎉 * feat: normalize search by @mudler in https://github.com/mudler/LocalAI/pull/5925 * feat(rfdetr): add object detection API by @mudler in https://github.com/mudler/LocalAI/pull/5923 ### Other Changes * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/5920 * chore: :arrow_up: Update ggml-org/whisper.cpp to `e7bf0294ec9099b5fc21f5ba969805dfb2108cea` by @localai-bot in https://github.com/mudler/LocalAI/pull/5922 * chore: :arrow_up: Update ggml-org/llama.cpp to `11dd5a44eb180e1d69fac24d3852b5222d66fb7f` by @localai-bot in https://github.com/mudler/LocalAI/pull/5921 * chore: drop assistants endpoint by @mudler in https://github.com/mudler/LocalAI/pull/5926 * chore: :arrow_up: Update ggml-org/llama.cpp to `bf78f5439ee8e82e367674043303ebf8e92b4805` by @localai-bot in https://github.com/mudler/LocalAI/pull/5927 </details> **Full Changelog**: https://github.com/mudler/LocalAI/compare/v3.2.3...v3.3.0