LocalAI v2.14.0 — Release Notes & Engineering Impact

## 🚀 AIO Image Update: llama3 has landed! We're excited to announce that our AIO image has been upgraded with the latest LLM model, llama3, enhancing our capabilities with more accurate and dynamic responses. Behind the scenes uses https://huggingface.co/NousResearch/Hermes-2-Pro-Llama-3-8B-GGUF which is ready for function call, yay! ## 💬 WebUI enhancements: Updates in Chat, Image Generation, and TTS |Chat | TTS | Image gen | |------------|----------------|-------------| |  |  |  | Our interfaces for Chat, Text-to-Speech (TTS), and Image Generation have finally landed. Enjoy streamlined and simple interactions thanks to the efforts of our team, led by @mudler, who have worked tirelessly to enhance your experience. The WebUI interface serves as a quick way to debug and assess models loaded in LocalAI - there is much to improve, but we have now a small, hackable interface! ## 🖼️ Many new models in the model gallery! |  | |------------| The model gallery has received a substantial upgrade with numerous new models, including Einstein v6.1, SOVL, and several specialized Llama3 iterations. These additions are designed to cater to a broader range of tasks , making LocalAI more versatile than ever. Kudos to @mudler for spearheading these exciting updates - now you can select with a couple of click the model you like! ## 🛠️ Robust Fixes and Optimizations This update brings a series of crucial bug fixes and security enhancements to ensure our platform remains secure and efficient. Special thanks to @dave-gray101, @cryptk, and @fakezeta for their diligent work in rooting out and resolving these issues :hugs: ## ✨ OpenVINO and more We're introducing OpenVINO acceleration, and many OpenVINO models in the gallery. You can now enjoy fast-as-hell speed on Intel CPU and GPUs. Applause to @fakezeta for the contributions! ## 📚 Documentation and Dependency Upgrades We've updated our documentation and dependencies to keep you equipped with the latest tools and knowledge. These updates ensure that LocalAI remains a robust and dependable platform. ## 👥 A Community Effort A special shout-out to our new contributors, @QuinnPiers and @LeonSijiaLu, who have enriched our community with their first contributions. Welcome aboard, and thank you for your dedication and fresh insights! Each update in this release not only enhances our platform's capabilities but also ensures a safer and more user-friendly experience. We are excited to see how our users leverage these new features in their projects, freel free to hit a line on Twitter or in any other social, we'd be happy to hear how you use LocalAI! ## 📣 Spread the word! First off, a massive thank you (again!) to each and every one of you who've chipped in to squash bugs and suggest cool new features for LocalAI. Your help, kind words, and brilliant ideas are truly appreciated - more than words can say! And to those of you who've been heros, giving up your own time to help out fellow users on Discord and in our repo, you're absolutely amazing. We couldn't have asked for a better community. Just so you know, LocalAI doesn't have the luxury of big corporate sponsors behind it. It's all us, folks. So, if you've found value in what we're building together and want to keep the momentum going, consider showing your support. A little shoutout on your favorite social platforms using @LocalAI_OSS and @mudler_it or joining our sponsors can make a big difference. Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy Every bit of support, every mention, and every star adds up and helps us keep this ship sailing. Let's keep making LocalAI awesome together! Thanks a ton, and.. exciting times ahead with LocalAI! ## What's Changed ### Bug fixes :bug: * fix: `config_file_watcher.go` - root all file reads for safety by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2144 * fix: github bump_docs.sh regex to drop emoji and other text by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2180 * fix: undefined symbol: iJIT_NotifyEvent in import torch ##2153 by @fakezeta in https://github.com/mudler/LocalAI/pull/2179 * fix: security scanner warning noise: error handlers part 2 by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2145 * fix: ensure GNUMake jobserver is passed through to whisper.cpp build by @cryptk in https://github.com/mudler/LocalAI/pull/2187 * fix: bring everything onto the same GRPC version to fix tests by @cryptk in https://github.com/mudler/LocalAI/pull/2199 ### Exciting New Features 🎉 * feat(gallery): display job status also during navigation by @mudler in https://github.com/mudler/LocalAI/pull/2151 * feat: cleanup Dockerfile and make final image a little smaller by @cryptk in https://github.com/mudler/LocalAI/pull/2146 * fix: swap to WHISPER_CUDA per deprecation message from whisper.cpp by @cryptk in https://github.com/mudler/LocalAI/pull/2170 * feat: only keep the build artifacts from the grpc build by @cryptk in https://github.com/mudler/LocalAI/pull/2172 * feat(gallery): support model deletion by @mudler in https://github.com/mudler/LocalAI/pull/2173 * refactor(application): introduce application global state by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2072 * feat: organize Dockerfile into distinct sections by @cryptk in https://github.com/mudler/LocalAI/pull/2181 * feat: OpenVINO acceleration for embeddings in transformer backend by @fakezeta in https://github.com/mudler/LocalAI/pull/2190 * chore: update go-stablediffusion to latest commit with Make jobserver fix by @cryptk in https://github.com/mudler/LocalAI/pull/2197 * feat: user defined inference device for CUDA and OpenVINO by @fakezeta in https://github.com/mudler/LocalAI/pull/2212 * feat(ux): Add chat, tts, and image-gen pages to the WebUI by @mudler in https://github.com/mudler/LocalAI/pull/2222 * feat(aio): switch to llama3-based for LLM by @mudler in https://github.com/mudler/LocalAI/pull/2225 * feat(ui): support multilineand style `ul` by @mudler in https://github.com/mudler/LocalAI/pull/2226 ### 🧠 Models * models(gallery): add Einstein v6.1 by @mudler in https://github.com/mudler/LocalAI/pull/2152 * models(gallery): add SOVL by @mudler in https://github.com/mudler/LocalAI/pull/2154 * models(gallery): add average_normie by @mudler in https://github.com/mudler/LocalAI/pull/2155 * models(gallery): add solana by @mudler in https://github.com/mudler/LocalAI/pull/2157 * models(gallery): add poppy porpoise by @mudler in https://github.com/mudler/LocalAI/pull/2158 * models(gallery): add Undi95/Llama-3-LewdPlay-8B-evo-GGUF by @mudler in https://github.com/mudler/LocalAI/pull/2160 * models(gallery): add biomistral-7b by @mudler in https://github.com/mudler/LocalAI/pull/2161 * models(gallery): add llama3-32k by @mudler in https://github.com/mudler/LocalAI/pull/2183 * models(gallery): add openvino models by @mudler in https://github.com/mudler/LocalAI/pull/2184 * models(gallery): add lexifun by @mudler in https://github.com/mudler/LocalAI/pull/2193 * models(gallery): add suzume-llama-3-8B-multilingual-gguf by @mudler in https://github.com/mudler/LocalAI/pull/2194 * models(gallery): add guillaumetell by @mudler in https://github.com/mudler/LocalAI/pull/2195 * models(gallery): add wizardlm2 by @mudler in https://github.com/mudler/LocalAI/pull/2209 * models(gallery): Add Hermes-2-Pro-Llama-3-8B-GGUF by @mudler in https://github.com/mudler/LocalAI/pull/2218 ### 📖 Documentation and examples * :arrow_up: Update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/2149 * draft:Update model-gallery.md with correct gallery file by @QuinnPiers in https://github.com/mudler/LocalAI/pull/2163 * docs: update gallery, add rerankers by @mudler in https://github.com/mudler/LocalAI/pull/2166 * docs: enhance and condense few sections by @mudler in https://github.com/mudler/LocalAI/pull/2178 * [Documentations] Removed invalid numberings from `troubleshooting mac` by @LeonSijiaLu in https://github.com/mudler/LocalAI/pull/2174 ### 👒 Dependencies * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2150 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2159 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2176 * :arrow_up: Update ggerganov/whisper.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2177 * update go-tinydream to latest commit by @cryptk in https://github.com/mudler/LocalAI/pull/2182 * build(deps): bump dependabot/fetch-metadata from 2.0.0 to 2.1.0 by @dependabot in https://github.com/mudler/LocalAI/pull/2186 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2189 * :arrow_up: Update ggerganov/whisper.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2188 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2203 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2213 ### Other Changes * Revert ":arrow_up: Update docs version mudler/LocalAI" by @mudler in https://github.com/mudler/LocalAI/pull/2165 * Issue-1720: Updated `Build on mac` documentations by @LeonSijiaLu in https://github.com/mudler/LocalAI/pull/2171 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2224 ## New Contributors * @QuinnPiers made their first contribution in https://github.com/mudler/LocalAI/pull/2163 * @LeonSijiaLu made their first contribution in https://github.com/mudler/LocalAI/pull/2171 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v2.13.0...v2.14.0