LocalAI v2.15.0 — Release Notes & Engineering Impact

 # 🎉 LocalAI v2.15.0! 🚀 Hey awesome people! I'm happy to announce the release of LocalAI version 2.15.0! This update introduces several significant improvements and features, enhancing usability, functionality, and user experience across the board. Dive into the key highlights below, and don't forget to check out the full changelog for more detailed updates. ### 🌍 WebUI Upgrades: Turbocharged! #### 🚀 Vision API Integration The Chat WebUI now seamlessly integrates with the Vision API, making it easier for users to test image processing models directly through the browser interface - this is a very simple and hackable interface in less then 400L of code with Alpine.JS and HTMX!  #### 💬 System Prompts in Chat System prompts can be set in the WebUI chat, which guide the user through interactions more intuitively, making our chat interface smarter and more responsive.  #### 🌟 Revamped Welcome Page New to LocalAI or haven't installed any models yet? No worries! The updated welcome page now guides users through the model installation process, ensuring you're set up and ready to go without any hassle. This is a great first step for newcomers - thanks for your precious feedback!  #### 🔄 Background Operations Indicator Don't get lost with our new background operations indicator on the WebUI, which shows when tasks are running in the background.  #### 🔍 Filter Models by Tag and Category As our model gallery balloons, you can now effortlessly sift through models by tag and category, making finding what you need a breeze.  ### 🔧 Single Binary Release LocalAI is expanding into offering single binary releases, simplifying the deployment process and making it easier to get LocalAI up and running on any system. For the moment we have condensed the builds which disables AVX and SSE instructions set. We are also planning to include cuda builds as well. ### 🧠 Expanded Model Gallery This release introduces several exciting new models to our gallery, such as 'Soliloquy', 'tess', 'moondream2', 'llama3-instruct-coder' and 'aurora', enhancing the diversity and capability of our AI offerings. Our selection of one-click-install models is growing! We pick carefully model from the most trending ones on huggingface, feel free to submit your requests in a github issue, hop to our Discord or contribute by hosting your gallery, or.. even by adding models directly to LocalAI!   Want to share your model configurations and customizations? See the docs: https://localai.io/docs/getting-started/customize-model/ ## 📣 Let's Make Some Noise! A gigantic THANK YOU to everyone who’s contributed—your feedback, bug squashing, and feature suggestions are what make LocalAI shine. To all our heroes out there supporting other users and sharing their expertise, you’re the real MVPs! Remember, LocalAI thrives on community support—not big corporate bucks. If you love what we're building, show some love! A shoutout on social (@LocalAI_OSS and @mudler_it on twitter/X), joining our sponsors, or simply starring us on GitHub makes all the difference. Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy Thanks a ton, and.. enjoy this release! --- ## What's Changed ### Bug fixes :bug: * fix(webui): correct documentation URL for text2img by @mudler in https://github.com/mudler/LocalAI/pull/2233 * fix(ux): fix small glitches by @mudler in https://github.com/mudler/LocalAI/pull/2265 ### Exciting New Features 🎉 * feat: update ROCM and use smaller image by @cryptk in https://github.com/mudler/LocalAI/pull/2196 * feat(llama.cpp): do not specify backends to autoload and add llama.cpp variants by @mudler in https://github.com/mudler/LocalAI/pull/2232 * fix(webui): display small navbar with smaller screens by @mudler in https://github.com/mudler/LocalAI/pull/2240 * feat(startup): show CPU/GPU information with --debug by @mudler in https://github.com/mudler/LocalAI/pull/2241 * feat(single-build): generate single binaries for releases by @mudler in https://github.com/mudler/LocalAI/pull/2246 * feat(webui): ux improvements by @mudler in https://github.com/mudler/LocalAI/pull/2247 * fix: OpenVINO winograd always disabled by @fakezeta in https://github.com/mudler/LocalAI/pull/2252 * UI: flag `trust_remote_code` to users // favicon support by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2253 * feat(ui): prompt for chat, support vision, enhancements by @mudler in https://github.com/mudler/LocalAI/pull/2259 ### 🧠 Models * fix(gallery): hermes-2-pro-llama3 models checksum changed by @Nold360 in https://github.com/mudler/LocalAI/pull/2236 * models(gallery): add moondream2 by @mudler in https://github.com/mudler/LocalAI/pull/2237 * models(gallery): add llama3-llava by @mudler in https://github.com/mudler/LocalAI/pull/2238 * models(gallery): add llama3-instruct-coder by @mudler in https://github.com/mudler/LocalAI/pull/2242 * models(gallery): update poppy porpoise by @mudler in https://github.com/mudler/LocalAI/pull/2243 * models(gallery): add lumimaid by @mudler in https://github.com/mudler/LocalAI/pull/2244 * models(gallery): add openbiollm by @mudler in https://github.com/mudler/LocalAI/pull/2245 * gallery: Added some OpenVINO models by @fakezeta in https://github.com/mudler/LocalAI/pull/2249 * models(gallery): Add Soliloquy by @mudler in https://github.com/mudler/LocalAI/pull/2260 * models(gallery): add tess by @mudler in https://github.com/mudler/LocalAI/pull/2266 * models(gallery): add lumimaid variant by @mudler in https://github.com/mudler/LocalAI/pull/2267 * models(gallery): add kunocchini by @mudler in https://github.com/mudler/LocalAI/pull/2268 * models(gallery): add aurora by @mudler in https://github.com/mudler/LocalAI/pull/2270 * models(gallery): add tiamat by @mudler in https://github.com/mudler/LocalAI/pull/2269 ### 📖 Documentation and examples * docs: updated Transformer parameters description by @fakezeta in https://github.com/mudler/LocalAI/pull/2234 * Update readme: add ShellOracle to community integrations by @djcopley in https://github.com/mudler/LocalAI/pull/2254 * Add missing Homebrew dependencies by @michaelmior in https://github.com/mudler/LocalAI/pull/2256 ### 👒 Dependencies * :arrow_up: Update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/2228 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2229 * :arrow_up: Update ggerganov/whisper.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2230 * build(deps): bump tqdm from 4.65.0 to 4.66.3 in /examples/langchain/langchainpy-localai-example in the pip group across 1 directory by @dependabot in https://github.com/mudler/LocalAI/pull/2231 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2239 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2251 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2255 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2263 ### Other Changes * test: check the response URL during image gen in `app_test.go` by @dave-gray101 in https://github.com/mudler/LocalAI/pull/2248 ## New Contributors * @Nold360 made their first contribution in https://github.com/mudler/LocalAI/pull/2236 * @djcopley made their first contribution in https://github.com/mudler/LocalAI/pull/2254 * @michaelmior made their first contribution in https://github.com/mudler/LocalAI/pull/2256 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v2.14.0...v2.15.0