LocalAI v2.8.1 — Release Notes & Engineering Impact

This is a patch release, mostly containing minor patches and bugfixes from 2.8.0. Most importantly it contains a bugfix for https://github.com/mudler/LocalAI/issues/1333 which made the llama.cpp backend to get stuck in some cases where the model starts to hallucinate and fixes to the python-based backends. ## Spread the word! First off, a massive thank you to each and every one of you who've chipped in to squash bugs and suggest cool new features for LocalAI. Your help, kind words, and brilliant ideas are truly appreciated - more than words can say! And to those of you who've been heros, giving up your own time to help out fellow users on Discord and in our repo, you're absolutely amazing. We couldn't have asked for a better community. Just so you know, LocalAI doesn't have the luxury of big corporate sponsors behind it. It's all us, folks. So, if you've found value in what we're building together and want to keep the momentum going, consider showing your support. A little shoutout on your favorite social platforms using [@LocalAI_OSS](https://twitter.com/LocalAI_API) and [@mudler_it](https://twitter.com/mudler_it) or joining our sponsorship program can make a big difference. Also, if you haven't yet joined our Discord, come on over! Here's the link: https://discord.gg/uJAeKSAGDy Every bit of support, every mention, and every star adds up and helps us keep this ship sailing. Let's keep making LocalAI awesome together! Thanks a ton, and here's to more exciting times ahead with LocalAI! 🚀 ## What's Changed ### Bug fixes :bug: * fix(vall-e-x): Fix voice cloning by @mudler in https://github.com/mudler/LocalAI/pull/1696 * fix: drop unused code by @mudler in https://github.com/mudler/LocalAI/pull/1697 * fix(llama.cpp): disable infinite context shifting by @mudler in https://github.com/mudler/LocalAI/pull/1704 * fix(llama.cpp): downgrade to a known working version by @mudler in https://github.com/mudler/LocalAI/pull/1706 * fix(python): pin exllama2 by @mudler in https://github.com/mudler/LocalAI/pull/1711 ### Exciting New Features 🎉 * feat(tts): respect YAMLs config file, add sycl docs/examples by @mudler in https://github.com/mudler/LocalAI/pull/1692 * ci: add cuda builds to release by @sozercan in https://github.com/mudler/LocalAI/pull/1702 ### Other Changes * :arrow_up: Update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/1693 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1694 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1698 * :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/1700 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v2.8.0...v2.8.1