LocalAI v1.30.0 — Release Notes & Engineering Impact

## What's Changed This is an exciting LocalAI release! Besides bug-fixes and enhancements this release brings the new backend to a whole new level by extending support to `vllm` and `vall-e-x` for audio generation! ### Bug fixes :bug: * fix(llama): resolve lora adapters correctly from the model file by @mudler in https://github.com/go-skynet/LocalAI/pull/964 * fix(diffusers): correctly check alpha by @mudler in https://github.com/go-skynet/LocalAI/pull/967 * fix(utf8): prevent multi-byte utf8 characters from being mangled by @samm81 in https://github.com/go-skynet/LocalAI/pull/981 * fix(vall-e-x): make audiopath relative to models by @mudler in https://github.com/go-skynet/LocalAI/pull/1012 * fix(vall-e-x): copy vall-e-x next to the local-ai binary in the container image by @mudler in https://github.com/go-skynet/LocalAI/pull/1082 ### Exciting New Features 🎉 * feat(diffusers): Add lora by @mudler in https://github.com/go-skynet/LocalAI/pull/965 * feat: expose all the jobs via `/models/jobs` endpoint by @Jirubizu in https://github.com/go-skynet/LocalAI/pull/983 * feat: Model Gallery Endpoint Refactor / Mutable Galleries Endpoints by @dave-gray101 in https://github.com/go-skynet/LocalAI/pull/991 * Allow to manually set the seed for the SD pipeline by @maxjcohen in https://github.com/go-skynet/LocalAI/pull/998 * feat: add vall-e-x by @mudler in https://github.com/go-skynet/LocalAI/pull/1007 * feat(vllm): Initial vllm backend implementation by @mudler in https://github.com/go-skynet/LocalAI/pull/1026 * feat(speculative-sampling): allow to specify a draft model in the model config by @mudler in https://github.com/go-skynet/LocalAI/pull/1052 * fix(vllm): set default top_p with vllm by @mudler in https://github.com/go-skynet/LocalAI/pull/1078 * feat(python-grpc): allow to set max workers with PYTHON_GRPC_MAX_WORKERS by @mudler in https://github.com/go-skynet/LocalAI/pull/1081 * feat(vllm): Allow to set quantization by @mudler in https://github.com/go-skynet/LocalAI/pull/1094 ### 👒 Dependencies * fix(deps): update github.com/go-skynet/go-llama.cpp digest to 9072315 by @renovate in https://github.com/go-skynet/LocalAI/pull/963 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/968 * fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.0 by @renovate in https://github.com/go-skynet/LocalAI/pull/966 * fix(deps): update github.com/tmc/langchaingo digest to c85d396 by @renovate in https://github.com/go-skynet/LocalAI/pull/962 * fix(deps): update module github.com/valyala/fasthttp to v1.49.0 by @renovate in https://github.com/go-skynet/LocalAI/pull/971 * fix(deps): update go-llama.cpp by @mudler in https://github.com/go-skynet/LocalAI/pull/980 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to bf3f946 by @renovate in https://github.com/go-skynet/LocalAI/pull/979 * fix(deps): update module github.com/sashabaranov/go-openai to v1.15.1 by @renovate in https://github.com/go-skynet/LocalAI/pull/984 * fix(deps): update module github.com/shirou/gopsutil/v3 to v3.23.8 by @renovate in https://github.com/go-skynet/LocalAI/pull/989 * fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to b6e38d6 by @renovate in https://github.com/go-skynet/LocalAI/pull/988 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to c5622a8 by @renovate in https://github.com/go-skynet/LocalAI/pull/992 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/996 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to d8c8547 by @renovate in https://github.com/go-skynet/LocalAI/pull/997 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1002 * fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.1 by @renovate in https://github.com/go-skynet/LocalAI/pull/1001 * chore(deps): remove unused package by @appleboy in https://github.com/go-skynet/LocalAI/pull/1003 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1005 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to 05dc4b6 by @renovate in https://github.com/go-skynet/LocalAI/pull/1004 * feat(llama.cpp): update by @mudler in https://github.com/go-skynet/LocalAI/pull/1024 * fix(deps): update module github.com/sashabaranov/go-openai to v1.15.2 by @renovate in https://github.com/go-skynet/LocalAI/pull/1022 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to 4145bd5 by @renovate in https://github.com/go-skynet/LocalAI/pull/1025 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1027 * fix(deps): update github.com/tmc/langchaingo digest to 9c8845b by @renovate in https://github.com/go-skynet/LocalAI/pull/1029 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1043 * fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to f0735ef by @renovate in https://github.com/go-skynet/LocalAI/pull/1034 * fix(deps): update module github.com/sashabaranov/go-openai to v1.15.3 by @renovate in https://github.com/go-skynet/LocalAI/pull/1035 * chore(deps): update docker/build-push-action action to v5 by @renovate in https://github.com/go-skynet/LocalAI/pull/1039 * chore(deps): update docker/login-action action to v3 by @renovate in https://github.com/go-skynet/LocalAI/pull/1040 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to cc8a123 by @renovate in https://github.com/go-skynet/LocalAI/pull/1041 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1048 * chore(deps): update docker/metadata-action action to v5 by @renovate in https://github.com/go-skynet/LocalAI/pull/1045 * fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to cf4eb53 by @renovate in https://github.com/go-skynet/LocalAI/pull/1047 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1062 * fix(deps): update module google.golang.org/grpc to v1.58.1 by @renovate in https://github.com/go-skynet/LocalAI/pull/1020 * fix(deps): update module github.com/gofiber/fiber/v2 to v2.49.2 by @renovate in https://github.com/go-skynet/LocalAI/pull/1049 * fix(deps): update module github.com/valyala/fasthttp to v1.50.0 by @renovate in https://github.com/go-skynet/LocalAI/pull/1060 * fix(deps): update github.com/go-skynet/go-llama.cpp digest to b471eb7 by @renovate in https://github.com/go-skynet/LocalAI/pull/1050 * fix(deps): update github.com/nomic-ai/gpt4all/gpt4all-bindings/golang digest to e86c637 by @renovate in https://github.com/go-skynet/LocalAI/pull/1059 * :arrow_up: Update go-skynet/go-llama.cpp by @ci-robbot in https://github.com/go-skynet/LocalAI/pull/1084 * fix(llama.cpp): update, run go mod tidy by @mudler in https://github.com/go-skynet/LocalAI/pull/1088 * fix(deps): update module google.golang.org/grpc to v1.58.2 by @renovate in https://github.com/go-skynet/LocalAI/pull/1090 * fix(deps): update github.com/tmc/langchaingo digest to 2c309cf by @renovate in https://github.com/go-skynet/LocalAI/pull/1097 ### Other Changes * [query_data example] max_chunk_overlap in PromptHelper must be in 0..1 range by @quoing in https://github.com/go-skynet/LocalAI/pull/1000 * feat(diffusers): don't set seed in params and respect device by @mudler in https://github.com/go-skynet/LocalAI/pull/1010 * Update README to reflect changes in Continue's config file by @rdeaton in https://github.com/go-skynet/LocalAI/pull/1014 * 1038 - Streamlit bot with LocalAI by @majoshi1 in https://github.com/go-skynet/LocalAI/pull/1072 * Cleaned up chatbot-ui READMEs by @jamesbraza in https://github.com/go-skynet/LocalAI/pull/1075 * Requested Changes from GPT4ALL to Luna-AI-Llama2 by @lunamidori5 in https://github.com/go-skynet/LocalAI/pull/1092 * Add the CONTRIBUTING.md by @Aisuko in https://github.com/go-skynet/LocalAI/pull/1098 ## New Contributors * @Jirubizu made their first contribution in https://github.com/go-skynet/LocalAI/pull/983 * @maxjcohen made their first contribution in https://github.com/go-skynet/LocalAI/pull/998 * @appleboy made their first contribution in https://github.com/go-skynet/LocalAI/pull/1003 * @quoing made their first contribution in https://github.com/go-skynet/LocalAI/pull/1000 * @rdeaton made their first contribution in https://github.com/go-skynet/LocalAI/pull/1014 * @majoshi1 made their first contribution in https://github.com/go-skynet/LocalAI/pull/1072 * @jamesbraza made their first contribution in https://github.com/go-skynet/LocalAI/pull/1075 * @lunamidori5 made their first contribution in https://github.com/go-skynet/LocalAI/pull/1092 **Full Changelog**: https://github.com/go-skynet/LocalAI/compare/v1.25.0...v2.0.0