LocalAI v2.19.2 — Release Notes & Engineering Impact

This release is a patch release to fix well known issues from 2.19.x ## What's Changed ### Bug fixes :bug: * fix: pin setuptools 69.5.1 by @fakezeta in https://github.com/mudler/LocalAI/pull/2949 * fix(cuda): downgrade to 12.0 to increase compatibility range by @mudler in https://github.com/mudler/LocalAI/pull/2994 * fix(llama.cpp): do not set anymore lora_base by @mudler in https://github.com/mudler/LocalAI/pull/2999 ### Exciting New Features 🎉 * ci(Makefile): reduce binary size by compressing by @mudler in https://github.com/mudler/LocalAI/pull/2947 * feat(p2p): warn the user to start with --p2p by @mudler in https://github.com/mudler/LocalAI/pull/2993 ### 🧠 Models * models(gallery): add tulu 8b and 70b by @mudler in https://github.com/mudler/LocalAI/pull/2931 * models(gallery): add suzume-orpo by @mudler in https://github.com/mudler/LocalAI/pull/2932 * models(gallery): add archangel_sft_pythia2-8b by @mudler in https://github.com/mudler/LocalAI/pull/2933 * models(gallery): add celestev1.2 by @mudler in https://github.com/mudler/LocalAI/pull/2937 * models(gallery): add calme-2.3-phi3-4b by @mudler in https://github.com/mudler/LocalAI/pull/2939 * models(gallery): add calme-2.8-qwen2-7b by @mudler in https://github.com/mudler/LocalAI/pull/2940 * models(gallery): add StellarDong-72b by @mudler in https://github.com/mudler/LocalAI/pull/2941 * models(gallery): add calme-2.4-llama3-70b by @mudler in https://github.com/mudler/LocalAI/pull/2942 * models(gallery): add llama3.1 70b and 8b by @mudler in https://github.com/mudler/LocalAI/pull/3000 ### 📖 Documentation and examples * docs: add federation by @mudler in https://github.com/mudler/LocalAI/pull/2929 * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/2935 ### 👒 Dependencies * chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2936 * chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2943 * chore(deps): Bump grpcio from 1.64.1 to 1.65.1 in /backend/python/openvoice by @dependabot in https://github.com/mudler/LocalAI/pull/2956 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/sentencetransformers by @dependabot in https://github.com/mudler/LocalAI/pull/2955 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/bark by @dependabot in https://github.com/mudler/LocalAI/pull/2951 * chore(deps): Bump docs/themes/hugo-theme-relearn from `1b2e139` to `7aec99b` by @dependabot in https://github.com/mudler/LocalAI/pull/2952 * chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2959 * chore(deps): Bump numpy from 1.26.4 to 2.0.1 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2958 * chore(deps): Bump sqlalchemy from 2.0.30 to 2.0.31 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2957 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/vllm by @dependabot in https://github.com/mudler/LocalAI/pull/2964 * chore(deps): Bump llama-index from 0.10.55 to 0.10.56 in /examples/chainlit by @dependabot in https://github.com/mudler/LocalAI/pull/2966 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/common/template by @dependabot in https://github.com/mudler/LocalAI/pull/2963 * chore(deps): Bump weaviate-client from 4.6.5 to 4.6.7 in /examples/chainlit by @dependabot in https://github.com/mudler/LocalAI/pull/2965 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/transformers by @dependabot in https://github.com/mudler/LocalAI/pull/2970 * chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/2973 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/diffusers by @dependabot in https://github.com/mudler/LocalAI/pull/2969 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/exllama2 by @dependabot in https://github.com/mudler/LocalAI/pull/2971 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/rerankers by @dependabot in https://github.com/mudler/LocalAI/pull/2974 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/coqui by @dependabot in https://github.com/mudler/LocalAI/pull/2980 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/parler-tts by @dependabot in https://github.com/mudler/LocalAI/pull/2982 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/vall-e-x by @dependabot in https://github.com/mudler/LocalAI/pull/2981 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/transformers-musicgen by @dependabot in https://github.com/mudler/LocalAI/pull/2990 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/autogptq by @dependabot in https://github.com/mudler/LocalAI/pull/2984 * chore(deps): Bump llama-index from 0.10.55 to 0.10.56 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2986 * chore(deps): Bump grpcio from 1.65.0 to 1.65.1 in /backend/python/mamba by @dependabot in https://github.com/mudler/LocalAI/pull/2989 * chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2992 * chore(deps): Bump langchain-community from 0.2.7 to 0.2.9 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2960 * chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/langchain/langchainpy-localai-example by @dependabot in https://github.com/mudler/LocalAI/pull/2961 * chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/functions by @dependabot in https://github.com/mudler/LocalAI/pull/2975 * chore(deps): Bump openai from 1.35.13 to 1.37.0 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2988 * chore(deps): Bump langchain from 0.2.8 to 0.2.10 in /examples/langchain-chroma by @dependabot in https://github.com/mudler/LocalAI/pull/2987 * chore: :arrow_up: Update ggerganov/llama.cpp by @localai-bot in https://github.com/mudler/LocalAI/pull/2995 ### Other Changes * ci(Makefile): enable p2p on cross-arm64 builds by @mudler in https://github.com/mudler/LocalAI/pull/2928 **Full Changelog**: https://github.com/mudler/LocalAI/compare/v2.19.1...v2.19.2