Dify: v0.6.16

## ✨ What’s New in v0.6.16? ✨ Hey everyone, we’re back with another update, and this one’s packed with some exciting new features, model support, and enhancements. Let’s dive right in! ### 🚀 Phasing Out N-to-1: Upgrading Multi-path Knowledge Retrieval > [!IMPORTANT] > We're phasing out the `N-to-1` retrieval strategy on **September 1, 2024**, and introducing a more flexible multi-path retrieval strategy. We recommend switching to this new approach to boost your application's retrieval efficiency.  Learn More: https://dify.ai/blog/dify-ai-blog-n-to-1-knowledge-retrieval-legacy ### 🧠 Models #### Llama3.1 Support - **OpenRouter Provider**: Added support for Llama3.1 series models by @sinomoe in #6595. - **GroqCloud**: Llama3.1 series models are now supported by @takatost in #6596. - **Bedrock**: Llama 3.1 support added by @longzhihun in #6645. - **NVIDIA**: Llama3.1 model support by @sulgweb in #6844. #### GPT-4o Mini Support - **Azure GPT-4o Mini**: Added support for Azure GPT-4o Mini by @charli117 in #6862 and @leslie2046 in #6866. #### Other Models - **DeepSeek-Coder-v2**: Added in SiliconFlow by @senseb in #6149. - **Novita Model Provider**: New model provider added by @jasonhp in #6717. - **Solar Model Provider**: Added new provider Solar by @JuHyung-Son in #6884. - **Hunyuan-Embedding**: New model support by @maybemaynot in #6657. - **Xinference TTS**: Added support for text-to-speech by @Weaxs in #6746. - **Tool-Call for Hunyuan**: Added support for tool-call by @maybemaynot in #6656. ### 🛠️ Tools - **AWS Built-in Tools**: Added by @ybalbert001 in #6721. - **Serper for Google Search**: New tool added for Google search by @hwzhuhao in #6790. ### ⚙️ Enhancements - **Python 3.12 Support**: Added Python 3.12 support for API Service by @bowenliang123 in #6771. - **Milvus 2.4.x Support**: Initial support for Milvus 2.4.x by @bowenliang123 in #6084. - **Docker-Compose Certbot Configurations**: Added with backward compatibility by @k-brahma in #6702. - **Celery Auto-Scale**: Added support for Celery auto-scaling by @ZuzooVn in #6249. - **User Session ID Search**: Enhanced App Logs search capabilities by @ZhouhaoJiang in #6638. ### 🧹 Cleanups - **Remove TTS (Blocking Call)**: Removed blocking call for TTS by @ic-xu in #6869. For additional enhancements and updates, refer to the What's Changed section below. --- ## Upgrade Guide ### Docker compose deployments > [!WARNING] > The `docker-compose.yaml` has been refactored. If you've made any changes to the file, make sure to check out the "Upgrade to new docker compose deployment" section above for usage and migration tips. 1. Back up your customized docker-compose YAML file (optional) ```bash cd docker cp docker-compose.yaml docker-compose.yaml.$(date +%s).bak ``` 2. Get the latest code from the main branch ```bash git checkout main git pull origin main ``` 3. Stop the service，Command, please execute in the docker directory ```bash docker compose down ``` 4. Back up data ```bash tar -cvf volumes-$(date +%s).tgz volumes ``` 5. Upgrade services ```bash docker compose up -d ``` ### Source Code deployments 1. Stop API server, Worker and Web frontend Server. 2. Get the latest code from the main branch: ```bash git checkout main git pull origin main ``` 3. Update Python dependencies: ```bash cd api poetry install ``` 7. Then, let's run the migration script: ```bash poetry shell flask db upgrade ``` 8. Finally, run API server, Worker and Web frontend Server again. --- ## What's Changed * feat: support llama3.1 series models for openrouter provider by @sinomoe in https://github.com/langgenius/dify/pull/6595 * feat: add GroqCloud llama3.1 series models support by @takatost in https://github.com/langgenius/dify/pull/6596 * fix: downgraded sentry-sdk to 1.44.1 due to claude LLM token returning 0 by @takatost in https://github.com/langgenius/dify/pull/6597 * Feat/delete single dataset retrival by @JohnJyong in https://github.com/langgenius/dify/pull/6570 * feat: n to 1 retrieval legacy by @zxhlyh in https://github.com/langgenius/dify/pull/6554 * Fix: reset button in embedded chatbot by @JzoNgKVO in https://github.com/langgenius/dify/pull/6611 * Fix: DSL backup by @JzoNgKVO in https://github.com/langgenius/dify/pull/6616 * Fix/6615 40 varchar limit on model name by @crazywoola in https://github.com/langgenius/dify/pull/6623 * fix: qwen fc error by @Dofine-dufei in https://github.com/langgenius/dify/pull/6620 * feat: added ActionButton component by @YIXIAO0 in https://github.com/langgenius/dify/pull/6631 * chore: optimize asynchronous deletion performance of app related data by @takatost in https://github.com/langgenius/dify/pull/6634 * chore: optimize asynchronous workflow deletion performance of app related data by @takatost in https://github.com/langgenius/dify/pull/6639 * doc: fix about model features by @zhangzhiqiangcs in https://github.com/langgenius/dify/pull/6619 * fix: value is not an array by @crazywoola in https://github.com/langgenius/dify/pull/6632 * Feat/user session id search by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6638 * remove rerank model must be required when retrieval_model is multiple by @JohnJyong in https://github.com/langgenius/dify/pull/6640 * feat(api/core/app/segments/variables.py): Support description in Variable. by @laipz8200 in https://github.com/langgenius/dify/pull/6636 * refactor(api/core/workflow/workflow_engine_manager.py): Remove by @laipz8200 in https://github.com/langgenius/dify/pull/6630 * Chores: add missing profile for middleware docker compose cmd and fix ssrf-proxy doc link by @vicoooo26 in https://github.com/langgenius/dify/pull/6372 * fix(api/core/workflow/nodes/iteration/iteration_node.py): Extend output in iteration if output is a array. by @laipz8200 in https://github.com/langgenius/dify/pull/6647 * fix reranking model field error by @JohnJyong in https://github.com/langgenius/dify/pull/6654 * Resolve variable type parameter error by @majian159 in https://github.com/langgenius/dify/pull/6646 * fix tencent_cos_storage image-preview error is not a byte by @yanghx-git in https://github.com/langgenius/dify/pull/6652 * [seanguo] feat: add llama 3.1 support in bedrock by @longzhihun in https://github.com/langgenius/dify/pull/6645 * chore: fix type annotations by @hjlarry in https://github.com/langgenius/dify/pull/6600 * Add support of tool-call for model provider "hunyuan" by @maybemaynot in https://github.com/langgenius/dify/pull/6656 * fix(api/fields/workflow_fields.py): Add check in environment variables by @laipz8200 in https://github.com/langgenius/dify/pull/6621 * feat: support max_retries in jina requests by @xielong in https://github.com/langgenius/dify/pull/6585 * Enhance database URI security and add URL encoding by @Seayon in https://github.com/langgenius/dify/pull/6668 * refactor(api/core/app/segments): implement `to_object` in ObjectVariable and ArrayVariable. by @laipz8200 in https://github.com/langgenius/dify/pull/6671 * fix bugs(when using Oracle23ai as Vector DB) by @tmuife in https://github.com/langgenius/dify/pull/6658 * fix: code block segmentation problem of markdown document by @greycodee in https://github.com/langgenius/dify/pull/6465 * Add french and jp translation for new feature by @HanqingZ in https://github.com/langgenius/dify/pull/6675 * modify llama3-1 yaml filename to support Windows pull operations by @Sakura4036 in https://github.com/langgenius/dify/pull/6677 * Update bug_report.yml by @crazywoola in https://github.com/langgenius/dify/pull/6678 * [seanguo] fix: unsupported filename in windows & add Mistral Large 2 by @longzhihun in https://github.com/langgenius/dify/pull/6679 * security/SSRF vulns by @Yeuoly in https://github.com/langgenius/dify/pull/6682 * fix: doc link in knowledge base by @crazywoola in https://github.com/langgenius/dify/pull/6691 * chore: make prompt generator max tokens configurable by @gijigae in https://github.com/langgenius/dify/pull/6693 * Fix appId missing in annotations by @JzoNgKVO in https://github.com/langgenius/dify/pull/6699 * fix(log/list): Incorrect field 'app_id' causing annotations to fail t… by @Kevin9703 in https://github.com/langgenius/dify/pull/6697 * issues #6655 Open ai tts issues by @ic-xu in https://github.com/langgenius/dify/pull/6696 * refactor(api/core/app/segments): Support more kinds of Segments. by @laipz8200 in https://github.com/langgenius/dify/pull/6706 * fix(answer/operation): feedback status in the logs by @Kevin9703 in https://github.com/langgenius/dify/pull/6716 * Feat/model provider novita by @jasonhp in https://github.com/langgenius/dify/pull/6717 * fix: tongyi empty tool_calls is not supported in message by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6719 * feat(api/core/app/segments/parser.py): Remove blank segment in `convert_template` by @laipz8200 in https://github.com/langgenius/dify/pull/6709 * add xlsx support hyperlink extract by @JohnJyong in https://github.com/langgenius/dify/pull/6722 * fix(api/core/model_runtime/model_providers/azure_openai/llm/llm.py): Try to skip if `delta.delta` is None. by @laipz8200 in https://github.com/langgenius/dify/pull/6727 * Feat/6725 can not get image url from cogview tool by @crazywoola in https://github.com/langgenius/dify/pull/6728 * refactor(api/core/workflow/nodes/base_node.py): Update extract_variable_selector_to_variable_mapping method signature. by @laipz8200 in https://github.com/langgenius/dify/pull/6733 * feat(api/core/app/segments): Update segment types and variables by @laipz8200 in https://github.com/langgenius/dify/pull/6734 * chore: migrate to poetry in devcontainer commands by @perzeuss in https://github.com/langgenius/dify/pull/6724 * feat: enhance the firecrawl tool by @hjlarry in https://github.com/langgenius/dify/pull/6705 * Fix/6615 40 varchar limit on DatasetCollectionBinding and Embedding model name by @HiroshigeAoki in https://github.com/langgenius/dify/pull/6723 * switch to dify_config with Pydantic in files, moderation and app by @VickyGuo0907 in https://github.com/langgenius/dify/pull/6747 * Add jp translation for new features by @HanqingZ in https://github.com/langgenius/dify/pull/6749 * chore: improve position map conversion and tolerate empty position yaml file by @bowenliang123 in https://github.com/langgenius/dify/pull/6541 * Fix action button size by @YIXIAO0 in https://github.com/langgenius/dify/pull/6753 * chore: set logging level to debug when reading YAML files and falling back to default value in case of None by @bowenliang123 in https://github.com/langgenius/dify/pull/6758 * fix: n to 1 retrieval legacy text by @zxhlyh in https://github.com/langgenius/dify/pull/6760 * chore: n to 1 retrieval legacy text by @zxhlyh in https://github.com/langgenius/dify/pull/6767 * fix(api/core/moderation/output_moderation.py): Fix config call. by @laipz8200 in https://github.com/langgenius/dify/pull/6769 * Add model hunyuan-embedding by @maybemaynot in https://github.com/langgenius/dify/pull/6657 * upgrade deepseek params by @wayneg123 in https://github.com/langgenius/dify/pull/6744 * add deepseek-coder-v2 in siliconflow by @senseb in https://github.com/langgenius/dify/pull/6149 * feat: implement function dispatch table for trace processing by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6628 * dep: initial support for Milvus 2.4.x by @bowenliang123 in https://github.com/langgenius/dify/pull/6084 * chore: remove redundant version pinning for indirect dependencies by @bowenliang123 in https://github.com/langgenius/dify/pull/6772 * refactor(api): Switch to `dify_config` by @laipz8200 in https://github.com/langgenius/dify/pull/6750 * improve issue templates by @guchenhe in https://github.com/langgenius/dify/pull/6785 * fix: nonetype in webscraper validation by @Yeuoly in https://github.com/langgenius/dify/pull/6788 * chore: add shortcut keys and hints for the shortcuts by @hjlarry in https://github.com/langgenius/dify/pull/6779 * fix: eco knowledge retrieval method by @zxhlyh in https://github.com/langgenius/dify/pull/6798 * chore : option card by @iamjoel in https://github.com/langgenius/dify/pull/6800 * fix wrong charset when decoding Chinese content by @eric-0x72 in https://github.com/langgenius/dify/pull/6774 * feat: bedrock invoke enhancement by @longzhihun in https://github.com/langgenius/dify/pull/6808 * fix: workflow api by @crazywoola in https://github.com/langgenius/dify/pull/6810 * chore: Add processId field for metrics of threads/db-pool-stat/health by @zhangever in https://github.com/langgenius/dify/pull/6797 * Add docker-compose certbot configurations with backward compatibility by @k-brahma in https://github.com/langgenius/dify/pull/6702 * feat: tag filter adapte to scrolling by @kimjion in https://github.com/langgenius/dify/pull/6819 * feat: support Celery auto-scale by @ZuzooVn in https://github.com/langgenius/dify/pull/6249 * Add AWS builtin Tools by @ybalbert001 in https://github.com/langgenius/dify/pull/6721 * fix: edit segment missing space between buttons by @douxc in https://github.com/langgenius/dify/pull/6826 * fix: improved error handling for spider tool by @WilliamEspegren in https://github.com/langgenius/dify/pull/6835 * chore: fix ssrf doc url by @hjlarry in https://github.com/langgenius/dify/pull/6828 * fix notion internal setting by @JohnJyong in https://github.com/langgenius/dify/pull/6836 * chore: upgrade slider ui by @iamjoel in https://github.com/langgenius/dify/pull/6838 * fix: claude-3-5-sonnet-20240620 max token error by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6843 * add unstructured profiles by @JohnJyong in https://github.com/langgenius/dify/pull/6846 * Add model parameter enable_enhance for hunyuan llm model by @maybemaynot in https://github.com/langgenius/dify/pull/6847 * feat: nvidia add llama3.1 model by @sulgweb in https://github.com/langgenius/dify/pull/6844 * chore: update SQLAlchemy configuration with custom naming convention by @laipz8200 in https://github.com/langgenius/dify/pull/6854 * fix: model parameter selector by @zxhlyh in https://github.com/langgenius/dify/pull/6861 * fix: anthropic max token NoneType error by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6858 * support xinference tts by @Weaxs in https://github.com/langgenius/dify/pull/6746 * Fix keyboard shortcut conflict between workflow and browser by @douxc in https://github.com/langgenius/dify/pull/6863 * Add azure gpt4omini by @charli117 in https://github.com/langgenius/dify/pull/6862 * delete weight_type by @JohnJyong in https://github.com/langgenius/dify/pull/6865 * feat:Azure gpt4o mini by @leslie2046 in https://github.com/langgenius/dify/pull/6866 * fix: remote image not display in answer node by @hjlarry in https://github.com/langgenius/dify/pull/6867 * Revert "feat:Azure gpt4o mini" by @crazywoola in https://github.com/langgenius/dify/pull/6870 * chore: n to 1 retrieval by @zxhlyh in https://github.com/langgenius/dify/pull/6839 * Azure 4o mini options by @leslie2046 in https://github.com/langgenius/dify/pull/6873 * Remove tts (blocking call) by @ic-xu in https://github.com/langgenius/dify/pull/6869 * feat: Add support for i18n Turkish language (tr-TR) by @hursit in https://github.com/langgenius/dify/pull/6886 * fix: Change API key authentication failure response code from 404 to 401 by @supersaloon in https://github.com/langgenius/dify/pull/6885 * fix: xinference reranker return_documents by @Weaxs in https://github.com/langgenius/dify/pull/6888 * Modify/modify jp doc by @HanqingZ in https://github.com/langgenius/dify/pull/6889 * delete weight_type in knowledge retrieval node by @JohnJyong in https://github.com/langgenius/dify/pull/6892 * fix tongyi tool calls by @Dofine-dufei in https://github.com/langgenius/dify/pull/6896 * pref: change ollama embedded api request by @greycodee in https://github.com/langgenius/dify/pull/6876 * fix score threshold limit be None by @JohnJyong in https://github.com/langgenius/dify/pull/6900 * feat: update llama3.1 parameters for openrouter by @sinomoe in https://github.com/langgenius/dify/pull/6901 * fix: multiple retrieval default weighted score by @zxhlyh in https://github.com/langgenius/dify/pull/6897 * fix: knowledge save button visible by @zxhlyh in https://github.com/langgenius/dify/pull/6905 * Fix: webapp color theme by @JzoNgKVO in https://github.com/langgenius/dify/pull/6908 * fix: code execution node not display clear reasons when sandbox res error by @hjlarry in https://github.com/langgenius/dify/pull/6830 * fix: return code in service api by @crazywoola in https://github.com/langgenius/dify/pull/6911 * dep: bump pgvecto-rs client from 0.1.x to 0.2.x by @bowenliang123 in https://github.com/langgenius/dify/pull/6891 * fix: system model setting missing space between buttons by @douxc in https://github.com/langgenius/dify/pull/6912 * fix: reranking disable timer error by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6910 * fix: default rerank model check by @zxhlyh in https://github.com/langgenius/dify/pull/6917 * fix(nodes/knowledge-retrieval): workflow knowledge retrieval rerank model check by @Kevin9703 in https://github.com/langgenius/dify/pull/6918 * fix update dataset failed when embedding model is not exist by @JohnJyong in https://github.com/langgenius/dify/pull/6920 * feat: add the tool Serper for Google search. (#6786) by @hwzhuhao in https://github.com/langgenius/dify/pull/6790 * add new provider Solar by @JuHyung-Son in https://github.com/langgenius/dify/pull/6884 * dep: support for Python 3.12 by @bowenliang123 in https://github.com/langgenius/dify/pull/6771 * fix: sending app trace data to other app trace provider by @takatost in https://github.com/langgenius/dify/pull/6931 * fix: workflow trace user_id error by @ZhouhaoJiang in https://github.com/langgenius/dify/pull/6932 * compatible xinference reranker server by @Weaxs in https://github.com/langgenius/dify/pull/6927 * Workflow TTS playback node filtering issue. by @ic-xu in https://github.com/langgenius/dify/pull/6877 * fix: import workflow errors by @crazywoola in https://github.com/langgenius/dify/pull/6937 * Fix increase_usage of total_price in agent_runner by @PedroGomes02 in https://github.com/langgenius/dify/pull/6688 * fix: restore xinference secret field by @liuzhenghua in https://github.com/langgenius/dify/pull/6941 * chore: fix markdown format and one typo by @alwqx in https://github.com/langgenius/dify/pull/6939 * fix: ensure db migration in docker entry script running with `upgrade-db` command for proper locking by @bowenliang123 in https://github.com/langgenius/dify/pull/6946 * Fix: tag & settings modal in dataset card in Firefox by @JzoNgKVO in https://github.com/langgenius/dify/pull/6953 * fix: The permissions issue of the editor role accessing some backend … by @liuzhenghua in https://github.com/langgenius/dify/pull/6945 * Fixed a bug where permission was clearly displaye… by @ChenZixinn in https://github.com/langgenius/dify/pull/6934 * chore: exclude .txt extenstion in create_by_text API by @gijigae in https://github.com/langgenius/dify/pull/6956 * chore: optimize streaming tts of xinference by @takatost in https://github.com/langgenius/dify/pull/6966 * chore: MAX_TREE_DEPTH spelling mistake by @quicksandznzn in https://github.com/langgenius/dify/pull/6965 * Revise the wrong pricing of certain LLM models. by @PedroGomes02 in https://github.com/langgenius/dify/pull/6967 * security: fix api image security issues by @takatost in https://github.com/langgenius/dify/pull/6971 * version to 0.6.16 by @takatost in https://github.com/langgenius/dify/pull/6972 * fix doc by @ArtificialZeng in https://github.com/langgenius/dify/pull/6974 * chore: update duckduckgo tool by @hjlarry in https://github.com/langgenius/dify/pull/6983 * feat:nvidia add nemotron4-340b and microsoft/phi-3 by @sulgweb in https://github.com/langgenius/dify/pull/6973 ## New Contributors * @YIXIAO0 made their first contribution in https://github.com/langgenius/dify/pull/6631 * @zhangzhiqiangcs made their first contribution in https://github.com/langgenius/dify/pull/6619 * @vicoooo26 made their first contribution in https://github.com/langgenius/dify/pull/6372 * @maybemaynot made their first contribution in https://github.com/langgenius/dify/pull/6656 * @Seayon made their first contribution in https://github.com/langgenius/dify/pull/6668 * @greycodee made their first contribution in https://github.com/langgenius/dify/pull/6465 * @Sakura4036 made their first contribution in https://github.com/langgenius/dify/pull/6677 * @Kevin9703 made their first contribution in https://github.com/langgenius/dify/pull/6697 * @HiroshigeAoki made their first contribution in https://github.com/langgenius/dify/pull/6723 * @VickyGuo0907 made their first contribution in https://github.com/langgenius/dify/pull/6747 * @wayneg123 made their first contribution in https://github.com/langgenius/dify/pull/6744 * @senseb made their first contribution in https://github.com/langgenius/dify/pull/6149 * @eric-0x72 made their first contribution in https://github.com/langgenius/dify/pull/6774 * @k-brahma made their first contribution in https://github.com/langgenius/dify/pull/6702 * @douxc made their first contribution in https://github.com/langgenius/dify/pull/6826 * @sulgweb made their first contribution in https://github.com/langgenius/dify/pull/6844 * @hursit made their first contribution in https://github.com/langgenius/dify/pull/6886 * @supersaloon made their first contribution in https://github.com/langgenius/dify/pull/6885 * @hwzhuhao made their first contribution in https://github.com/langgenius/dify/pull/6790 * @JuHyung-Son made their first contribution in https://github.com/langgenius/dify/pull/6884 * @PedroGomes02 made their first contribution in https://github.com/langgenius/dify/pull/6688 * @alwqx made their first contribution in https://github.com/langgenius/dify/pull/6939 * @ChenZixinn made their first contribution in https://github.com/langgenius/dify/pull/6934 * @ArtificialZeng made their first contribution in https://github.com/langgenius/dify/pull/6974 **Full Changelog**: https://github.com/langgenius/dify/compare/0.6.15...0.6.16