Solution Overview
This solution helps you rapidly deploy both standalone and high-availability versions of Dify, while also supporting the mounting of document knowledge bases created on the Dify platform to Huawei Cloud Object Storage Service (OBS) buckets. Dify is an open-source large language model (LLM) application development platform. It integrates the concepts of backend as a service (BaaS) and LLMOps, enabling you to quickly build production-level generative AI applications.
Solution Architecture
This solution is built on CCE for fast deployment of the highly available Dify platform, an LLM application development environment.
Building a Dify-LLM Application Development Platform
Version: 2.0.0
Last Updated: May 2025
Built By: Huawei Cloud
Time Required for Deployment: About 20 minutes
Time Required for Uninstallation: About 10 minutes
Solution Description
Single-cloud server deployment:
1. This solution will create one Huawei Cloud Flexus X Instance (FlexusX) to set up the Dify platform.
2. This solution will create one EIP and associate it with the FlexusX to enable Internet access and accessibility from the Internet.
3. This solution will create one security group with specified rules to protect cloud servers.
HA deployment in CCE container:
1. This solution will create three EIPs to enable access to and from the Internet.
2. This solution will create one ELB and associate an EIP with it to automatically distribute access traffic to various backend services. This enhances the external service capabilities of the application system and achieves robust application fault tolerance.
3. This solution will create one NAT gateway and bind an EIP to it. Add SNAT rules to let all instances in a private subnet connect outbound to the Internet while remaining fully private.
4. This solution will create three FlexusX instances for deploying five core Dify plug-ins.
5. This solution will create one CCE Turbo cluster, create a node pool, and manage the three FlexusX instances as nodes in the cluster.
6. This solution will create one FlexusX to deploy the Embedding (bge-m3) and Reranker (bge-reranker-v2-m3) models.
7. This solution will use OBS to mount the Dify knowledge base to the OBS bucket.
8. This solution will create one Distributed Cache Service (DCS) for Redis®* instance that is compatible with Redis, providing you with high-performance, cost-effective NoSQL databases while ensuring data consistency during data circulation.
9. This solution will create one RDS for PostgreSQL instance with primary/standby deployment across AZs to ensure disaster recovery capabilities.
10. This solution will create one CSS OpenSearch cluster to provide functions such as online distributed search and semantic search.
11. This solution will create four security groups with specified rules to protect cloud services.
Solution Description
Single-cloud server deployment:
1. This solution will create one Huawei Cloud Flexus X Instance (FlexusX) to set up the Dify platform.
2. This solution will create one EIP and associate it with the FlexusX to enable Internet access and accessibility from the Internet.
3. This solution will create one security group with specified rules to protect cloud servers.
HA deployment in CCE container:
1. This solution will create three EIPs to enable access to and from the Internet.
2. This solution will create one ELB and associate an EIP with it to automatically distribute access traffic to various backend services. This enhances the external service capabilities of the application system and achieves robust application fault tolerance.
3. This solution will create one NAT gateway and bind an EIP to it. Add SNAT rules to let all instances in a private subnet connect outbound to the Internet while remaining fully private.
4. This solution will create three FlexusX instances for deploying five core Dify plug-ins.
5. This solution will create one CCE Turbo cluster, create a node pool, and manage the three FlexusX instances as nodes in the cluster.
6. This solution will create one FlexusX to deploy the Embedding (bge-m3) and Reranker (bge-reranker-v2-m3) models.
7. This solution will use OBS to mount the Dify knowledge base to the OBS bucket.
8. This solution will create one Distributed Cache Service (DCS) for Redis®* instance that is compatible with Redis, providing you with high-performance, cost-effective NoSQL databases while ensuring data consistency during data circulation.
9. This solution will create one RDS for PostgreSQL instance with primary/standby deployment across AZs to ensure disaster recovery capabilities.
10. This solution will create one CSS OpenSearch cluster to provide functions such as online distributed search and semantic search.
11. This solution will create four security groups with specified rules to protect cloud services.