New case study: Synchronizing Data from RDS for MySQL to Elasticsearch Through Logstash
By configuring the Logstash configuration file to define the JDBC input and Elasticsearch output, you can synchronize data from RDS for MySQL to Elasticsearch at specified intervals.
Elasticsearch supports offline creation of vector indexes
Where real-time data is not crucial, you can enable offline index creation to reduce the repeated creation of intermediate vector indexes, improving end-to-end write and index merging performance.
Elasticsearch supports vector search for nested fields
In Elasticsearch clusters, nested fields allow multiple vectorized records to be stored in a single document. For a document that contains multiple vector records, if the query vector matches any of them, the document is returned.
You can synchronize Elasticsearch alerts to Prometheus so you can use Prometheus to monitor the key performance metrics of Elasticsearch clusters in real time.
{"Compute":["Elastic Cloud Server","Huawei Cloud Flexus","Bare Metal Server","Auto Scaling","Image Management Service","Dedicated Host","FunctionGraph","Cloud Phone Host","Huawei Cloud EulerOS"],"Storage":["Object Storage Service","Elastic Volume Service","Cloud Backup and Recovery","Storage Disaster Recovery Service","Scalable File Service Turbo","Scalable File Service","Volume Backup Service","Cloud Server Backup Service","Data Express Service","Dedicated Distributed Storage Service"],"Networking":["Virtual Private Cloud","Elastic IP","Elastic Load Balance","NAT Gateway","Direct Connect","Virtual Private Network","VPC Endpoint","Cloud Connect","Enterprise Router","Enterprise Switch","Global Accelerator"],"Containers":["Cloud Container Engine","SoftWare Repository for Container","Application Service Mesh","Ubiquitous Cloud Native Service","Cloud Container Instance"],"Management & Governance":["Cloud Eye","Identity and Access Management","Cloud Trace Service","Resource Formation Service","Tag Management Service","Log Tank Service","Config","OneAccess","Resource Access Manager","Simple Message Notification","Application Performance Management","Application Operations Management","Organizations","Optimization Advisor","IAM Identity Center","Cloud Operations Center","Resource Governance Center"],"Databases":["Relational Database Service","Document Database Service","Data Admin Service","Data Replication Service","GeminiDB","GaussDB","Distributed Database Middleware","Database and Application Migration UGO","TaurusDB"],"Migration":["Server Migration Service","Object Storage Migration Service","Cloud Data Migration","Migration Center"],"Middleware":["Distributed Cache Service","API Gateway","Distributed Message Service for Kafka","Distributed Message Service for RabbitMQ","Distributed Message Service for RocketMQ","Cloud Service Engine","Multi-Site High Availability Service","EventGrid"],"Cloud Ecosystem":["KooGallery","Partner Center"],"Dedicated Cloud":["Dedicated Computing Cluster"],"User Support":["My Account","Billing Center","Cost Center","Resource Center","Enterprise Management","Service Tickets","HUAWEI CLOUD (International) FAQs"," ICP Filing","Support Plans","My Credentials","Customer Operation Capabilities","Partner Support Plans","Professional Services"],"Business Applications":["Workspace","ROMA Connect","Message & SMS","Domain Name Service","Edge Data Center Management","Meeting"],"Analytics":["MapReduce Service","Data Lake Insight","CloudTable Service","Cloud Search Service","Data Lake Visualization","Data Ingestion Service","GaussDB(DWS)","DataArts Studio","Data Lake Factory","DataArts Lake Formation"],"AI":["Face Recognition Service","Graph Engine Service","Content Moderation","Image Recognition","Optical Character Recognition","ModelArts","ImageSearch","Conversational Bot Service","Speech Interaction Service","Huawei HiLens","Video Intelligent Analysis Service"],"IoT":["IoT Device Access"],"Developer Tools":["SDK Developer Guide","API Request Signing Guide","Terraform","Koo Command Line Interface"],"Others":["Product Pricing Details","System Permissions","Console Quick Start","Common FAQs","Instructions for Associating with a HUAWEI CLOUD Partner","Message Center"],"Content Delivery & Edge Computing":["Content Delivery Network","Intelligent EdgeFabric","CloudPond","Intelligent EdgeCloud"],"Security & Compliance":["Security Technologies and Applications","Web Application Firewall","Host Security Service","Cloud Firewall","SecMaster","Anti-DDoS Service","Data Encryption Workshop","Database Security Service","Cloud Bastion Host","Data Security Center","Cloud Certificate Manager","Edge Security","Situation Awareness","Managed Threat Detection"],"Solutions":["SAP Cloud","High Performance Computing"],"Blockchain":["Blockchain Service","Web3 Node Engine Service"],"Developer Services":["ServiceStage","CodeArts","CodeArts PerfTest","CodeArts Req","CodeArts Pipeline","CodeArts Build","CodeArts Deploy","CodeArts Artifact","CodeArts TestPlan","CodeArts Check","CodeArts Repo","Cloud Application Engine"],"Media Services":["Media Processing Center","Video On Demand","Live","SparkRTC","MetaStudio"],"MacroVerse aPaaS":["KooMessage","KooPhone","KooDrive"]}
["Elastic Cloud Server","Huawei Cloud Flexus","Bare Metal Server","Auto Scaling","Image Management Service","Dedicated Host","FunctionGraph","Cloud Phone Host","Huawei Cloud EulerOS","Object Storage Service","Elastic Volume Service","Cloud Backup and Recovery","Storage Disaster Recovery Service","Scalable File Service Turbo","Scalable File Service","Volume Backup Service","Cloud Server Backup Service","Data Express Service","Dedicated Distributed Storage Service","Virtual Private Cloud","Elastic IP","Elastic Load Balance","NAT Gateway","Direct Connect","Virtual Private Network","VPC Endpoint","Cloud Connect","Enterprise Router","Enterprise Switch","Global Accelerator","Cloud Container Engine","SoftWare Repository for Container","Application Service Mesh","Ubiquitous Cloud Native Service","Cloud Container Instance","Cloud Eye","Identity and Access Management","Cloud Trace Service","Resource Formation Service","Tag Management Service","Log Tank Service","Config","OneAccess","Resource Access Manager","Simple Message Notification","Application Performance Management","Application Operations Management","Organizations","Optimization Advisor","IAM Identity Center","Cloud Operations Center","Resource Governance Center","Relational Database Service","Document Database Service","Data Admin Service","Data Replication Service","GeminiDB","GaussDB","Distributed Database Middleware","Database and Application Migration UGO","TaurusDB","Server Migration Service","Object Storage Migration Service","Cloud Data Migration","Migration Center","Distributed Cache Service","API Gateway","Distributed Message Service for Kafka","Distributed Message Service for RabbitMQ","Distributed Message Service for RocketMQ","Cloud Service Engine","Multi-Site High Availability Service","EventGrid","KooGallery","Partner Center","Dedicated Computing Cluster","My Account","Billing Center","Cost Center","Resource Center","Enterprise Management","Service Tickets","HUAWEI CLOUD (International) FAQs"," ICP Filing","Support Plans","My Credentials","Customer Operation Capabilities","Partner Support Plans","Professional Services","Workspace","ROMA Connect","Message & SMS","Domain Name Service","Edge Data Center Management","Meeting","MapReduce Service","Data Lake Insight","CloudTable Service","Cloud Search Service","Data Lake Visualization","Data Ingestion Service","GaussDB(DWS)","DataArts Studio","Data Lake Factory","DataArts Lake Formation","Face Recognition Service","Graph Engine Service","Content Moderation","Image Recognition","Optical Character Recognition","ModelArts","ImageSearch","Conversational Bot Service","Speech Interaction Service","Huawei HiLens","Video Intelligent Analysis Service","IoT Device Access","SDK Developer Guide","API Request Signing Guide","Terraform","Koo Command Line Interface","Product Pricing Details","System Permissions","Console Quick Start","Common FAQs","Instructions for Associating with a HUAWEI CLOUD Partner","Message Center","Content Delivery Network","Intelligent EdgeFabric","CloudPond","Intelligent EdgeCloud","Security Technologies and Applications","Web Application Firewall","Host Security Service","Cloud Firewall","SecMaster","Anti-DDoS Service","Data Encryption Workshop","Database Security Service","Cloud Bastion Host","Data Security Center","Cloud Certificate Manager","Edge Security","Situation Awareness","Managed Threat Detection","SAP Cloud","High Performance Computing","Blockchain Service","Web3 Node Engine Service","ServiceStage","CodeArts","CodeArts PerfTest","CodeArts Req","CodeArts Pipeline","CodeArts Build","CodeArts Deploy","CodeArts Artifact","CodeArts TestPlan","CodeArts Check","CodeArts Repo","Cloud Application Engine","Media Processing Center","Video On Demand","Live","SparkRTC","MetaStudio","KooMessage","KooPhone","KooDrive"]
3339
www.huaweicloud.com/intl/en-us/productfeature
[{"product":"Virtual Private Network","stage":"","functionName":"Gateways of the Professional 3 specification","onlineTime":"February,2025","description":"<p id=\"EN-US_TOPIC_0000001613896804__p078883611386\" data-hd-class=\"- topic/p \" data-hd-id=\"p078883611386\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001613896804\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"202506174729\">In S2C VPN, the specification Professional 3 is supported. A VPN gateway of this specification supports a maximum of 5 Gbit/s bandwidth.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/productdesc-vpn/vpn_01_0036.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/vpn.html","id":"6a1f1445-db8b-382f-8a8d-cefb432bd668","documentName":"Product specifications,","content":{"updatedAt":1738897041000},"btnLink":"https://support.huaweicloud.com/intl/en-us/productdesc-vpn/vpn_01_0036.html"},{"product":"Virtual Private Network","stage":"","functionName":"Specifying an IP address for a client","onlineTime":"February,2025","description":"<p id=\"EN-US_TOPIC_0000001613896804__p13390922496\" data-hd-class=\"- topic/p \" data-hd-id=\"p13390922496\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001613896804\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"202506174729\">P2C VPN allows users to assign a virtual IP address to a specific client.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00020.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/vpn.html","id":"5c237892-8245-37a9-9c0c-95487d984aac","documentName":"Creating a User and User Group,","content":{"updatedAt":1738896997000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00020.html"},{"product":"Virtual Private Network","stage":"","functionName":"Login and access audit","onlineTime":"February,2025","description":"<p id=\"EN-US_TOPIC_0000001613896804__p1493495112152\" data-hd-class=\"- topic/p \" data-hd-id=\"p1493495112152\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001613896804\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"202506174729\">P2C VPN allows users to query historical online and offline terminal information.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00033.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/vpn.html","id":"a8dc3d92-2aa0-3707-8c67-d059a20d445d","documentName":"Viewing VPN Connection Logs,","content":{"updatedAt":1738896987000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00033.html"},{"product":"Virtual Private Network","stage":"","functionName":"Connection management and proactive disconnection","onlineTime":"February,2025","description":"<p id=\"EN-US_TOPIC_0000001613896804__p67406541939\" data-hd-class=\"- topic/p \" data-hd-id=\"p67406541939\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001613896804\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"202506174729\">P2C VPN allows users to manage and proactively disconnect connections.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00032.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/vpn.html","id":"73533335-d61f-3488-af29-2e968e1394fd","documentName":"Tearing Down a VPN Connection,","content":{"updatedAt":1738896977000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-vpn/vpn_ug_p2c_00032.html"},{"product":"Virtual Private Network","stage":"","functionName":"IPsec negotiation failure logs","onlineTime":"February,2025","description":"<p id=\"EN-US_TOPIC_0000001613896804__p21888315418\" data-hd-class=\"- topic/p \" data-hd-id=\"p21888315418\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001613896804\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"202506174729\">S2C VPN allows users to view IPsec negotiation failure logs.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/trouble-vpn/vpn_touble_00001.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/vpn.html","id":"123f749b-8b3d-3510-84dd-18dd683d9f1f","documentName":"The State of a VPN Connection Is Not connected,","content":{"updatedAt":1738896964000},"btnLink":"https://support.huaweicloud.com/intl/en-us/trouble-vpn/vpn_touble_00001.html"},{"product":"Cloud Search Service","stage":"","functionName":"New case study: Synchronizing Data from RDS for MySQL to Elasticsearch Through Logstash","onlineTime":"January,2025","description":"<p id=\"EN-US_TOPIC_0000001981502797__p19586105513586\" data-hd-class=\"- topic/p \" data-hd-id=\"p19586105513586\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001981502797\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"205960160653\">By configuring the Logstash configuration file to define the JDBC input and Elasticsearch output, you can synchronize data from RDS for MySQL to Elasticsearch at specified intervals.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/bestpractice-css/css_07_0047.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/css.html","id":"9114fdc9-c1ba-35f0-b03c-69734e508c3a","documentName":"Synchronizing Data from RDS for MySQL to Elasticsearch Through Logstash,","content":{"updatedAt":1737965257000},"btnLink":"https://support.huaweicloud.com/intl/en-us/bestpractice-css/css_07_0047.html"},{"product":"Cloud Search Service","stage":"","functionName":"Elasticsearch supports offline creation of vector indexes","onlineTime":"January,2025","description":"<p id=\"EN-US_TOPIC_0000001981502797__p65852558580\" data-hd-class=\"- topic/p \" data-hd-id=\"p65852558580\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001981502797\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"205960160653\">Where real-time data is not crucial, you can enable offline index creation to reduce the repeated creation of intermediate vector indexes, improving end-to-end write and index merging performance.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0121.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/css.html","id":"84f42dd5-9a6b-3e1b-8129-9a6d85ce5b93","documentName":"Creating Vector Indexes in an Elasticsearch Cluster,","content":{"updatedAt":1737965253000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0121.html"},{"product":"Cloud Search Service","stage":"","functionName":"Elasticsearch supports vector search for nested fields","onlineTime":"January,2025","description":"<p id=\"EN-US_TOPIC_0000001981502797__p3898172017357\" data-hd-class=\"- topic/p \" data-hd-id=\"p3898172017357\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001981502797\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"205960160653\">In Elasticsearch clusters, nested fields allow multiple vectorized records to be stored in a single document. For a document that contains multiple vector records, if the query vector matches any of them, the document is returned.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0264.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/css.html","id":"3ebcbb8a-0b11-3707-91ac-d2a2b66e709a","documentName":"Using a Vector Index with Nested Fields,","content":{"updatedAt":1737965248000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0264.html"},{"product":"Cloud Search Service","stage":"","functionName":"Synchronizing Elasticsearch Alerts to Prometheus","onlineTime":"January,2025","description":"<p id=\"EN-US_TOPIC_0000001981502797__p25831455145810\" data-hd-class=\"- topic/p \" data-hd-id=\"p25831455145810\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001981502797\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"205960160653\">You can synchronize Elasticsearch alerts to Prometheus so you can use Prometheus to monitor the key performance metrics of Elasticsearch clusters in real time.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0219.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/css.html","id":"e3c6032d-8be1-3234-9efc-29265ba5bb07","documentName":"Synchronizing Elasticsearch Alerts to Prometheus,","content":{"updatedAt":1737965245000},"btnLink":"https://support.huaweicloud.com/intl/en-us/usermanual-css/css_01_0219.html"},{"product":"Cloud Search Service","stage":"","functionName":"New case study: Testing the Performance of CSS's Elasticsearch Vector Search","onlineTime":"January,2025","description":"<p id=\"EN-US_TOPIC_0000001981502797__p14587555205812\" data-hd-class=\"- topic/p \" data-hd-id=\"p14587555205812\" data-copy-enter=\"true\" data-copy=\"true\" data-topicnum=\"en-us_topic_0000001981502797\" data-lang=\"en-us\" data-multidtd=\"true\" data-dtdtype=\"topic\" data-projectid=\"205960160653\">Describes how to use open-source datasets and pressure testing tools to test the performance of CSS's Elasticsearch vector search engine.</p>","documentLink":"https://support.huaweicloud.com/intl/en-us/bestpractice-css/css_07_0050.html,","detailsLink":"https://www.huaweicloud.com/intl/en-us/product/css.html","id":"d13e60f0-18de-3b87-ab02-e452a711ee3c","documentName":"Testing the Performance of CSS's Elasticsearch Vector Search,","content":{"updatedAt":1737965202000},"btnLink":"https://support.huaweicloud.com/intl/en-us/bestpractice-css/css_07_0050.html"}]
