Cloud Stream Service (CS)

Cloud Stream Service (CS)

Cloud Stream Service (CS) provides full-stack capabilities for processing streaming data in real time. Compatible with Apache Flink and Spark APIs, CS fully hosts computing clusters, so you can run StreamSQL or custom jobs without learning any programming skills.

Cloud Stream Service (CS) provides full-stack capabilities for processing streaming data in real time. Compatible with Apache Flink and Spark APIs, CS fully hosts computing clusters, so you can run StreamSQL or custom jobs without learning any programming skills.

Product Advantages

Product Advantages

  • Easy to Use

    CS allows you to implement business logic by using StreamSQL statements. You only need to perform streaming data analysis without the need to manage clusters and learn programming skills.

  • Support of Exclusive Clusters

    You can run your jobs in a shared cluster or exclusive cluster. Exclusive clusters are physically isolated from shared clusters and other tenants' clusters. You can also manage the quota of exclusive clusters.

  • Pay per Use

    Pay only for what you actually use. When no jobs are running, you pay nothing.

  • High Throughput, Low Latency

    CS uses the Dataflow model of Apache Flink, a real-time computing framework. High-performance computing resources are used to consume data from your created Kafka, DMS Kafka, and MRS Kafka clusters. A single SPU processes 1,000 to 50,000 messages per second.

Application Scenarios

  • Real-time Stream Analysis

  • IoT

Real-time Stream Analysis

Real-time Stream Analysis

Real-time stream analysis features ease of use, low latency, and high throughput. It can be achieved based on StreamSQL and user-defined jobs.

Advantages

Easy to Use

Supports online StreamSQL statement editing and provides abundant SQL functions to meet complex service requirements.

Fully Managed

Computing clusters are fully managed by CS, enabling you to focus on stream analysis.

Pay per Use

SPU resources specified during job creation are charged by duration (unit: second).

Related Services

OBS

IoT

IoT

IoT or edge devices upload data to DIS. CS reads data from DIS, analyzes data (including fault detection and counter warning), and makes the analysis result persistent or reports alarms in real time.

Advantages

Abundant IoT SQL Functions

Provides common IoT functions such as area, yaw, and distance detection functions.

High Throughput, Low Latency

Leverages Apache Flink to achieve a complete real-time computing framework.

Secure Isolation

Isolates tenants from each other to ensure data security.

Related Services

OBS

Basic Functions

Basic Functions

  • StreamSQL Functions

    SQL is used to express the business logic. Aggregate functions, such as WINDOW and JOIN are supported.
    SQL is used to express the business logic. Aggregate functions, such as WINDOW and JOIN are supported.

  • High Throughput, Low Latency

    CS supports the backpressure mechanism, high throughput, and millisecond-level latency.
    CS supports the backpressure mechanism, high throughput, and millisecond-level latency.

  • Rock-solid Security

    Security protection mechanisms for tenants ensure operation security.
    Security protection mechanisms for tenants ensure operation security.

  • Distributed Real-time Computing

    Large-scale cluster computing and cluster auto scaling significantly reduce the cost.
    Large-scale cluster computing and cluster auto scaling significantly reduce the cost.

Features

Advanced Functions

Advanced Functions

  • StreamingML

    Adopts multiple streaming machine learning methods to analyze and predict data in real time. You only need to compile SQL statements to call related functions for data statistics, anomaly detection, real-time clustering, and time series analysis.
    Adopts multiple streaming machine learning methods to analyze and predict data in real time. You only need to compile SQL statements to call related functions for data statistics, anomaly detection, real-time clustering, and time series analysis.

  • Geographic Location Analysis

    Offers geographic location analysis functions to analyze geospatial data in real time, enabling you to fulfill yaw detection and geo-fencing using SQL statements.
    Offers geographic location analysis functions to analyze geospatial data in real time, enabling you to fulfill yaw detection and geo-fencing using SQL statements.

  • Pattern Matching

    Provides Match Recognize-based pattern matching and detection to assist business personnel in anomaly detection based on complex event rules. You can apply this function in various scenarios, such as fraud detection, abnormal vehicle behavior detection, and abnormal running status detection of industrial devices.
    Provides Match Recognize-based pattern matching and detection to assist business personnel in anomaly detection based on complex event rules. You can apply this function in various scenarios, such as fraud detection, abnormal vehicle behavior detection, and abnormal running status detection of industrial devices.

  • Visualization

    Works with charts of various types to display job output data in real time. You can directly use API Gateway to access job data as well as customize data to be visualized.
    Works with charts of various types to display job output data in real time. You can directly use API Gateway to access job data as well as customize data to be visualized.

Register with HUAWEI CLOUD to get free services

Register Now