云日志服务 LTS-使用Flume采集器上报日志到LTS:通过Flume采集TCP/UDP协议传输的日志上报到LTS

时间:2025-02-12 15:14:38

通过Flume采集TCP/UDP协议传输的日志上报到LTS

通过Flume采集TCP/UDP协议传输的日志上报到LTS。以下示例中的参数介绍请参考使用KAFKA协议上报日志

  • 采集TCP端口日志,参考如下示例添加采集端口的conf文件。
    a1.sources = r1a1.sinks = k1a1.channels = c1a1.sources.r1.type = netcata1.sources.r1.bind = 0.0.0.0a1.sources.r1.port = {host_port}a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSinka1.sinks.k1.kafka.topic = ${logGroupId}_${logStreamId}a1.sinks.k1.kafka.bootstrap.servers = ${ip}:${port}a1.sinks.k1.kafka.producer.acks = 0a1.sinks.k1.kafka.producer.security.protocol = SASL_PLAINTEXTa1.sinks.k1.kafka.producer.sasl.mechanism = PLAINa1.sinks.k1.kafka.producer.compression.type = gzipa1.sinks.k1.kafka.producer.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="${projectId}" password="${accessKey}#${accessSecret}";a1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100a1.sources.r1.channels = c1a1.sinks.k1.channel = c1
  • 采集UDP端口日志,参考如下示例添加采集端口的conf文件。
    a1.sources = r1a1.sinks = k1a1.channels = c1a1.sources.r1.type = netcatudpa1.sources.r1.bind = 0.0.0.0a1.sources.r1.port = {host_port}a1.sinks.k1.type = org.apache.flume.sink.kafka.KafkaSinka1.sinks.k1.kafka.topic = ${logGroupId}_${logStreamId}a1.sinks.k1.kafka.bootstrap.servers = ${ip}:${port}a1.sinks.k1.kafka.producer.acks = 0a1.sinks.k1.kafka.producer.security.protocol = SASL_PLAINTEXTa1.sinks.k1.kafka.producer.sasl.mechanism = PLAINa1.sinks.k1.kafka.producer.compression.type = gzipa1.sinks.k1.kafka.producer.sasl.jaas.config=org.apache.kafka.common.security.plain.PlainLoginModule required username="${projectId}" password="${accessKey}#${accessSecret}";a1.channels.c1.type = memorya1.channels.c1.capacity = 1000a1.channels.c1.transactionCapacity = 100a1.sources.r1.channels = c1a1.sinks.k1.channel = c1
support.huaweicloud.com/bestpractice-lts/lts_07_1111.html