Logagent Plugin: Apache Kafka

Input plugin for @sematext/logagent. The plugin acts as message consumer for Apache Kafka.

Installation

Install @sematext/logagent and logagent-input-kafka npm package:

npm i -g @sematext/logagent 
npm i -g logagent-input-kafka

Configuration

# Global options
options:
  includeOriginalLine: false

input:
  kafka: 
    module: logagent-input-kafka
    host: localhost
    port: 9093
    groupId: ExampleTestGroup
    topic: test
    autoCommit: true
    sessionTimeout: 15000
    sslEnable: false
    #For init sslOptions please refer to to https://nodejs.org/api/tls.html
    sslOptions: 
      - rejectUnauthorized: false
    
output:
  stdout: yaml # use 'pretty' for pretty json and 'ldjson' for line delimited json (default)
  elasticsearch: 
    module: elasticsearch
    url: http://localhost:9200
    index: test

Start logagent

logagent --config logagent-kafka-input.yaml

Contributions

Original author: Filippo Balicchia logagent-js PR#75 PR#77 PR#81