Kafka Archives - Simon Technology Blog

Windows Configures Kafka Environment (depending on ZooKeeper, Kafka built-in)

说明：
kafka依赖java环境，需要先安装jdk并在cmd中运行java -version 能够正常显示java版本号

1.下载kafka (版本:kafka_2.12-2.3.0):
http://kafka.apache.org/downloads.html

2.解压后修改zookeeper配置文件: kafka_2.12-2.3.0\config\zookeeper.

October 19, 2021By Simo Windows built-in, configuration, dependence, environment, Kafka, windows, ZookeeperLeave a Comment

ZooKeeper + Kafka Cluster

ZooKeeper is a distributed, open source distributed application coordination service, an open source implementation of Google’s Chubby, and an important component of Hadoop and Hbase. It is a softw

October 14, 2021By Simo ZooKeeper cluster, construction, Kafka, Zookeeper, Zookeeper + KafkaLeave a Comment

ELK + Zookeeper + Kafka Collect SpringCould log configuration documentation

####
####
####

This article introduces the use of ELK (elasticsearch, logstash, kibana) + 　kafka to build a logging system. The main demonstration is to use spring aop to collect logs, and

October 14, 2021By Simo ZooKeeper collection, configuration, Document, Elk, Elk + Zookeeper + Kafka, Kafka, log, Springcould, ZookeeperLeave a Comment

Spark Streaming + Kafka

1. Summarize some concepts:

Install zookeeper 3.4.6

cp zoo_sample.cfg zoo.cfg
vim zoo.cfg tickTime=2000
initLimit=10
syncLimit=5
dataDir=/opt /software/zookeeper-3.4.6/data
dataLogDir=/

October 14, 2021By Simo ZooKeeper Kafka, Spark Streaming, Spark Streaming + KafkaLeave a Comment

ZooKeeper is built with Kafka cluster

First of all, this blog doesn’t have any theoretical stuff, it just explains in detail the process of setting up a cluster of kafka and zookeeper, which requires three linux servers.

Java env

October 14, 2021By Simo ZooKeeper cluster, construction, Kafka, ZookeeperLeave a Comment