kafka 基本操作

kafka

1. kafka操作

1.1 创建主题

bin/kafka-topics.sh --create --zookeeper 124.232.152.11:2181,124.232.152.11:2181 --replication-factor 2 --partitions 1 --topic keyword
bin/kafka-topics.sh --create --zookeeper 124.232.152.11:2181,124.232.152.11:2181 --replication-factor 2 --partitions 1 --topic url
bin/kafka-topics.sh --create --zookeeper 124.232.152.11:2181,124.232.152.11:2181 --replication-factor 2 --partitions 1 --topic crawler
bin/kafka-topics.sh --create --zookeeper 124.232.152.11:2181,124.232.152.11:2181 --replication-factor 2 --partitions 1 --topic analysis
bin/kafka-topics.sh --create --zookeeper 124.232.152.11:2181,124.232.152.11:2181 --replication-factor 2 --partitions 1 --topic urlfilter

1.2 查看创建的主题

bin/kafka-topics.sh --list --zookeeper 124.232.152.11:2181,124.232.152.11:2181

1.3 后台启动

bin/kafka-server-start.sh -daemon config/server.properties

1.4 消费主题

bin/kafka-console-consumer.sh --zookeeper 124.232.152.12:2181,124.232.152.12:2181 --topic keyword --from-beginning

1.5 查看主题

bin/kafka-topics.sh --describe --zookeeper 124.232.152.12:2181,124.232.152.12:2181 --topic keyword

1.6修改主题

bin/kafka-topics.sh --zookeeper 124.232.152.12:2181,124.232.152.12:2181 --alter --topic keyword --partitions 10

2. linux 系统设置

2.1 centos7 防火墙关闭

systemctl stop firewalld.service #停止firewall
systemctl disable firewalld.service #禁止firewall开机启动

2.2 在防火墙下开放某个端口

firewall-cmd --query-port=80/tcp # 如要查询是否开启80端口
firewall-cmd --add-port=80/tcp # 开启80端口