我想从容器 A 生成消息到容器 B 中的 Kafka 主题,但我在这些容器的网络方面遇到了一些奇怪的问题。 您知道如何以正确的方式连接这些容器吗? 问题是收集器服务无法从其他容器看到kafka,也无法向其中添加消息。 更具体地说,我有以下服务:
docker-compose.yml
version: '3.5'
services:
zookeeper:
image: confluentinc/cp-zookeeper:latest
ports:
- "2181:2181"
environment:
ZOOKEEPER_CLIENT_PORT: 2181
ZOOKEEPER_TICK_TIME: 2000
ADVERTISED_HOST: zookeeper
ADVERTISED_PORT: 2181
extra_hosts:
- "moby:127.0.0.1"
networks:
- meetup-net
kafka:
image: confluentinc/cp-kafka:latest
depends_on:
- zookeeper
ports:
- "9092:9092"
environment:
KAFKA_BROKER_ID: 1
KAFKA_ZOOKEEPER_CONNECT: zookeeper:2181
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092
KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
extra_hosts:
- "moby:127.0.0.1"
networks:
- meetup-net
collector:
image: collector:v1
environment:
- kafka-bootstrap-servers=docker_kafka_1.docker_meetup-net
restart: always
depends_on:
- kafka
networks:
- meetup-net
networks:
meetup-net:
driver: bridge
在另一边我有 application.conf 文件
streaming {
window-size = 50
window-interval = 5
kafka-bootstrap-servers = ${?kafka-bootstrap-servers}
kafka-bootstrap-servers = "localhost:9092"
sink-topic = ${?source-topic}
sink-topic = "meetup"
key-value-json-path = ${key-value-json-path}
key-value-json-path = "./data/keyvalue"
source-topic-checkpoint-location = ${source-topic-checkpoint-location}
source-topic-checkpoint-location = "./target/source-topic"
sink-topic-checkpoint-location = ${sink-topic-checkpoint-location}
sink-topic-checkpoint-location = "./target/sink-topic"
}
zookeeper.server = ${?zookeeper-server}
zookeeper.server = "localhost:2181"
您需要正确设置
KAFKA_ADVERTISED_LISTENERS
。
目前
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://localhost:9092
意味着任何连接到代理的客户端都将获得 localhost
作为连接后续请求的代理地址。
除非客户端在代理上运行(它不在这里),那么您需要更改此配置。对于在独立的 Docker 环境中运行来说,这很简单:
KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://kafka:29092,PLAINTEXT_HOST://localhost:9092
现在任何客户端连接都应该是
kafka:29092
。这也意味着您可以将在 Docker 主机上运行的客户端连接到 Kafka 代理,这可能很有用,例如在笔记本电脑上运行并在本地运行客户端时。
这里