Kafka bitnami/kafka:3.4 트러블슈팅

참고사이트

https://github.com/bitnami/containers/issues/31789

 

발생

아래와 같은 kafka 세팅으로 실행 시, 에러발생

kafka:
    image: 'bitnami/kafka:3.4.0'
    networks:
      - fastcampuspay_network
    ports:
      - '9092:9092'
    environment:
      - KAFKA_BROKER_ID=1
      - KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper:2181
      - ALLOW_PLAINTEXT_LISTENER=yes
      - KAFKA_CFG_LISTENERS=LC://kafka:29092,LX://kafka:9092
      - KAFKA_CFG_ADVERTISED_LISTENERS=LC://kafka:29092,LX://${DOCKER_HOST_IP:-localhost}:9092
      - KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=LC:PLAINTEXT,LX:PLAINTEXT
      - KAFKA_CFG_INTER_BROKER_LISTENER_NAME=LC
    depends_on:
      - zookeeper
      
      
      
-- 에러 

2023-12-31 20:26:21 kafka 11:26:21.75 
2023-12-31 20:26:21 kafka 11:26:21.75 Welcome to the Bitnami kafka container
2023-12-31 20:26:21 kafka 11:26:21.75 Subscribe to project updates by watching https://github.com/bitnami/containers
2023-12-31 20:26:21 kafka 11:26:21.75 Submit issues and feature requests at https://github.com/bitnami/containers/issues
2023-12-31 20:26:21 kafka 11:26:21.76 
2023-12-31 20:26:21 kafka 11:26:21.76 INFO  ==> ** Starting Kafka setup **
2023-12-31 20:26:21 kafka 11:26:21.87 WARN  ==> KAFKA_CFG_LISTENERS must include a listener for CONTROLLER
2023-12-31 20:26:21 kafka 11:26:21.88 WARN  ==> You set the environment variable ALLOW_PLAINTEXT_LISTENER=yes. For safety reasons, do not use this flag in a production environment.
2023-12-31 20:26:21 kafka 11:26:21.89 INFO  ==> Initializing Kafka...
2023-12-31 20:26:21 kafka 11:26:21.90 INFO  ==> No injected configuration files found, creating default config files
2023-12-31 20:26:22 kafka 11:26:22.26 INFO  ==> Initializing KRaft...
2023-12-31 20:26:22 kafka 11:26:22.26 WARN  ==> KAFKA_KRAFT_CLUSTER_ID not set - If using multiple nodes then you must use the same Cluster ID for each one
2023-12-31 20:26:24 kafka 11:26:24.92 INFO  ==> Generated Kafka cluster ID '1yevGD-aRYGt_4zG69Eekw'
2023-12-31 20:26:24 kafka 11:26:24.92 INFO  ==> Formatting storage directories to add metadata...

 

원인

-> For those that aren't pinning the -debian-11-r.. tags, and instead using latest or just :3.x... Kraft mode is now the default. open the container to be accessed from the host, you must add CONTROLLER listener

 

 

해결

아래와 같이 수정

  kafka:
    image: 'bitnami/kafka:3.4.0'
    networks:
      - fastcampuspay_network
    ports:
      - '9092:9092'
    environment:
      - KAFKA_CFG_CONTROLLER_LISTENER_NAMES= CONTROLLER
      - KAFKA_BROKER_ID=1
      - KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper:2181
      - ALLOW_PLAINTEXT_LISTENER=yes
      - KAFKA_CFG_LISTENERS= PLAINTEXT://:29092,PLAINTEXT_HOST://0.0.0.0:9092,CONTROLLER://:9093
      - KAFKA_CFG_ADVERTISED_LISTENERS= PLAINTEXT://kafka:29092,PLAINTEXT_HOST://localhost:9092
      - KAFKA_CFG_LISTENER_SECURITY_PROTOCOL_MAP=PLAINTEXT:PLAINTEXT,PLAINTEXT_HOST:PLAINTEXT,CONTROLLER:PLAINTEXT
      -  KAFKA_CFG_INTER_BROKER_LISTENER_NAME= PLAINTEXT
      - KAFKA_KRAFT_MODE=BASIC
    depends_on:
      - zookeeper

 

 

 

참고 사이트 캡쳐