Paleozoic/storm_spring_boot_demo

提交集群出现错误Topic '[stormTest]' is invalid

sniperXue opened this issue · 1 comments

sniperXue commented

  1. 问题：Unable to get offset lags for kafka. Reason: org.apache.kafka.shaded.common.errors.InvalidTopicException: Topic '[stormTest]' is invalid

  2. 错误日志
    2019-02-19 04:48:02,515:INFO main (StormSubmitter.java:478) - Uploading topology jar /data/StormDemo.jar to assigned location: /data/nimbus/inbox/stormjar-94cda9c9-2e09-4401-84b5-8c3a3b79ae26.jar
    2019-02-19 04:48:04,053:INFO main (StormSubmitter.java:503) - Successfully uploaded topology jar to assigned location: /data/nimbus/inbox/stormjar-94cda9c9-2e09-4401-84b5-8c3a3b79ae26.jar
    2019-02-19 04:48:14,922:INFO main (AbstractApplicationContext.java:987) - Closing org.springframework.context.annotation.AnnotationConfigApplicationContext@7946e1f4: startup date [Tue Feb 19 04:47:31 GMT 2019]; root of context hierarchy
    2019-02-19 04:48:14,940:INFO main (DefaultLifecycleProcessor.java:358) - Stopping beans in phase 2147483647
    2019-02-19 04:48:14,951:INFO main (DefaultLifecycleProcessor.java:358) - Stopping beans in phase 0
    2019-02-19 04:48:14,954:INFO main (MBeanExporter.java:449) - Unregistering JMX-exposed beans on shutdown
    2019-02-19 04:48:14,956:WARN main (DisposableBeanAdapter.java:374) - Invocation of destroy method 'close' failed on bean with name 'kafkaSpout': java.lang.NullPointerException
    2019-02-19 04:48:14,961:WARN main (DisposableBeanAdapter.java:374) - Invocation of destroy method 'close' failed on bean with name 'kafkaClientSpout': java.lang.NullPointerException
    2019-02-19 04:48:14,973:INFO main (ExecutorConfigurationSupport.java:203) - Shutting down ExecutorService

  3. 自己的docker-compose.yml
    kafka1:
    image: wurstmeister/kafka

    restart: always

    container_name: kafka1
    ports:

    • "9092:9092"
      depends_on:
    • zoo1
    • zoo2
    • zoo3
      links:
    • zoo1
    • zoo2
    • zoo3
      environment:
      KAFKA_LOG_DIRS: /kafka
      KAFKA_BROKER_ID: 1
      KAFKA_CREATE_TOPICS: stormTest:3:2,order-info-topic-1:1:2,order-info-topic-2:1:2,order-info-topic-3:1:2,msgTopic1:1:2,msgTopic2:1:2
      KAFKA_HOST_NAME: kafka1
      KAFKA_ADVERTISED_HOST_NAME: 192.168.1.101
      KAFKA_ADVERTISED_PORT: 9092
      KAFKA_LOG_RETENTION_HOURS: "168"
      KAFKA_LOG_RETENTION_BYTES: "100000000"
      KAFKA_ZOOKEEPER_CONNECT: zoo1:2181,zoo2:2182,zoo3:2183
      KAFKA_DELETE_TOPIC_ENABLE: "true"
      volumes:
Paleozoic commented

熊得……你贴这一坨日志给我。。。。
看日志是 kafkaClientSpout报java.lang.NullPointerException，你本地单机调试是否成功？
kafkaClientSpout对象是否成功初始化了？
Kafka和Storm版本和我原来的demo是否一致？如果升级了，不排除部分API的改变，可以review demo源码做一定修改。