mesos/kafka

Cannot start broker

Closed this issue · 2 comments

cmgc commented

When scheduler receives the offer and tries to start broker it fails because of 'Task uses more resources'
But from log we see that we have a lot of resources to start task. So it doesn't make sense.

2015-08-28 10:29:47,981 [Thread-172] INFO  ly.stealth.mesos.kafka.Scheduler$  - Starting broker 0: launching task broker-0-2e3609cb-165e-4716-89a7-7b6e3195d582 by offer host-15#O2438
 broker-0-2e3609cb-165e-4716-89a7-7b6e3195d582 slave:#1-S49 cpus:1.00 mem:2048.00 ports:[20202..20202] data:defaults=broker.id\=0\,log.dirs\=kafka-logs\,port\=20202\,zookeeper.connect\=<zookeeper host here>:2181\,host.name\=host-15\,log.retention.bytes\=10737418240,broker={"stickiness" : {"period" : "10m"}\, "id" : "0"\, "port" : "20202"\, "constraints" : "hostname\=like:host-15"\, "mem" : 2048\, "cpus" : 1.0\, "heap" : 1024\, "failover" : {"delay" : "1m"\, "maxDelay" : "10m"}\, "active" : true}

2015-08-28 10:29:48,000 [Thread-174] INFO  ly.stealth.mesos.kafka.Scheduler$  - [statusUpdate] broker-0-2e3609cb-165e-4716-89a7-7b6e3195d582 TASK_ERROR slave:#1-S49 reason:REASON_TASK_INVALID message:Task uses more resources cpus(*):1; mem(*):2048; ports(*):[20202-20202] than available cpus(big):40; mem(big):63027; disk(big):3.34156e+07; ports(big):[1-21, 23-5050, 5052-65535]
2015-08-28 10:29:48,000 [Thread-174] INFO  ly.stealth.mesos.kafka.Scheduler$  - Broker 0 failed 1, waiting 1m, next start ~ 2015-08-28 10:30:48Z

Hi @cmgc can you please do 2 things:

  1. post here also log statement containing the offer coming to Scheduler;
  2. try to use latest build from master (similar issue with resources has already been fixed, but not released yet).
cmgc commented

The next build works without this issue. Thank you.