taskmanager.numberOfTaskSlots doesn't work in YARN session
Opened this issue · 1 comments
spolex commented
When flink is started as ambari service (yarn session), the command will be launched without the -s parameter which was established in the log as taskmanager.numberOfTaskSlots:
Execute['export HADOOP_CONF_DIR=/etc/hadoop/conf; /opt/flink/bin/yarn-session.sh -n 10 -jm 1024 -tm 2048 -qu default -nm flinkapp-from-ambari -d -st >> /var/log/flink/flink-setup.log'] {'user': 'flink'}
It's wrong because it needs one container for each parallel task with this configuration and it can not change the number of slots.
jamesbenharris commented
I resolved this issue. It has been incorporated in the new version.