hortonworks/hive-testbench

hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists

powerLambda opened this issue · 4 comments

powerLambda commented

failed to execute tpch-setup.sh in hive2.3.5, hadoop2.8.5

DEBUG_SCRIPT=ON FORMAT=textfile ./tpch-setup.sh 100 /data
Logging initialized using configuration in file:/usr/local/service/hive/conf/hive-log4j2.properties Async: true
Query returned non-zero code: 1, cause: hive configuration hive.optimize.sort.dynamic.partition.threshold does not exists.

p-forest commented

which file to configure the item and a valid value? i have no idea.

lyzGithub commented

you can modify the setting sql in the settings/load-flat.sql

herrytco commented

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

  • 👍2
  • 🎉1
davi16sm commented

I had the same issue, my Hive version did not support the setting configuration hive.optimize.sort.dynamic.partition.threshold. In the file settings/load-flat.sql, I changed the line

set hive.optimize.sort.dynamic.partition.threshold=0;

to

set hive.optimize.sort.dynamic.partition=true;

which fixed the issue

Great! This fix the issue!!