/datax-on-yarn

实现yarn客户端,datax-on-yarn可以让datax在yarn master上运行

Primary LanguageJava

datax-on-yarn

datax-on-yarn可以让datax在yarn master上运行

  • datax_home_hdfs datax在hdfs的安装包
  • datax_job 配置json
  • master_memory内存为datax实际使用内存
  • yarn master内存内置128m(一般不需要修改)
yarn jar /code/datax-on-yarn-1.0.0.jar com.on.yarn.Client \
  -jar_path /code/datax-on-yarn-1.0.0.jar \
  -appname DemoApp \
  -master_memory 1024 \
  -queue default \
  -datax_job /code/orcfile_none.json \
  -datax_home_hdfs /datax/datax.tar.gz