Consistent variable reference across all spark scripts.
Closed this issue · 1 comments
ashishgupta-in commented
Hey !
I found that in some of the spark scripts, the variables for input & output is specified as input_path & output_path respectively.
Whereas, for some it is INPUT_PATH & OUTPUT_PATH.
Please make it consistent as the lambda handler function is setting the system environment variable using os.environ as INPUT_PATH & OUTPUT_PATH. It is resulting in errors while testing with the sample scripts under spark scripts folder.
JohnChe88 commented
@ashishgupta-in Sure, INPUT_PATH & OUTPUT_PATH is supposed to be set an evironment variable. in AWS Lambda. We will fix it part of the release 0.4.0