[Proposal] Use pickle instead of using serialized parameter
kitagry opened this issue · 1 comments
kitagry commented
Instead of serializing TaskParameter, how about making the task itself pickle to execute? I am thinking of the following execution procedure.
- Make the task into a pickle and save it in gokart's cache space. (Currently, the cache space should be shared between master and child jobs.)
- Specify the path to the pickle file in job's args and call it.
This should solve the following problems.
- The parameters to serialize are accurate.
- e.x) #8
- ParameterVisibility.PRIVATE params aren't serialized.
- The task itself does not need to be imported by a child job.