Support Multiple Column Selection for Scrubbing

Question

wasciutto opened this issue a year ago · 4 comments

Scrubbing can only be done on one column currently - should support a list where the user can give multiple columns to be scrubbed.

This should work in conjunction with #385 , where wildcarded column names are valid in the list.

Answer 1 · 2023-07-11T17:30:54.000Z

Write workflow to use MapNode and Reduce, if it still makes sense

Answer 2 · 2023-07-25T17:37:45.000Z

Convert test to use workflow over individual nodes
Change output array from reducer to be integer 1s/0s over boolean
Integrate workflow with overall pipeline
Ensure test test_build_postprocessing_workflow_scrub has the scrub vector workflow at top of graph before image and confounds wf

Answer 3 · 2023-08-08T17:30:36.000Z

Note - we need to handle the insertNA case. Have multiple scrub profiles doesn't make this easy, probably better to remove?

Answer 4 · 2023-08-08T17:36:59.000Z

Update to above - we will use strategy of changing scrub options back to dict instead of array and put the column selection in its own list