som-shahlab/femr

Allow delimiter specification in ETLs

guolin1 opened this issue · 0 comments

Is your feature request related to a problem? Please describe.
Currently the ETLs (e.g., piton.extractors.csv.run_csv_extractors() and PatientCollection.to_patient_database()) require fields in files to be separated by commas. In some cases (e.g., SK OMOP and vocabulary CSVs downloaded from Athena) fields are separated by tabs.

Describe the solution you'd like
Allow users to specify delimiters in the methods above.

Describe alternatives you've considered
Replace tab delimiters in files with comma delimiters, but seems unnecessary.