error opening a csv
Closed this issue · 3 comments
Hi! Thank you for this awesome tool! Looking forward to use it on a daily basis.
I got an error while opening a csv with big numbers (which are actually strings):
~/Desktop ❯ tw kbks.csv
Error: ComputeError(ErrString("could not parse `18210102010011000110` as dtype `i64` at column 'code' (column number 3)\n\nThe current offset in the file is 29 bytes.\n\nYou might want to try:\n- increasing `infer_schema_length` (e.g. `infer_schema_length=10000`),\n- specifying correct dtype with the `dtypes` argument\n- setting `ignore_errors` to `True`,\n- adding `18210102010011000110` to the `null_values` list.\n\nOriginal error: ```remaining bytes non-empty```"))
I guess this error is from polars that's trying to parse 18210102010011000110
as an i64 integer.
Attaching the problem file:
kbks.csv
The problem should be fixed in version 0.3.0.
However, in your case, you need to use --infer-schema no
to disable schema inference or --infer-schema safe
to make the operation safe.
Let me know if the problem is solved.
I'm not sure I got you right. Trying to do this in several ways, no luck:
~/projects/tochka/screpka/skrepka/taxcalc/tables beta *12 ❯ tw --infer-schema no kbks.csv
error: unexpected argument '--infer-schema' found
tip: to pass '--infer-schema' as a value, use '-- --infer-schema'
Usage: tw <FILE_NAME>
For more information, try '--help'.
~/projects/tochka/screpka/skrepka/taxcalc/tables beta *12 ❯ tw --infer-schema=no kbks.csv
error: unexpected argument '--infer-schema' found
tip: to pass '--infer-schema' as a value, use '-- --infer-schema'
Usage: tw <FILE_NAME>
For more information, try '--help'.
~/projects/tochka/screpka/skrepka/taxcalc/tables beta *12 ❯ tw -- --infer-schema=no kbks.csv
error: unexpected argument 'kbks.csv' found
Usage: tw <FILE_NAME>
For more information, try '--help'.
~/projects/tochka/screpka/skrepka/taxcalc/tables beta *12 ❯ tw kbks.csv -- --infer-schema=no
error: unexpected argument '--infer-schema=no' found
Usage: tw <FILE_NAME>
For more information, try '--help'.
~/projects/tochka/screpka/skrepka/taxcalc/tables beta *12 ❯ tw kbks.csv --infer-schema=no
error: unexpected argument '--infer-schema' found
tip: to pass '--infer-schema' as a value, use '-- --infer-schema'
Usage: tw <FILE_NAME>
For more information, try '--help'.
First, make sure you have the latest version of Tabiew installed:
tw --version
then, you may open kbks.csv
via the following commands:
tw kbks.csv --infer-schema no
and
tw kbks.csv --infer-schema safe
Let me know if the problem is solved.