Implement preprocessor for SQL analysis and conversion
Closed this issue · 0 comments
shinsa82 commented
Before analysis, DOA first performs the following preprocessing to each input file:
- Convert its encoding to UTF-8 using
nkf
. - Convert line break to Unix style (
\n
) usingnkf
. - Convert alphabets to uppercase using
tr
.