PositiveTechnologies/PT.PM

Optimize automatic language detection algorithm

KvanTTT opened this issue · 1 comments

Take a look on the following detections libs:

Also, it's possible to simplify the algorithm by considering only tokens stream without parsing.

It's especially actual for different SQL dialects (T-SQL, PL/SQL, MySql), because they have the same extensions.