/distinct

Filter duplicate lines from streaming data. Or just do `awk '!x[$0]++'`

Primary LanguageGo

Distinct is a command line tool for filtering duplicate lines from streaming data. The input data does not need to be sorted, but memory consumption is proportional to the cardinality of unique lines.