Information Retrieval Assignment - tokenizing, stopping, stemming
to use:
- download all files in one directory
- begin by compiling tokenizer.java ($ javac tokenizer.java)
- now run the tokenizer ($ java tokenizer)
- instructions will appear via println statments onto your terminal
hint: the text file to be examined is hard-coded into tokenizer.java