GREP FOR OSINT

GREP FOR OSINT is a set of very simple shell scripts that will help you quickly analyze a text or a folder with files for data useful for investigation (phone numbers, bank card numbers, URLs, emails and nicknames).

Simply replace the text in the "text_for_analyze.txt" file with your text and run one of the .sh files whose name ends in "from_text".

For example:

bash Email_from_text.sh

Or replace the files in the "files_for_analyze" folder with your own and run one of the .sh files ending in "from_folder".

The result will be saved in a new text file with an appropriate name (for example, result_email_from_text_2021.08.01-16.47.52).

In files tags_content_from_folder.sh, tags_content_from_html.sh, Keyword_from_folder.sh, Keyword_from_text.sh you don't have to change anything. You can just run them and enter the desired values directly into the command line after a prompt from the script.

Warning

With large amounts of text the grep command can take a very, very long time.

It's possible to use this tool for analyze html files from WayBack Machine (web.archive.org):

Make sure you have Python installed on your computer or install it.

Next launch pip install waybackpack

Get list of website's saved pages: waybackpack http://litsey623.ru/ --list

Download pages version, saved during period between 2010-2011

waybackpack http://litsey623.ru/ -d files_for_analyze --from-date 2010 --to-date 2011

For extracting emails from saved pages launch:

bash Email_from_folder.sh

View file:

result_email_from_folder_(current_date).txt

(Analogously, it is possible to extract keywords, phone numbers, URL etc)

GREP Alternatives

Regular expressions from the scripts in this repository can also be used with various GREP modifications. Some of them can be found in this list:

https://github.com/cipher387/awesome-grep

Thank you for following me! @cyb_detective

cipher387/grep_for_osint

GREP FOR OSINT

GREP Alternatives