Code corresponding to task 6 are in main.py. As 1Tb file is to big to be read fully. main function has parameter that sets up the max number of lines to read.
The result for first part of this task is in confident_intervals.csv.
The result for second task in check_index_test_equal.txt
make_log.py makes random log.txt file.