Fake Apache Log Generator

This script generates a boatload of fake apache logs very quickly. Its useful for generating fake workloads for data ingest and/or analytics applications.

It can write log lines to console, to log files or directly to gzip files.

It utilizes the excellent Faker library to generate realistic ip's, URI's etc.

Basic Usage

Generate a single log line to STDOUT

$ python apache-fake-log-gen.py

Generate 100 log lines into a .log file

$ python apache-fake-log-gen.py -n 100 -o LOG

Generate 100 log lines into a .gz file at intervals of 10 seconds

$ python apache-fake-log-gen.py -n 100 -o GZ -s 10

Infinite log file generation (useful for testing File Tail Readers)

$ python apache-fake-log-gen.py -n 0 -o LOG

Prefix the output filename

$ python apache-fake-log-gen.py -n 100 -o LOG -p WEB1

Detailed help

$ python apache-fake-log-gen.py -h
usage: apache-fake-log-gen.py [-h] [--output {LOG,GZ,CONSOLE}]
                              [--num NUM_LINES] [--prefix FILE_PREFIX]
                              [--sleep SLEEP]

Fake Apache Log Generator

optional arguments:
  -h, --help            show this help message and exit
  --output {LOG,GZ,CONSOLE}, -o {LOG,GZ,CONSOLE}
                        Write to a Log file, a gzip file or to STDOUT
  --num NUM_LINES, -n NUM_LINES
                        Number of lines to generate (0 for infinite)
  --prefix FILE_PREFIX, -p FILE_PREFIX
                        Prefix the output file name
  --sleep SLEEP, -s SLEEP
                        Sleep this long between lines (in seconds)

Requirements

Python 2.7
pip install -r requirements.txt

Docker Usage

docker run -it kununu/Fake-Apache-Log-Generator

Environment variables:

NUM_LINES number of lines to print before terminate (default: 0 - infinite)
DELAY_SECONDS delay between lines (default: 1.0 seconds)

License

This script is released under the Apache version 2 license.