flm

fake log maker

This script will generate a list of random urls, a list of random ip address and time stamps.

The goal is to demonstrate that such data don't take much space to store.

You might need to install pip install humanfriendly

The output will look like that:

log lines: 2000000
original size: 109.12 MB
bz2 size: 16.05 MB
gzip size: 28.84 MB
zlib size: 29.7 MB

The script will also generate a log.txt file

You can try differents settings by simply updating the code:

population = 10000

loglines = 2000000

lines_per_minute = 5

domain_count = 120
page_per_domain_min = 3
page_per_domain_max = 13