DEV Community

Cover image for Apache Log Parser and Data Normalization Application
Will Raymond
Will Raymond

Posted on • Edited on

Apache Log Parser and Data Normalization Application

Python handles File Processing & MySQL handles Data Processing

ApacheLogs2MySQL consists of two Python Modules & one MySQL Schema to automate importing Access & Error files and normalizing data into database designed for reports & data analysis.

Runs on Windows, Linux and MacOS & tested with MySQL versions 8.0.39, 8.4.3, 9.0.0 & 9.1.0.

4 LogFormats & 2 ErrorLogFormats can be loaded and 5 MySQL Stored Procedures can be processed in a single Python ProcessLogs function execution.

Database system designed to accommodate unlimited Domains from unlimited Servers. Step-by-step guide for easy installation.

Web interface with Drill Down Capability and apache/echarts Log Visualization integration in development.

https://github.com/WillTheFarmer/apache-logs-to-mysql

Top comments (0)