Week 12

Final week!

This week has been dedicated to code cleaning and documentation.

Working on this project has been a great learning and professional experience. Up to date, this internship is the most valuable professional experience I have ever had.

This work can be extended to other files like HPCC log files in order to confirm the effectiveness of the approaches used and also make the algorithms more robust, applicable to a variety of log files.

Also, this work could be extended by adding some modules which will provide clues about root causes of the detected anomalies.

Finally, this work can be leveraged by the implementation of a streaming anomaly detection system. Indeed, the algorithm designed in this project works in batch mode. A streaming version would analyze the log file in real-time and be able to detect anomalies timely as the logs are recorded.

Infinite times Thanks to HPCC Systems and especially to my dedicated supervisors 🙂