REAL-TIME LOG ANALYSIS WITH AWS OPENSEARCH AND DOCKER

Abstract: Cloud computing environments generate a massive amount of operational and security logs due to continuous API calls, user authentication activities, and service interactions. Monitoring these logs manually is inefficient and cannot provide real-time insights for security and operational management. This research presents a centralized real-time log monitoring system using AWS CloudTrail, Docker, and Amazon OpenSearch. The proposed system automatically collects CloudTrail logs stored in Amazon S3, processes them through a Dockerbased log ingestion engine, and indexes them in Amazon OpenSearch for fast search and analysis.

OpenSearch Dashboards provide visualization tools that help administrators detect suspicious activities, analyze system usage patterns, and improve cloud security monitoring. The system ensures automation, scalability, centralized visibility, and efficient log analytics in AWS environments. By integrating AWS services with containerization technologies, the system simplifies log monitoring and enables faster incident detection. The solution provides an effective framework for real-time monitoring of cloud infrastructure activities.

Keywords: CloudTrail, OpenSearch, Docker, Log Analysis, Cloud Security, AWS