Cloud-native AI Pipelines for Continuous Infrastructure Optimization and Anomaly Detection

The article describes a model of cloud-native AI pipelines designed for continuous optimization of computing infrastructure and real-time anomaly detection. The developed model combines modern approaches to observability, machine learning (ML), and auto-scaling based on load forecasting. The methodology is based on the use of LSTM models, autoencoders, and convolutional neural networks (CNN) integrated into Kubernetes environment with support for Prometheus, Kafka, and Grafana. Load changes are simulated, and the system's response to critical events is evaluated. The results demonstrate a significant improvement in anomaly detection accuracy (up to 93%) and resource efficiency (up to 26% cost reduction compared to traditional approaches). The proposed model can be used in AIOps systems that require a high level of automation and reliability.