Resilient Infrastructure through Autonomous Machine Learning and Cloud-Native Observability for Threat Detection

Authors

  • Dr. Mabruk Fekihal Faculty of Computing & Information Technology Sohar University, Oman Author

DOI:

https://doi.org/10.15662/IJARCST.2024.0705020

Keywords:

autonomous machine learning, cloud-native observability, threat detection, infrastructure resilience, anomaly detection, cybersecurity, machine learning, cloud security, telemetry, microservices, automated response, DevSecOps

Abstract

Modern digital infrastructure is increasingly distributed across cloud platforms, containers, microservices, edge devices, application programming interfaces, and dynamically provisioned computing resources. This complexity expands the attack surface while making conventional monitoring and rule-based threat detection less effective against rapidly changing and previously unseen attacks. This paper examines how autonomous machine learning combined with cloud-native observability can strengthen infrastructure resilience and threat detection. Autonomous machine learning refers to systems capable of continuously learning from operational and security telemetry, identifying deviations from established patterns, adapting detection models, and supporting automated responses with limited human intervention. Cloud-native observability integrates metrics, logs, traces, events, network flows, and security signals to provide a contextual representation of infrastructure behaviour. The proposed approach considers a unified architecture in which telemetry is collected continuously, processed through scalable cloud-native pipelines, analysed using machine-learning techniques, and correlated to identify anomalous or malicious behaviour. The methodology incorporates data preprocessing, feature engineering, unsupervised and supervised learning, continuous model evaluation, and automated response mechanisms. Particular attention is given to explainability, false-positive reduction, model drift, scalability, privacy, and adversarial manipulation. The study argues that resilient infrastructure requires not only accurate threat detection but also continuous visibility, adaptive learning, fault tolerance, and controlled automation

References

1. Yang, Q., Huang, A., Fan, L., Chan, C. S., Lim, J. H., Ng, K. W., Ong, D. S., et al. (2023). Federated Learning with Privacy-preserving and Model IP-right-protection. Machine Intelligence Research, 20, 19–37.

2. Jain, R. (2019). The hidden tax: A production framework for cloud cost architecture in enterprise data workloads. International Journal of Science, Research and Technology (IJSRAT), 2(6), 2522–2530.

3. Ambalakannu, M. (2024). Driving operational efficiency and clinical insights via unified care management. International Journal of Advanced Research in Computer Science & Technology (IJARCST), 7(4), 10693-10702.

4. Koganti, H. (2024). The computational complexity of hybrid algorithms: When branch-and-bound meets machine learning heuristics. International Journal of Research and Applied Innovations (IJRAI), 7(4), 11184–11190.

5. Sugumar, R. (2022). Federated Learning and Distributed AI Architectures for Cloud-Based Cyber Healthcare Data Collaboration Systems. International Journal of Future Innovative Science and Technology (IJFIST), 5(5), 9232.

6. Vemireddy, S. (2023). Building resilient enterprise platforms using event-driven and distributed computing models. International Journal of Research and Applied Innovations, 6(6), 10106-10112.

7. Venkatasalam, K., Rajendran, P., & Thangavel, M. (2019). Improving the accuracy of feature selection in big data mining using accelerated flower pollination (AFP) algorithm. Journal of medical systems, 43(4), 96.

8. Rahul Rao Juvvadi. (2024). Large Language Models in FP&A: An Architecture for Grounded Variance Commentary and Driver-Based Narrative Generation. Enterprise Development and Microfinance, 34(1), 71–84

9. Bellundagi, M. (2023). Integrating Machine Learning with Business Rule Management Systems for Adaptive Enterprise. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 6(1), 8023-8039.

10. Vedula, J. (2023). Operational resilience by design: A continuity assurance model for modernizing critical energy applications. International Journal of Applied Engineering & Technology, 5(S2), 299–309.

11. Jayaraman, S., Rajendran, S., & P, S. P. (2019). Fuzzy c-means clustering and elliptic curve cryptography using privacy preserving in cloud. International Journal of Business Intelligence and Data Mining, 15(3), 273-287.

12. Sandhu, Y. S. (2024). Real time ETL optimization using change data capture incremental. International Journal of Emerging Trends in Engineering and Management Research, 9(3), 15711–15721.

13. Mathew, A. (2021). Artificial intelligence and cognitive computing for 6G communications & networks. International Journal of Computer Science and Mobile Computing, 10(3), 26-31.

14. Devisri, M., Vetriselvan, V., Baskar, M., Mylapalli, M., Jayabalan, K., & Mouli, S. K. M. K. (2024). Blockchain Innovations for Secure Online Transactions. In Strategies for E-Commerce Data Security: Cloud, Blockchain, AI, and Machine Learning (pp. 523-545). IGI Global Scientific Publishing.

15. Selvarajan, K. (2023). Optimizing large-scale data lakehouse architectures for performance and cost efficiency. International Journal of Research and Applied Innovations, 6(6), 10093–10101.

16. Soundappan, S. J. (2021). Integrated Artificial Intelligence Framework for Enterprise Cloud Modernization and Intelligent Threat Management Systems. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 4(4), 5274-5284.

17. Manda, P. (2024). Oracle E-Business Suite modernization: The transition from 12.1.3 to 12.2.8. International Journal of Research and Applied Innovations, 7(3), 10838–10842.

18. Badam, L. R. (2023). AI-driven real-time cyberattack detection for critical financial infrastructure. International Journal of Science, Research and Technology (IJSRAT), 6(4), 10374–10383.

19. Raja, G. V. (2022). AI Enabled Cloud and Data Engineering Frameworks for Secure, Scalable, and Intelligent Cyber Physical Analytics Systems. International Journal of Research and Applied Innovations, 5(4), 7395-7409.

20. Polamarasetty, V. K. (2021). Modernizing SAP sales and distribution systems through ABAP-based enterprise solutions. International Journal of Research and Applied Innovations, 4(2), 4925–4930.

21. Ambati, K. C. (2024). Enterprise-wide procurement consolidation: Ivalua-SAP-EDW integration architecture for global supply chain excellence. International Journal of Research Publications in Engineering, Technology and Management (IJRPETM), 7(4), 14309-14318.

22. Bitragunta, S. L. V., & Paramasivan, M. (2023). Midterm dynamic simulation for the governance of reserves in systems with elevated renewable energy integration. Journal of Artificial Intelligence, 1(1), 1956–1962.

23. Anand, L. (2023). Machine Learning Enabled Enterprise Integration through Intelligent API Governance Secure Cloud Infrastructure and Automated Operations. International Journal of Research and Applied Innovations, 6(3), 5972-5979.

24. Sivakumer, D. (2023). Depth of ServiceNow platform utilization and business delivery performance in enterprise project management. International Journal of Computer Technology and Electronics Communication (IJCTEC), 6(6), 8167–8177.

25. Sudhan, S. K. H. H., & Kumar, S. S. (2016). Gallant Use of Cloud by a Novel Framework of Encrypted Biometric Authentication and Multi Level Data Protection. Indian Journal of Science and Technology, 9, 44.

26. Gopinathan, V. R. (2023). Modernizing Enterprise Applications Using Intelligent API Frameworks Machine Learning and Cloud Native Computing. International Journal of Science, Research and Technology, 6(5), 10690-10697.

27. Punithavathi, R., Selvi, R. T., Latha, R., Kadiravan, G., Srikanth, V., & Shukla, N. K. (2022). Robust node localization with intrusion detection for wireless sensor networks. Intelligent Automation and Soft Computing, 33(1), 143-156.

28. Gowda, M. K. S. (2024). Leveraging machine learning to enhance accuracy and efficiency in regulatory compliance. International Journal of Advanced Research in Computer Science & Technology (IJARCST), 7(4), 10683-10692.

29. Ramasamy, M. (2023). Designing resilient control planes for autonomous enterprise networks. International Journal of Science, Research and Technology, 6(1), 9220–9230.

30. Kundavaram, R. M. R. (2022). Cloud-based data analysis identifying key financial influencers at scale. European Economic Letters (EEL), 12(2), 234–241. https://www.eelet.org.uk/index.php/journal/article/view/3389

31. Khare, A., Khare, S., Goel, O., & Goel, P. (2024). Strategies for successful organizational change management in large digital transformation. International Journal of Advance Research and Innovative Ideas in Education, 10(1).

32. Matrouk, K., V, S., Kumar, S., Bhadla, M. K., Sabirov, M., & Saadh, M. J. (2023). Deep Learning–based Dynamic User Alignment in Social Networks. ACM Journal of Data and Information Quality, 15(3), 1-26.

33. Ludwig, H., & Baracaldo, N. (Eds.). (2022). Federated Learning: A Comprehensive Overview of Methods and Applications. Springer.

Downloads

Published

2024-10-10

How to Cite

Resilient Infrastructure through Autonomous Machine Learning and Cloud-Native Observability for Threat Detection. (2024). International Journal of Advanced Research in Computer Science & Technology(IJARCST), 7(5), 11049-11056. https://doi.org/10.15662/IJARCST.2024.0705020