Get in Touch
 Duration 14 hours

Course Outline

Architecting an Open-Source AIOps Framework

  • Overview of essential components in open AIOps pipelines
  • Data journey from ingestion through to alerting
  • Comparative analysis of tools and integration strategies

Data Acquisition and Aggregation

  • Capturing time-series data using Prometheus
  • Collecting logs via Logstash and Beats
  • Standardising data for cross-source correlation

Creating Observability Dashboards

  • Visualising metrics with Grafana
  • Developing Kibana dashboards for log analysis
  • Utilising Elasticsearch queries to derive operational insights

Anomaly Detection and Incident Forecasting

  • Transferring observability data into Python pipelines
  • Training ML models for outlier detection and forecasting
  • Deploying models for live inference within the observability stack

Alerting and Automation Using Open-Source Tools

  • Configuring Prometheus alert rules and Alertmanager routing
  • Automating responses via scripts or API workflows
  • Leveraging open-source orchestration tools (e.g., Ansible, Rundeck)

Integration and Scalability Factors

  • Managing high-volume ingestion and long-term data retention
  • Implementing security and access control in open-source stacks
  • Independently scaling each layer: ingestion, processing, and alerting

Practical Applications and Extensions

  • Case studies: performance optimisation, downtime mitigation, and cost reduction
  • Expanding pipelines with tracing tools or service graphs
  • Best practices for operating and maintaining AIOps in production

Recap and Future Directions

Requirements

  • Proficiency with observability platforms such as Prometheus or ELK
  • Practical knowledge of Python and core machine learning concepts
  • Familiarity with IT operations and alerting workflows

Target Audience

  • Senior Site Reliability Engineers (SREs)
  • Data engineers focused on operational tasks
  • DevOps platform leaders and infrastructure architects

Number of participants


Price per participant

Upcoming Courses

Related Categories