Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Enterprise Architecture and Pipeline Strategy
- Multi-layer ETL architecture design
- Creating modular and reusable components
- Implementing hybrid approaches across different systems
Advanced Performance Engineering
- Optimization at the step level
- Strategies for parallelism and threading
- Monitoring pipelines under high load
Automation, Scripting, and Custom Extensions
- Incorporating scripting within transformations
- Creating custom plugins
- Expanding PDI capabilities using Java and JavaScript
Complex Data Processing and Integrations
- Real-time and streaming data integration
- Interfacing with big data platforms
- Advanced processing of files and APIs
Data Governance, Security, and Compliance
- Securing transformations and credential management
- Ensuring data lineage and traceability
- Addressing regulatory and compliance requirements
Enterprise Orchestration and Scheduling
- Overseeing large-scale job networks
- Designing error recovery and failover mechanisms
- Managing orchestration at the environment level
Repository Management, Version Control, and CI/CD
- Strategies for enterprise repositories
- Integration of PDI with Git
- Implementing continuous deployment patterns
Deployment, Monitoring, and Production Operations
- Migrating solutions across different environments
- Utilizing operational tools and dashboards
- Achieving end-to-end production readiness
Course Summary and Future Directions
Requirements
- A solid grasp of ETL pipelines and data modeling concepts
- Practical experience with intermediate-level PDI transformations
- Proficiency in SQL and scripting languages
Target Audience
- Senior Data Engineers
- ETL Architects
- Professionals overseeing complex data integration workloads
21 Hours
Testimonials (1)
It's a hands-on session.
