Get in Touch
 Duration 21 hours

Course Outline

Enterprise Architecture and Pipeline Design

  • Implementation of multi-tier ETL structures
  • Construction of modular and reusable data components
  • Integration of hybrid data models across diverse systems

Advanced Performance Engineering

  • Optimization of individual processing steps
  • Strategies for parallel execution and threading management
  • Monitoring of high-volume pipeline operations

Automation, Scripting, and Custom Extensions

  • Incorporation of scripting within transformation processes
  • Development of proprietary plugins for specific government functions
  • Expansion of PDI capabilities through Java and JavaScript integration

Complex Data Processing and Integrations

  • Real-time and streaming data integration protocols
  • Interaction with large-scale big data platforms
  • Advanced handling of file-based and API-driven data exchanges

Data Governance, Security, and Compliance

  • Protection of transformation logic and credential management
  • Establishment of data lineage and full traceability
  • Adherence to regulatory standards and compliance frameworks

Enterprise Orchestration and Scheduling

  • Management of extensive job network dependencies
  • Design of error recovery mechanisms and failover procedures
  • Coordination of orchestration across distinct operational environments

Repository, Version Control, and CI/CD

  • Strategic approaches to enterprise repository management
  • Integration of PDI environments with Git version control systems
  • Implementation of continuous deployment methodologies

Deployment, Monitoring, and Production Operations

  • Migration of validated solutions across operational tiers
  • Utilization of operational tooling and monitoring dashboards
  • Ensuring end-to-end readiness for production environments

Summary and Next Steps

Requirements

  • Foundational understanding of ETL pipelines and data modeling principles
  • Practical experience with intermediate-level PDI transformations
  • Proficiency in SQL and scripting languages

Intended Audience

  • Senior data engineers
  • ETL architects
  • Professionals responsible for managing complex data integration workloads

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories