Get in Touch

Course Outline

Core Python Competencies for Data Operations

  • Installation of Python and configuration of the development environment
  • Fundamental language components: variables, data types, and control structures
  • Development and execution of elementary Python scripts

Data File Management: CSV and Excel Formats

  • Ingestion and output of CSV files utilizing the csv module and Pandas library
  • Manipulation of Excel workbooks using openpyxl/xlrd and Pandas
  • Applied exercises: automation of file format conversions

Fundamentals of Pandas

  • DataFrame operations: initialization, indexing, selection, and filtering
  • Aggregation and grouping methodologies
  • Standard data cleansing techniques: handling missing values, duplicate records, and type casting

Fundamentals of Polars

  • Core concepts of Polars and performance analysis relative to Pandas
  • Basic DataFrame operations within the Polars framework
  • Strategic application: criteria for selecting Polars over Pandas in specific contexts, including those relevant for government

Advanced Data Transformation (Intermediate Level)

  • Complex joins, window functions, and pivot operations in Pandas
  • Efficient data processing patterns using Polars
  • Operation chaining and memory optimization strategies

Process Automation via Python

  • Script development to automate repetitive data tasks and ETL processes
  • Scheduling execution through operating system schedulers or task management systems
  • Implementation of logging, error handling protocols, and notification mechanisms

Script Packaging and Operational Best Practices

  • Creation of executables using PyInstaller or comparable tools
  • Project architecture, virtual environment management, and dependency control
  • Version control fundamentals and documentation of operational workflows for government compliance

Applied Mini-Project

  • Comprehensive workflow: ingestion of raw data, cleansing, transformation, and output generation
  • Workflow automation and deployment as a runnable script or executable package
  • Evaluation and refinement based on peer review and feedback

Summary and Future Development Steps

Requirements

  • Fundamental understanding of programming principles or demonstrated aptitude for acquiring these skills
  • Proficiency in utilizing command-line interfaces for the installation of software packages
  • Demonstrated experience manipulating spreadsheet formats, including CSV and Excel files

Target Audience

  • Data analysts and operations personnel responsible for automating data processing tasks
  • Analytical engineers requiring efficient solutions for Extract, Transform, Load (ETL) scripting
  • Professional practitioners seeking to implement practical Python-driven data workflows for government missions
 14 Hours

Number of participants


Price per participant

Testimonials (2)

Upcoming Courses

Related Categories