Course Outline
Python Fundamentals for Data Tasks for Government
- Installing Python and configuring the development environment
- Language fundamentals: variables, data types, control structures
- Writing and executing simple Python scripts
File Handling: CSV and Excel for Government
- Reading and writing CSV files using the csv module and Pandas
- Working with Excel files using openpyxl/xlrd and Pandas
- Practical exercises: automating file conversions for government processes
Introduction to Pandas for Government
- DataFrame basics: creation, indexing, selection, and filtering
- Aggregation and grouping operations
- Common cleaning operations: handling missing values, duplicates, and type conversions
Introduction to Polars for Government
- Polars concepts and performance characteristics compared to Pandas
- Basic DataFrame operations in Polars
- Use-case example: when to choose Polars over Pandas for government data tasks
Advanced Data Transformation (Intermediate) for Government
- Complex joins, window functions, and pivot operations in Pandas
- Efficient data processing patterns with Polars
- Chaining operations and optimizing memory usage for government datasets
Process Automation with Python for Government
- Writing scripts to automate repetitive data tasks and ETL steps in a government context
- Scheduling scripts using OS schedulers or task schedulers for consistent performance
- Implementing logging, error handling, and notifications for enhanced reliability
Packaging Scripts and Best Practices for Government
- Creating executables with PyInstaller or similar tools for government use
- Project structuring, virtual environments, and dependency management for government projects
- Version control basics and documenting workflows for government compliance
Hands-on Mini-Project for Government
- End-to-end task: read raw files, clean and transform data, produce outputs for government reporting
- Automate the workflow and package as a runnable script or executable for government deployment
- Review and improvements based on peer feedback within the government context
Summary and Next Steps for Government
Requirements
- Basic understanding of programming concepts or a willingness to learn
- Comfort with using command-line or terminal for package installation
- Experience working with spreadsheets (CSV/Excel)
Audience
- Data analysts and operations staff automating data tasks for government
- Analytical engineers seeking lightweight ETL scripting solutions
- Professionals interested in practical Python-based data workflows
Testimonials (5)
The fact of having more practical exercises using more similar data to what we use in our projects (satellite images in raster format)
Matthieu - CS Group
Course - Scaling Data Analysis with Python and Dask
I thought the trainer was very knowledgeable and answered questions with confidence to clarify understanding.
Jenna - TCMT
Course - Machine Learning with Python – 2 Days
Very good preparation and expertise of a trainer, perfect communication in English. The course was practical (exercises + sharing examples of use cases)
Monika - Procter & Gamble Polska Sp. z o.o.
Course - Developing APIs with Python and FastAPI
The explaination
Wei Yang Teo - Ministry of Defence, Singapore
Course - Machine Learning with Python – 4 Days
Trainer develops training based on participant's pace