Software Developer - ETL

Overview

The Ministry of Treasury Board Secretariat's Central Agencies Cluster is seeking a Senior ETL Developer to join their data engineering team on a fully onsite engagement in Toronto. The successful consultant will design, develop, and maintain robust data pipelines and ETL applications supporting enterprise Data Warehouse and Business Intelligence solutions. This is a hands-on technical role working across both Microsoft Azure and Amazon Web Services platforms to deliver high-quality, scalable data infrastructure.

Key Responsibilities

• Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading (ETL) activities across structured and semi-structured data repositories
• Develop and maintain ETL applications for Data Warehouse and Business Intelligence solutions using Azure Data Factory, Azure SQL Database, Azure Data Lake, and AWS services
• Build and maintain schedule and dependency logic for ETL scripts, ensuring reliable daily and initial load execution
• Construct complex SQL queries and perform performance tuning to optimize data processing workloads
• Collaborate with business stakeholders to elicit, document, and validate data and business requirements
• Investigate data to identify potential issues within ETL pipelines, notify end-users, and propose adequate solutions
• Ensure data architecture remains scalable, maintainable, and aligned with best practices and organizational standards
• Translate technical system specifications into working, tested applications including detailed programming specifications and unit tests
• Resolve and troubleshoot technical problems arising during use and operation of data software packages, including support during implementation, conversion, and migrations
• Create and maintain comprehensive technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, and detailed design documents
• Participate in the full software development lifecycle from development through testing, quality assurance, and delivery
• Communicate clearly and professionally as part of a development team and with clients

Must-Have Requirements

• Demonstrated experience with the Microsoft Azure suite including Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI
• Hands-on experience with the Databricks Platform
• Demonstrated experience with AWS services including Amazon Aurora, Amazon Relational Database Service (RDS), AWS Glue, and OpenSearch
• Experience developing data extraction, transformation, and load programs (daily and initial load) across a wide range of data repositories including structured and semi-structured files, relational and multi-dimensional data stores
• Experience developing, implementing, and maintaining schedule and dependency logic for ETL scripts
• Experience with data integration, data cleansing, and data analytics
• Experience with data modeling and design principles for data marts and data warehouses
• Experience in database management and administration
• Experience constructing complex SQL queries and performing performance tuning
• Experience with Git and knowledge of source control strategies
• Experience creating technical documentation including ETL source-to-target mappings, data model diagrams, architecture artifacts, and detailed design documents
• Experience eliciting, documenting, and validating business requirements from diverse stakeholders
• Experience across the full software development lifecycle from development through testing, quality assurance, and delivery
• Strong written and verbal communication skills with the ability to understand, comprehend, and follow technical and business requirements

Nice-to-Have Skills

• Knowledge and understanding of the Accessibility for Ontarians with Disabilities Act (AODA) and related regulations and standards
• Experience designing visual dashboards to highlight trends and Key Performance Indicators (KPIs), and developing scheduled and ad-hoc canned reports
• Experience with programming languages such as C#, including developing application code such as APIs and Azure Functions
• Experience writing scripts with PowerShell and other scripting languages
• Knowledge and experience with programming Internet-ready applications
• Experience with rapid application development (RAD) methodologies

Work Environment

This is a fully onsite role, five days per week, located at 222 Jarvis Street, Toronto. Candidates must be eligible for a Criminal Record and Judicial Matters Check (CRJMC) security clearance. The role involves close collaboration with a development team and regular communication with business stakeholders throughout the project lifecycle.