Software Developer - ETL - Senior
About the role
We do have a job opening for Software Developer - ETL - Senior for our direct client Province of Ontario. The position details are given below:
Job Details: Job ID: RQ11258 - Software Developer - ETL - Senior
Client: Health Services Cluster Duration: 1 year + extension Type: Onsite
Job Description: MUST HAVES:
10+ years experience in: · Designing and developing scalable Medallion Data Lakehouse architectures. · Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks. · Experience integrating structured and unstructured data sources into star/snowflake schemas. · Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt. · Implementing orchestrated workflows and job scheduling in Azure environments. · Strong knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling. · Advanced SQL query optimization, indexing, partitioning, and data replication strategies. · Experience with Apache Spark, Delta Lake, and distributed computing frameworks in Azure Databricks. · Working with Parquet, ORC, and JSON formats for optimized storage and retrieval. · Deep expertise in Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL, Event Hubs, and Azure Functions. · Strong understanding of cloud security, RBAC, and data governance. · Proficiency in Python (PySpark), SQL, and PowerShell for data engineering workflows. · Experience with CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines. · Implementing data lineage, cataloging, metadata management, and data quality frameworks. · Experience with Unity Catalog for managing permissions in Databricks environments. · Expertise in Power BI (DAX, data modeling, performance tuning). · Experience in integrating Power BI with Azure Synapse and Databricks SQL Warehouses. · Familiarity with MLflow, AutoML, and embedding AI-driven insights into data pipelines.
Not the right fit? Search for Software Developer jobs in Toronto, Ontario, Canada
About ITProFound Inc
The company that built over successful deliverance of gigantic applications across the US, Canada, Dubai and India. We are committed to building state of the art applications to meet today's challenges in Information Technology and help the businesses to thrive. We are a women owned company and most leaders are incredible Women, join us and excel in your passionate role.
Similar Jobs
Software Developer - ETL - Senior
About the role
We do have a job opening for Software Developer - ETL - Senior for our direct client Province of Ontario. The position details are given below:
Job Details: Job ID: RQ11258 - Software Developer - ETL - Senior
Client: Health Services Cluster Duration: 1 year + extension Type: Onsite
Job Description: MUST HAVES:
10+ years experience in: · Designing and developing scalable Medallion Data Lakehouse architectures. · Expertise in data ingestion, transformation, and curation using Delta Lake and Databricks. · Experience integrating structured and unstructured data sources into star/snowflake schemas. · Building, automating, and optimizing complex ETL/ELT pipelines using Azure Data Factory (ADF), Databricks (PySpark, SQL, Delta Live Tables), and dbt. · Implementing orchestrated workflows and job scheduling in Azure environments. · Strong knowledge of relational (SQL Server, Synapse, PostgreSQL) and dimensional modeling. · Advanced SQL query optimization, indexing, partitioning, and data replication strategies. · Experience with Apache Spark, Delta Lake, and distributed computing frameworks in Azure Databricks. · Working with Parquet, ORC, and JSON formats for optimized storage and retrieval. · Deep expertise in Azure Data Lake Storage (ADLS), Azure Synapse Analytics, Azure SQL, Event Hubs, and Azure Functions. · Strong understanding of cloud security, RBAC, and data governance. · Proficiency in Python (PySpark), SQL, and PowerShell for data engineering workflows. · Experience with CI/CD automation (Azure DevOps, GitHub Actions) for data pipelines. · Implementing data lineage, cataloging, metadata management, and data quality frameworks. · Experience with Unity Catalog for managing permissions in Databricks environments. · Expertise in Power BI (DAX, data modeling, performance tuning). · Experience in integrating Power BI with Azure Synapse and Databricks SQL Warehouses. · Familiarity with MLflow, AutoML, and embedding AI-driven insights into data pipelines.
Not the right fit? Search for Software Developer jobs in Toronto, Ontario, Canada
About ITProFound Inc
The company that built over successful deliverance of gigantic applications across the US, Canada, Dubai and India. We are committed to building state of the art applications to meet today's challenges in Information Technology and help the businesses to thrive. We are a women owned company and most leaders are incredible Women, join us and excel in your passionate role.