Senior Azure Databricks ETL
JOB_53388251121022Job type
ContractLocation
TorontoProfession
Other/tbcIndustry
InsurancePay
N/A
New Opportunity - Senior Azure Databricks ETL & DevOps Developer – Insurance Domain - Toronto - Hybrid
Job Title: DevOps Developer – Insurance Domain
Location: Toronto - Hybrid
Type: Long Term Contract
Senior Azure Databricks ETL & DevOps Developer – Insurance Domain Role Summary This role focuses on designing, developing, and optimizing scalable data pipelines and DevOps workflows using Azure Databricks, Azure Data Factory, and CI/CD tools. The developer will work closely with data architects, business analysts, and DevOps engineers to support insurance data modernization initiatives, including claims, policy, and customer analytics.
Key Responsibilities ETL Development - Build metadata-driven ETL pipelines using Azure Databricks, PySpark, and ADF. - Transform data from Azure Data Lake and SQL Server using Spark SQL and Delta Lake. - Optimize query performance and ensure SLA compliance for high-volume insurance datasets.
DevOps & CI/CD - Develop and manage Azure DevOps pipelines for build, release, and deployment. - Implement automated testing, version control (GitHub), and environment provisioning. - Monitor pipeline health and troubleshoot deployment issues across environments. Collaboration & Governance - Work with BAs and architects to translate business requirements into technical solutions. - Maintain data lineage, impact analysis, and traceability using Unity Catalog and metadata repositories. - Ensure compliance with insurance data governance and security standards. Mentorship & Documentation - Guide junior developers in best practices for data engineering and DevOps. - Document technical specifications, transformation logic, and deployment workflows.
Technical Environment - Cloud & Tools: Azure Databricks, Azure Data Factory, Azure SQL, Azure DevOps, GitHub, Jenkins, Jira - Languages: Python, PySpark, SQL, Spark SQL - Frameworks: Delta Lake, Unity Catalog, Medallion Architecture
- Certifications Preferred:
- Microsoft Certified Azure Data Engineer Associate
- Databricks Certified Data Engineer
- Microsoft Certified Azure Data Engineer Associate
- Databricks Certified Data Engineer
Insurance-Specific Use Cases - Claims ingestion and transformation pipelines - Policy data modeling and analytics - Customer 360 views and fraud detection - Integration with Guidewire and other core insurance platforms
#LI-DNI
Senior Azure Databricks ETLJOB_533882511210222025-08-252025-11-23
Talk to Ashley Hyslop, the specialist consultant managing this position
Located in Toronto (EN), 8 King Street East, 20th FloorTelephone: 4162031834JOB_53388251121022