About the role
Data & AI Databricks (Azure) Lead Data Engineer
We are:
The Advanced Technology Centers (ATCs) is the engine for reinvention in our clients’ transformation journey. Powered by more than 255,000* people across 24 countries, ATCs will provide our clients seamless access to industry insights and innovative technology solutions.
Stronger together!
The Advanced Technology Centers (ATCs) make tremendous impact in solving our clients’ business problems leveraging Innovation, Intelligence, Industry insights, new IT and new technology skills. Now, with the global environment changing at a faster pace, our clients are facing unprecedented challenges and they need us more than ever before. As a Network, ATCs are positioned to unlock greater opportunities and exponential value for our clients.
The value for our clients and our people
For our clients, the Network provides the strength of our geographic diversity, greater resilience, and seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world.
For our people, it brings an opportunity to shape truly boundaryless career paths in a highly collaborative team of experts where they can learn from each other and solve the world’s most complex client challenges.
You are:
An experienced, hands-on Data & AI Engineer with deep hands-on expertise in Databricks and Azure data services to design, build, and optimize scalable data pipelines. You’ll work closely with analytics, data science, and cloud teams to ensure reliable, high-performance data delivery for the clients we serve.
The Work:
There will never be a typical day and that’s why people love it here. The opportunities to make a difference within exciting client initiatives are unlimited in the ever-changing technology landscape. You will be part of a highly collaborative and growing network of technology and data experts, who are taking on today’s biggest, most complex business challenges using the latest data and analytics technologies. We will nurture your talent in an inclusive culture that values diversity. You will have an opportunity to work in a variety of roles covering all aspects of Data Engineering including Data Modelling, Integration, Pipeline Development, Quality & Governance.
This role will require 3 days per week at the local Mississauga office or a client site located in the Greater Toronto Area. Preferred hiring locations for this role are Toronto and Mississauga.
Come grow your career in Technology at Accenture!
Key Responsibilities:
-
Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets leveraging Azure Databricks workflows and Spark technologies.
-
Design and optimize lakehouse architecture using Delta Lake tables following Bronze, Silver, and Gold layers to ensure efficient, reliable, and governed data storage.
-
Partner closely with data scientists and business analysts to deliver clean, validated, and well-modeled datasets that support advanced analytics and AI initiatives.
-
Continuously monitor pipeline health and performance; implement automated alerting and observability frameworks to facilitate rapid troubleshooting and proactive optimization.
-
Develop and enforce comprehensive data quality, validation, and security frameworks aligned with GDPR, CCPA, and other regulatory requirements.
-
Lead initiatives to optimize compute and cost efficiency through containerized Spark job orchestration and serverless compute resource management on Azure.
-
Govern data assets through unified policies via Unity Catalog and Azure Active Directory for fine-grained access control and compliance assurance.
-
Champion CI/CD best practices including automated deployments, version control with Git, and infrastructure-as-code for robust, repeatable data engineering workflows.
-
Collaborate with Power BI teams to develop performant and scalable reporting solutions by connecting Databricks SQL endpoints to business intelligence tools.
-
This role is in our Local ATCs and will require on-site work 2-3 days per week.
What you need:
- 5+ years of professional experience as a Data Engineer or in a related role
- 5+ years of experience working with Microsoft Azure cloud data services (AWS & GCP may also be considered)
- 3+ years of hands-on experience Databricks (Pyspark, SQL, Delta Lake, workflows)
- Power BI integration for actionable analytics using Databricks SQL
- Advanced Python (PySpark) & SQL for data transformation and pipeline development
- Experience with Azure Databricks: Spark, Delta Lake, Auto Loader, Lakehouse Medallion Architecture (Bronze, Silver, Gold)
- Experience with Git-based version control and CI/CD pipelines (Azure DevOps or GitHub Actions
- Strong problem-solving and performance optimization skills
- Bachelor’s degree or completion of a college program in a related discipline
Bonus points if you have experience with:
- ETL development, data transformation, and orchestration tools
- Power BI integration for actionable analytics using Databricks SQL
- Spark job and cluster performance tuning for cost and scalability optimization
- Databricks Certified Data Engineer Professional (2025)
- Microsoft Certified: Azure Data Engineer Associate
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale.
We are a talent and innovation-led company serving clients in more than 120 countries. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
This LinkedIn company page is moderated. When engaging with Accenture, we encourage everyone to:
- Use common courtesy and be respectful of others.
- Create your own original content and avoid content that you know to be fraudulent.
- Never repost someone else's copyrighted work, unless you have permission.
- Never post personal, identifying, or confidential information.
We reserve the right to delete comments or posts we deem to be:
- Profane, obscene, inappropriate, offensive, abusive material.
- Spam, repeated comments and commercial messages and personal advertisements.
- Discriminatory or that contain hateful speech of any kind regarding age, gender, race, religion, nationality, sexual orientation, gender identity or disability.
- Threats; personal attacks; abusive, defamatory, derogatory, or inflammatory language; or stalking or harassment of any individual, entity or organization.
- False, inaccurate, libelous, or otherwise misleading in any way.
About the role
Data & AI Databricks (Azure) Lead Data Engineer
We are:
The Advanced Technology Centers (ATCs) is the engine for reinvention in our clients’ transformation journey. Powered by more than 255,000* people across 24 countries, ATCs will provide our clients seamless access to industry insights and innovative technology solutions.
Stronger together!
The Advanced Technology Centers (ATCs) make tremendous impact in solving our clients’ business problems leveraging Innovation, Intelligence, Industry insights, new IT and new technology skills. Now, with the global environment changing at a faster pace, our clients are facing unprecedented challenges and they need us more than ever before. As a Network, ATCs are positioned to unlock greater opportunities and exponential value for our clients.
The value for our clients and our people
For our clients, the Network provides the strength of our geographic diversity, greater resilience, and seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world.
For our people, it brings an opportunity to shape truly boundaryless career paths in a highly collaborative team of experts where they can learn from each other and solve the world’s most complex client challenges.
You are:
An experienced, hands-on Data & AI Engineer with deep hands-on expertise in Databricks and Azure data services to design, build, and optimize scalable data pipelines. You’ll work closely with analytics, data science, and cloud teams to ensure reliable, high-performance data delivery for the clients we serve.
The Work:
There will never be a typical day and that’s why people love it here. The opportunities to make a difference within exciting client initiatives are unlimited in the ever-changing technology landscape. You will be part of a highly collaborative and growing network of technology and data experts, who are taking on today’s biggest, most complex business challenges using the latest data and analytics technologies. We will nurture your talent in an inclusive culture that values diversity. You will have an opportunity to work in a variety of roles covering all aspects of Data Engineering including Data Modelling, Integration, Pipeline Development, Quality & Governance.
This role will require 3 days per week at the local Mississauga office or a client site located in the Greater Toronto Area. Preferred hiring locations for this role are Toronto and Mississauga.
Come grow your career in Technology at Accenture!
Key Responsibilities:
-
Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets leveraging Azure Databricks workflows and Spark technologies.
-
Design and optimize lakehouse architecture using Delta Lake tables following Bronze, Silver, and Gold layers to ensure efficient, reliable, and governed data storage.
-
Partner closely with data scientists and business analysts to deliver clean, validated, and well-modeled datasets that support advanced analytics and AI initiatives.
-
Continuously monitor pipeline health and performance; implement automated alerting and observability frameworks to facilitate rapid troubleshooting and proactive optimization.
-
Develop and enforce comprehensive data quality, validation, and security frameworks aligned with GDPR, CCPA, and other regulatory requirements.
-
Lead initiatives to optimize compute and cost efficiency through containerized Spark job orchestration and serverless compute resource management on Azure.
-
Govern data assets through unified policies via Unity Catalog and Azure Active Directory for fine-grained access control and compliance assurance.
-
Champion CI/CD best practices including automated deployments, version control with Git, and infrastructure-as-code for robust, repeatable data engineering workflows.
-
Collaborate with Power BI teams to develop performant and scalable reporting solutions by connecting Databricks SQL endpoints to business intelligence tools.
-
This role is in our Local ATCs and will require on-site work 2-3 days per week.
What you need:
- 5+ years of professional experience as a Data Engineer or in a related role
- 5+ years of experience working with Microsoft Azure cloud data services (AWS & GCP may also be considered)
- 3+ years of hands-on experience Databricks (Pyspark, SQL, Delta Lake, workflows)
- Power BI integration for actionable analytics using Databricks SQL
- Advanced Python (PySpark) & SQL for data transformation and pipeline development
- Experience with Azure Databricks: Spark, Delta Lake, Auto Loader, Lakehouse Medallion Architecture (Bronze, Silver, Gold)
- Experience with Git-based version control and CI/CD pipelines (Azure DevOps or GitHub Actions
- Strong problem-solving and performance optimization skills
- Bachelor’s degree or completion of a college program in a related discipline
Bonus points if you have experience with:
- ETL development, data transformation, and orchestration tools
- Power BI integration for actionable analytics using Databricks SQL
- Spark job and cluster performance tuning for cost and scalability optimization
- Databricks Certified Data Engineer Professional (2025)
- Microsoft Certified: Azure Data Engineer Associate
About Accenture
Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale.
We are a talent and innovation-led company serving clients in more than 120 countries. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.
This LinkedIn company page is moderated. When engaging with Accenture, we encourage everyone to:
- Use common courtesy and be respectful of others.
- Create your own original content and avoid content that you know to be fraudulent.
- Never repost someone else's copyrighted work, unless you have permission.
- Never post personal, identifying, or confidential information.
We reserve the right to delete comments or posts we deem to be:
- Profane, obscene, inappropriate, offensive, abusive material.
- Spam, repeated comments and commercial messages and personal advertisements.
- Discriminatory or that contain hateful speech of any kind regarding age, gender, race, religion, nationality, sexual orientation, gender identity or disability.
- Threats; personal attacks; abusive, defamatory, derogatory, or inflammatory language; or stalking or harassment of any individual, entity or organization.
- False, inaccurate, libelous, or otherwise misleading in any way.