Senior Specialist, Intelligence Platform Databricks Engineer

Job summary

The engineer will administer and govern the centralized Databricks Lakehouse environment, ensuring platform reliability and operational efficiency across business units. They will also implement infrastructure-as-code, manage platform-wide governance, and provide cost reporting to support scalable data operations.

Job details

Job Description As a Senior Specialist, Intelligence Platform Engineer reporting to the AVP of Enterprise Architecture, you'll play a critical role in administering, governing, and scaling Nasdaq's centralized Databricks Lakehouse environment — the CAP Intelligence Platform — which serves multiple business units across the Capital Access Platforms organization. You'll thrive in this position if you're detail-oriented, technically strong, and energized by building platforms that bring data governance, compliance, and operational efficiency together at scale. Key Responsibilities Administer and support a multi-workspace Databricks environment, including Unity Catalog governance, service principal management, and enterprise integrations, ensuring platform reliability and operational standards across all business units. Own platform-wide governance by monitoring compliance with catalog structure, metadata standards, naming conventions, and tagging requirements — producing scorecards, audit reports, and driving remediation where needed. Deliver monthly cost and usage reporting across workspaces, compute clusters, serverless workloads, and storage resources, identifying optimization opportunities and providing business unit-level consumption transparency. Partner with workspace administrators and data stewards across six business units to enable self-service administration, develop operational documentation, and serve as the escalation point for complex platform issues. Support Infrastructure-as-Code implementations using Terraform to automate provisioning, governance validation, and reporting — contributing to a scalable, efficient platform. Required Qualifications Bachelor's degree in Computer Science, Information Systems, or a related field, or equivalent practical experience. 5+ years of experience in data platform administration, cloud infrastructure, or a comparable technical discipline. Hands-on experience administering Databricks at scale, including Unity Catalog, workspace configuration, and compute management. Proven ability to deliver governance frameworks, compliance reporting, and cost management in a complex, regulated environment. Strong communicator who works effectively across technical and business teams in matrixed, cross-functional environments. Preferred Qualifications Databricks Certified Professional certification or equivalent cloud certifications (e.g., AWS). Experience in financial services, fintech, or regulated industries, including familiarity with compliance requirements such as Reg SCI. Background in FinOps principles, identity lifecycle management, or large-scale platform rollouts. This position offers the opportunity for a hybrid work environment at least 3 days a week in-office, subject to change, providing flexibility and accessibility for qualified candidates. Come as You Are Nasdaq is an equal opportunity employer. We welcome applications from candidates of all backgrounds and identities. We are committed to fostering an inclusive workplace where diverse perspectives, experiences, and identities are valued and celebrated. We ensure that individuals with disabilities are provided with reasonable accommodation throughout the hiring process. What We Offer We’re proud to offer a competitive rewards package that is meaningful, recognizes the unique needs of our employees and their families and incentivizes employees for their contribution to Nasdaq’s overall success. The base pay range for this role is $104,000 - $148,000. In addition to base salary, Nasdaq provides a generous annual bonus/commission (short-term incentive), and equity (long-term incentive), comprehensive benefits, and opportunity for growth. Exact compensation may vary based on several job-related factors that are unique to each candidate, including but not limited to: skill set, experience, education/training, business needs and market demands.

What you’ll do

The engineer will administer and govern the centralized Databricks Lakehouse environment, ensuring platform reliability and operational efficiency across business units. They will also implement infrastructure-as-code, manage platform-wide governance, and provide cost reporting to support scalable data operations.

Requirements

Candidates must have at least 5 years of experience in data platform administration or cloud infrastructure, with hands-on expertise in Databricks and Unity Catalog. A bachelor's degree in Computer Science or a related field is required, along with strong communication skills for cross-functional collaboration.

Benefits

• Annual bonus
• Equity
• Comprehensive benefits

Listed skills

• Terraform · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Databricks
• Unity Catalog
• Data governance
• Cloud infrastructure
• Terraform
• Infrastructure-as-code
• FinOps
• Compliance reporting
• Metadata management
• Service principal management
• Platform administration
• Cost management
• Identity lifecycle management
• Data platform architecture
• Compliance Reporting
• Operational Efficiency
• Workplace Inclusivity
• Financial Technology (FinTech)
• Enterprise Integration
• Serverless Computing
• Infrastructure as Code (IaC)
• Cloud Financial Management (FinOps)
• Amazon Web Services
• Auditor's Report
• Cost Management
• Management
• Cloud Infrastructure
• Computer Science
• Information Systems
• Data Governance
• Financial Services
• Governance
• Scalability
• Enterprise Architecture
• Metadata Standards
• Product Family Engineering
• Self Service Technologies
• Naming Conventions
• Lifecycle Management
• Top Secret-Sensitive Compartmented Information (TS/SCI Clearance)
• Detail Oriented

Job areas

• Data & Analytics
• Technology
• Software
• Engineering
• Finance & Accounting
• Platform Engineer
• Software and Applications Developers and Analysts Not Elsewhere Classified
• Validation Engineers
• Industrial Engineers

More jobs from Nasdaq