Data Engineer (Databricks)

Job summary

You will build and maintain data pipelines within the Databricks environment to deliver syndicated and custom audience segments. Additionally, you will collaborate with data science and commercial teams to translate business requirements into high-impact engineering solutions.

Job details

Fluent is building the next generation advertising network, Partner Monetize & Advertiser Acquisition. Our vision is to build an ML/AI first network of advertisers and publishers to achieve a common objective, elevating relevancy in E-commerce for everyday shoppers. As a Data Engineer on Fluent's Data Engineering team, you will bring your Databricks development expertise to build the data products that power Fluent's Audience Solutions business: the syndicated and custom consumer segments we build, model, and deliver to leading data marketplaces. These data products translate raw survey and behavioral signals into declared and modeled audiences that our commercial teams and clients rely on every day. You are known as a strong and efficient IC Data Engineer, with the ability to assist in designing engineering solutions, data modeling, and building architecture. You are familiar with the Databricks Lakehouse and how to work backwards from translating business requirements into engineering solutions. You are considered an expert in Python, SQL, and Spark. You will work closely with the Data Engineering team and Data Science partners to build and operate high-impact audience data solutions. This role is fully Remote in the United States or Canada, with occasional travel to NYC. What You'll Do: Majority of the role will be data engineering: tables, views, jobs/pipelines, and orchestration within the Databricks environment, following Fluent’s data model and architecture best practices. You will help elevate standards across testing, code repository, ci/cd, and naming conventions. Build and maintain pipelines that create and deliver syndicated and custom audience segments, spanning declared (survey-based) and modeled (ML driven) methodologies. Support delivery and performance reporting of finished segments on distribution marketplaces such as LiveRamp, TruAudience (TransUnion), and Lotame. Investigate and leverage Databricks' latest capabilities for real-time processing and operational workloads, such as Spark structured Streaming and Lakeflow Declarative Pipelines. Contribute to and maintain a high-quality codebase with comprehensive data observability, metadata standards, and best practices, including compliant handling of consumer data in line with Fluent's data privacy standards. Apply AI-assisted development practices, using tools such as Claude Code, to accelerate pipeline development, testing, and documentation, while upholding Fluent's engineering and data quality standards. Partner with the Data Engineering team, Data Science, and commercial stakeholders to define business requests and translate them into functional requirements. Keep track of emerging tech and trends within the Databricks ecosystem. Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices. Empower internal teams by providing communication on architecture, execution plans, releases, and training. Bachelor's or Master's degree in computer science or related field. 4+ years of industry experience in Data Engineering, including expertise in SQL, Python, Spark, and distributed processing. 2+ years of experience with Databricks environment leveraging Data Engineering and Data Warehousing features such as Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake. Strong foundation in database design, data structures, and algorithms. Experience using AI coding assistants (e.g., Claude Code, GitHub Copilot) as part of a modern engineering workflow. Nice to have: familiarity with Databricks emerging technologies and latest offerings such as: Genie, Lakebase, AI/BI Dashboards, Databricks Apps. Nice to have: Prior experience in digital marketing, ad-tech, media/advertising, or related field. In addition, familiarity with audience, identity, or consumer segmentation data, and experience with data marketplaces such as LiveRamp, TransUnion, and/or Lotame About Us Fluent, Inc (NASDAQ: FLNT) is a leader in customer acquisition, leveraging its direct response expertise to drive engagement and power discovery for leading brands. Backed by proprietary data science, Fluent connects data-rich consumers to targeted offers, allowing them to find new opportunities, content, and products that enhance their lives. Established in 2010, and headquartered in New York City, Fluent's team of experts have invested over $1B in media across its digital media portfolio to build a global audience available through 500+ DSPs, DMPs, online publishers, and programmatic platforms. For more information, visit fluentco.com. At Fluent, we like what we do and we like who we do it with. Our team is a tight-knit crew of go-getters; we love to celebrate our successes! In addition we offer a fully stocked kitchen, catered breakfast and lunch, and our office manager keeps the calendar stocked with activity-filled events. When we’re not eating, working out, or planning parties, Fluent folks can be found participating in recreational sports leagues, networking with She Runs It, and bonding across teams during quarterly outings to baseball games, fancy dinners, and pizza-making classes. And we have all the practical benefits, too… Competitive compensation Ample career and professional growth opportunities New Headquarters with an open floor plan to drive collaboration Health, dental, and vision insurance Pre-tax savings plans and transit/parking programs 401K with competitive employer match Volunteer and philanthropic activities throughout the year Educational and social events The amazing opportunity to work for a high-flying performance marketing company! Salary Range: $80,000 to $90,000 CAD - The base salary range represents the low and high end of the Fluent salary range for this position. Actual salaries will vary depending on factors including but not limited to location, experience, and performance. This is a new position, not a backfill. Fluent participates in the E-Verify Program. As a participating employer, Fluent, LLC will provide the Social Security Administration (SSA) and, if necessary, the Department of Homeland Security (DHS), with information from each new employee’s Form I-9 to confirm work authorization. Fluent, LLC follows all federal regulations including those set forth by The Office of Special Counsel for Immigration-Related Unfair Employment Practices (OSC). The OSC enforces the anti-discrimination provision (§ 274B) of the Immigration and Nationality Act (INA), 8 U.S.C. § 1324b.

What you’ll do

You will build and maintain data pipelines within the Databricks environment to deliver syndicated and custom audience segments. Additionally, you will collaborate with data science and commercial teams to translate business requirements into high-impact engineering solutions.

Requirements

Candidates must have at least 4 years of data engineering experience with expertise in Python, SQL, and Spark. A bachelor's or master's degree in computer science or a related field is required, along with 2+ years of experience in the Databricks ecosystem.

Benefits

• Health insurance • Dental insurance • Vision insurance • Pre-tax savings plans • Transit and parking programs • 401k with employer match • Professional growth opportunities • Catered breakfast and lunch • Social events

Listed skills

• SQL · Preferred
• CI/CD · Preferred
• Machine learning · Preferred
• Python · Preferred

Other relevant skills

Identified from the job description. Confirm important requirements above.

• Databricks
• Python
• SQL
• Spark
• Data engineering
• Data modeling
• Data architecture
• CI/CD
• Data observability
• Spark structured streaming
• Lakeflow
• Unity catalog
• Delta lake
• Cloud computing
• Machine learning
• Ad-tech
• Claude Code
• GitHub Copilot
• Pipelines
• Performance Reporting
• Observability
• Workflow Management
• Go (Programming Language)
• Data Privacy
• Emerging Technologies
• Planning
• Artificial Intelligence
• Social Security
• Business Intelligence
• Dashboard
• Business Requirements
• Customer Acquisition Management
• Communication
• Computer Science
• Market Segmentation
• Data Engineering
• Data Modeling
• Data Quality
• Data Structures
• Data Warehousing
• Database Design
• Development Testing
• Digital Marketing
• Direct Marketing
• Functional Requirement
• Marketing
• Python (Programming Language)
• Machine Learning
• Metadata Standards
• Office Management

Job areas

• Data & Analytics
• Software
• Engineering
• Technology
• Marketing
• Data Engineer
• Software Developers
• Database Administrators