[Remote] Data Engineer (Databricks)
Note: The job is a remote job and is open to candidates in USA. Fluent is building an ML/AI-first advertising network that connects advertisers and publishers to improve e-commerce relevancy. The Data Engineer will build and operate Databricks-based data products and pipelines that create, model, and deliver declared and custom consumer audience segments, while partnering with Data Science and commercial stakeholders to translate business needs into engineering solutions.
Responsibilities
- Majority of the role will be data engineering: tables, views, jobs/pipelines, and orchestration within the Databricks environment, following Fluent's data model and architecture best practices. You will help elevate standards across testing, code repository, ci/cd, and naming conventions
- Build and maintain pipelines that create and deliver syndicated and custom audience segments, spanning declared (survey-based) and modeled (ML driven) methodologies
- Support delivery and performance reporting of finished segments on distribution marketplaces such as LiveRamp, TruAudience (TransUnion), and Lotame
- Investigate and leverage Databricks' latest capabilities for real-time processing and operational workloads, such as Spark structured Streaming and Lakeflow Declarative Pipelines
- Contribute to and maintain a high-quality codebase with comprehensive data observability, metadata standards, and best practices, including compliant handling of consumer data in line with Fluent's data privacy standards
- Apply AI-assisted development practices, using tools such as Claude Code, to accelerate pipeline development, testing, and documentation, while upholding Fluent's engineering and data quality standards
- Partner with the Data Engineering team, Data Science, and commercial stakeholders to define business requests and translate them into functional requirements
- Keep track of emerging tech and trends within the Databricks ecosystem
- Share your knowledge by giving brown bags, tech talks, and evangelizing appropriate tech and engineering best practices
- Empower internal teams by providing communication on architecture, execution plans, releases, and training
Skills
- Bachelor's or Master's degree in computer science or related field
- 4+ years of industry experience in Data Engineering, including expertise in SQL, Python, Spark, and distributed processing
- 2+ years of experience with Databricks environment leveraging Data Engineering and Data Warehousing features such as Jobs & Workflows, Notebooks, Unity Catalog, and Delta Lake
- Strong foundation in database design, data structures, and algorithms
- Experience using AI coding assistants (e.g., Claude Code, GitHub Copilot) as part of a modern engineering workflow
- Nice to have: familiarity with Databricks emerging technologies and latest offerings such as: Genie, Lakebase, AI/BI Dashboards, Databricks Apps
- Nice to have: Prior experience in digital marketing, ad-tech, media/advertising, or related field
- In addition, familiarity with audience, identity, or consumer segmentation data, and experience with data marketplaces such as LiveRamp, TransUnion, and/or Lotame
Benefits
- Fully remote work in the United States or Canada, with occasional travel to NYC.
- A fully stocked kitchen
- Catered breakfast and lunch
- Activity-filled office events
- Participation in recreational sports leagues
- Networking with She Runs It
- Quarterly outings to baseball games, fancy dinners, and pizza-making classes
- Ample career and professional growth opportunities
- New Headquarters with an open floor plan to drive collaboration
- Health, dental, and vision insurance
- Pre-tax savings plans and transit/parking programs
- 401K with competitive employer match
- Volunteer and philanthropic activities throughout the year
- Educational and social events
Company Overview
Company H1B Sponsorship