[Remote] Lead Data Engineer

Note: The job is a remote job and is open to candidates in USA. UST is a mission-driven technology company that creates transformative, human-centered solutions through innovation and agility. UST is seeking a Lead Data Engineer to architect, build, and optimize scalable cloud-native data systems, lead enterprise data platform development using Databricks and AWS, and support secure healthcare data processing and governance.

Responsibilities

• Lead the design, implementation, and maintenance of robust data pipelines on AWS using Databricks
• Architect scalable lakehouse structures leveraging Apache Iceberg to ingest, process, and store complex healthcare data types
• Establish comprehensive data governance and data lineage frameworks using Databricks Unity Catalog
• Implement secure access controls, data masking, and row-level security through Role-Based Access Control (RBAC)
• Architect and scale ingestion frameworks capable of processing HL7 and FHIR data feeds natively into the lakehouse ecosystem
• Oversee end-to-end processing of Medicare Advantage data assets, ensuring accurate risk adjustment and reporting workflows
• Ensure strict adherence to healthcare regulations, including HIPAA compliance and robust data governance frameworks
• Mentor junior engineers, conduct code reviews, and drive technical best practices across the data team

Skills

• · 7+ years of data engineering experience
• · At least 2 years in a technical lead role
• · Production experience building and optimizing large-scale pipelines within Databricks
• · Production experience deploying data infrastructure on AWS (S3, EMR, Lambda, IAM, Glue)
• · Explicit, hands-on experience processing Medicare Advantage data (CMS enrollment, RAPS/EDPS submissions, MMR/MOR files, HCC risk adjustment models)
• · Proven experience working with healthcare interoperability standards (FHIR and HL7 models)
• · Proven experience implementing enterprise-level Role-Based Access Control (RBAC) and row-level security for PHI
• · Mastery of Python, PySpark, and advanced SQL for complex distributed computing tasks
• · Deep understanding and practical experience with Apache Iceberg (open table formats)
• · Expert-level knowledge of Databricks Unity Catalog for centralized data governance
• · Comprehensive understanding of US Healthcare data architecture
• · Strong data pipeline design and optimization capabilities
• · Security and compliance implementation expertise
• · Deep domain expertise in US Healthcare systems
• · In-depth knowledge of Medicare Advantage programs and workflows
• · Understanding of healthcare regulations and HIPAA compliance requirements
• · Knowledge of HL7 and FHIR healthcare interoperability standards
• · Databricks Certified Data Engineer Professional
• · AWS Certified Data Analytics certification
• · Familiarity with orchestration tools like Apache Airflow or AWS Step Functions

Benefits

• Full-time, regular employees accrue a minimum of 10 days of paid vacation per year.
• Full-time, regular employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Full-time, regular employees receive 10 paid holidays.
• Full-time, regular employees are eligible for paid bereavement leave and jury duty.
• Full-time, regular employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
• Full-time, regular employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
• Full-time, regular employees receive Company-paid basic life insurance, accidental death and disability insurance, and short- and long-term disability benefits for employees only.
• Regular employees may purchase additional voluntary short-term disability benefits.
• Regular employees may participate in a Health Savings Account (HSA) and a Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines.
• Benefits offerings vary in Puerto Rico.
• Part-time employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Part-time employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
• Full-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• Full-time temporary employees are eligible to participate in the Company’s 401(k) program with employer matching.
• Full-time temporary employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
• Part-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
• All US employees who work in a state or locality with more generous paid sick leave benefits than specified here will receive the benefit of those sick leave laws.

Company Overview

Company H1B Sponsorship