[Remote] Lead Data Engineer
Note: The job is a remote job and is open to candidates in USA. UST is a mission-driven technology company that creates transformative, human-centered solutions for clients and partners worldwide. UST is seeking a Lead Data Engineer to architect, build, and optimize scalable cloud-native data systems using Databricks and AWS, with a focus on healthcare data, governance, security, and Medicare Advantage workflows.
Responsibilities
- Lead the design, implementation, and maintenance of robust data pipelines on AWS using Databricks
- Architect scalable lakehouse structures leveraging Apache Iceberg to ingest, process, and store complex healthcare data types
- Establish comprehensive data governance and data lineage frameworks using Databricks Unity Catalog
- Implement secure access controls, data masking, and row-level security through Role-Based Access Control (RBAC)
- Architect and scale ingestion frameworks capable of processing HL7 and FHIR data feeds natively into the lakehouse ecosystem
- Oversee end-to-end processing of Medicare Advantage data assets, ensuring accurate risk adjustment and reporting workflows
- Ensure strict adherence to healthcare regulations, including HIPAA compliance and robust data governance frameworks
- Mentor junior engineers, conduct code reviews, and drive technical best practices across the data team
Skills
- 7+ years of data engineering experience
- At least 2 years in a technical lead role
- Production experience building and optimizing large-scale pipelines within Databricks
- Production experience deploying data infrastructure on AWS (S3, EMR, Lambda, IAM, Glue)
- Explicit, hands-on experience processing Medicare Advantage data (CMS enrollment, RAPS/EDPS submissions, MMR/MOR files, HCC risk adjustment models)
- Proven experience working with healthcare interoperability standards (FHIR and HL7 models)
- Proven experience implementing enterprise-level Role-Based Access Control (RBAC) and row-level security for PHI
- Mastery of Python, PySpark, and advanced SQL for complex distributed computing tasks
- Deep understanding and practical experience with Apache Iceberg (open table formats)
- Expert-level knowledge of Databricks Unity Catalog for centralized data governance
- Comprehensive understanding of US Healthcare data architecture
- Strong data pipeline design and optimization capabilities
- Security and compliance implementation expertise
- Deep domain expertise in US Healthcare systems
- In-depth knowledge of Medicare Advantage programs and workflows
- Understanding of healthcare regulations and HIPAA compliance requirements
- Knowledge of HL7 and FHIR healthcare interoperability standards
- Databricks Certified Data Engineer Professional
- AWS Certified Data Analytics certification
- Familiarity with orchestration tools like Apache Airflow or AWS Step Functions
Benefits
- Full-time, regular employees accrue a minimum of 10 days of paid vacation per year.
- Full-time, regular employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Full-time, regular employees receive 10 paid holidays.
- Full-time, regular employees are eligible for paid bereavement leave and jury duty.
- Full-time, regular employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
- Full-time, regular employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
- Full-time, regular employees receive basic life insurance as a Company-paid Employee Only benefit.
- Full-time, regular employees receive accidental death and disability insurance as a Company-paid Employee Only benefit.
- Full-time, regular employees receive short- and long-term disability benefits as Company-paid Employee Only benefits.
- Regular employees may purchase additional voluntary short-term disability benefits.
- Regular employees may participate in a Health Savings Account (HSA).
- Regular employees may participate in a Flexible Spending Account (FSA) for healthcare, dependent child care, and/or commuting expenses as allowable under IRS guidelines.
- Part-time employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Part-time employees are eligible to participate in the Company’s 401(k) Retirement Plan with employer matching.
- Full-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- Full-time temporary employees are eligible to participate in the Company’s 401(k) program with employer matching.
- Full-time temporary employees and their dependents residing in the US are eligible for medical, dental, and vision insurance.
- Part-time temporary employees receive 6 days of paid sick leave each year (pro-rated for new hires throughout the year).
- All US employees who work in a state or locality with more generous paid sick leave benefits than specified here will receive the benefit of those sick leave laws.
Company Overview