DQA Engineering Lead - Databricks & Snowflake
DQA Engineering Lead - Databricks & Snowflake 100% Remote 12+months Contract Required Experience & Technical Expertise 10+ Years of Experience: Extensive background in Data Engineering, Data Architecture, or highly technical Data Quality Engineering. Databricks SME (Required): Deep, hands-on expertise in Databricks, including PySpark, Spark SQL, Delta Lake architecture, and performance tuning for large-scale data processing. Snowflake SME (Highly Preferred): Strong experience with Snowflake architecture, Snowpark (Python), task scheduling, and data sharing. Programming & Scripting: Advanced proficiency in Python, PySpark, and SQL. Must be a hands-on coder who treats data quality as a software engineering discipline. Shift-Left & DQxC: Proven experience building programmatic data quality frameworks from the ground up, such as Great Expectations, dbt tests, Soda, or custom PySpark/Python frameworks.
Preferred Qualifications
Healthcare Payer Domain: Understanding of healthcare payer data ecosystems, including Medicare, Medicaid, claims processing, HL7/FHIR, and PHI/PII compliance. Platform Certifications: Active Databricks Certified Data Engineer Professional and/or SnowPro Advanced: Data Engineer certifications. Agile/Pod Delivery: Experience operating as a technical lead in a scaled Agile (SAFe) or Pod-based delivery model