SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP
SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP Contract Remote Visa: Any NOW HIRING | SENIOR DATA ENGINEER | SCALA | SPARK | CLoudera CDP Location: Remote Experience: 7+ Years Domain: Medicaid / Healthcare Data Processing us Visa : H1B & USC ( No GC ) We are looking for an experienced Senior Data Engineer to take ownership of a mission-critical enterprise data processing platform supporting Medicaid Encounter Processing and enterprise data ingestion. The ideal candidate will have strong hands-on expertise in Scala, Apache Spark, Hive, Drools, and Cloudera Data Platform (CDP), with proven experience maintaining and troubleshooting production-scale distributed data processing applications. Required Technical Skills: ✅ Scala — hands-on development ✅ Apache Spark 2.x / 3.x ✅ Cloudera Data Platform (CDP) 7.x or equivalent enterprise Hadoop distribution ✅ Apache Hive 3.x and Hive table management ✅ Drools Rules Engine — business rule implementation ✅ SQL development and query optimization ✅ Linux production support and troubleshooting ✅ Git and modern version control practices ✅ Spark batch processing, performance tuning, and production issue resolution Key Responsibilities: Own and enhance the Scala/Spark application framework for Medicaid Encounter Processing. Maintain and implement Drools business rules and regulatory changes. Manage enterprise data ingestion and Spark/Hive batch workflows. Troubleshoot production defects and distributed Spark application issues. Handle production releases, deployments, and version management. Optimize application performance, reliability, and scalability. Support Cloudera platform monitoring and operational administration. Maintain technical documentation and operational procedures. Preferred Qualifications: Medicaid / Healthcare data processing experience Medicaid Encounter Processing experience Cloudera Manager, HDFS, and YARN IBM DataStage integration AWS infrastructure supporting Cloudera Agile, Jira, and Confluence Refer Apply To This Job