[Remote] Sr. Data Engineer
Note: The job is a remote job and is open to candidates in USA. NeueHealth is a value-driven healthcare company focused on coordinated, accessible, and affordable care. The Senior Data Engineer will create and maintain data and software properties, build APIs, microservices, ETL pipelines, and Azure-based data ingestion frameworks, and develop LLM and RAG solutions while supporting DevOps, quality assurance, documentation, and team productivity.
Responsibilities
- Write traditional code and server-less functions using the language best suited for the task, which is primarily Scala. May include development with C# and SQL
- Build APIs, data microservices and ETL pipelines, to share data with internal and external partners and write interfaces to public data sets to enrich our analytics data stores
- Develop and optimize processes for fine-tuning large language models (LLMs) and implementing Retrieval-Augmented Generation (RAG) frameworks to enhance AI-driven solutions
- Participate in building and owning a culture of DevOps and Quality Assurance
- Continuously document your code, framework standards, and team processes
- Build and support Data Ingestion frameworks deployed in Azure
- Other duties and responsibilities as assigned
Skills
- Bachelor's degree in Computer Science, Computer Engineering, Information Systems, or equivalent experience required
- Around Five (5) years of experience in an enterprise or commercial software development environment
- Enterprise development experience coding in Scala
- Experience building batch and streaming data pipelines (Scala)
- Experience with API design
- Extensive experience developing data-intensive solutions in a Cloud environment
- Extensive experience developing solutions that use event sourcing and/or Big Data architectures
- Healthcare IT background is highly preferred
- Experience engineering big-data solutions using technologies like Databricks, Hive, and Spark
- Experience with functional programming in Scala and C#
- Experience building distributed systems with microservices and/or service-oriented architectures
- Experience working within an Azure environment. Hands on Azure admin and DevOps experience is a plus
- Familiarity with containerization/virtualization, e.g., Docker, Kubernetes
- Familiarity with Databricks infrastructure management
- Familiarity with CI/CD best practices
Company Overview