[Remote] Senior Cloud Data Engineer - Remote
Note: The job is a remote job and is open to candidates in USA. Optum Insight improves the flow of health data and information to create a more connected health system. The Senior Cloud Data Engineer will migrate on-premises database and ETL solutions to modern cloud data platforms using Azure, Snowflake, Python, and generative AI, while developing scalable solutions and leveraging advanced analytics to improve operational efficiency and business insights.
Responsibilities
- Lead the migration of ETL workloads from on-premises data warehouse platforms to Azure Cloud and Snowflake
- Design, develop, and implement scalable data platform solutions using Azure Data Factory (ADF), Databricks, Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, Snowflake, and Python
- Review, analyze, modernize, and optimize existing SSIS, T-SQL, and legacy ETL solutions
Skills
- 6+ years of ETL development experience using on-premises databases and ETL technologies
- 4+ years of experience as a Cloud Data Engineer
- 3+ years of hands-on experience with Azure Cloud data services including ADF, SHIR, Logic Apps, ADLS Gen2, and Blob Storage
- 3+ years of experience working with Snowflake data platforms
- 2+ years of experience working with Databricks
- 2+ years of experience Python for data engineering, automation, API integration, and AI application development
- 2+ years of experience integrating Large Language Models (LLMs) such as Azure OpenAI, OpenAI, Anthropic Claude, or similar platforms
- 1+ years of experience with Agile methodologies
- Experience developing AI-powered solutions including prompt engineering, document intelligence, semantic search, vector databases, and Retrieval-Augmented Generation (RAG) architectures
- Proven excellent problem-solving skills and ability to work independently
- Proven solid communication and collaboration skills
- Proven solid analytical skills and attention to detail
- Ability to adapt to new technologies and learn quickly
- Ability to travel up to 10%
- Azure Data Engineer, Azure AI Engineer, Azure Solutions Architect, and/or Snowflake certifications
- Experience designing enterprise AI solutions in Azure cloud environments
- Experience with Azure OpenAI Service, Azure AI Search, Azure AI Studio, and Azure Machine Learning
- Proven knowledge of vector databases, embeddings, semantic search, and GenAI application architectures
- Experience implementing data governance, data quality, and AI governance frameworks
- Demonstrated familiarity with Spark, MLflow, or machine learning operationalization (MLOps)
- Experience with healthcare data platforms, HIPAA compliance, and protected health information (PHI) handling
- Demonstrated familiarity with AWS and Google Cloud Platform data and AI services
Benefits
- Flexibility to work remotely from anywhere within the U.S., subject to the stated office requirements for hires in the Minneapolis or Washington, D.C. area
- A comprehensive benefits package
- Incentive and recognition programs
- Equity stock purchase
- 401k contribution
- Development for other roles you may be interested in
Company Overview
Company H1B Sponsorship