[Remote] Senior Data Engineer
Note: The job is a remote job and is open to candidates in USA. EPAM Systems is seeking an experienced Senior Data Engineer to evolve its data platform. The role focuses on designing and building Python-based platform components, managing Azure data services and pipelines, overseeing operations, and implementing DataOps practices to deliver reliable and scalable data solutions.
Responsibilities
- Design, build and optimize ETL/data pipelines for large-scale data operations
- Develop and maintain platform components using Python and PySpark
- Manage and enhance Data pipelines on Azure Databricks, Azure Data Factory and Azure Synapse Analytics
- Oversee data platform operations, troubleshooting and performance tuning
- Implement DataOps practices, including CI/CD and Terraform automation
- Validate and compare large data volumes to ensure data quality and accuracy
- Collaborate with cross-functional teams to deliver robust, scalable data solutions
Skills
- Strong hands-on experience in Data Engineering, ETL and data integration
- Proven experience with Azure Data Factory and Databricks
- Strong Python, PySpark, and SQL skills, with experience in Python OOP and ORMs
- Deep understanding of Databricks features (e.g., Unity Catalog) and system integrations
- Experience with DataOps, CI/CD pipelines and Terraform on Azure
- Excellent troubleshooting, problem-solving and communication skills
- Ability to work independently, manage multiple tasks and deliver under tight deadlines
Benefits
- Eligible for a one-month sign-on bonus (Terms & Conditions apply).
- Job at a Vietnam Best Workplace™ certified company (2022-23 and 2023-24).
- Work with the latest and most advanced technologies on exciting global projects with a supportive multicultural team where your voice matters.
- Flexible hybrid working model.
- Generous annual leave of up to 19 days.
- Transparent career path and an individual roadmap to engineer your future and accelerate your journey.
- Access to over 25,000 online courses and libraries from industry leaders.
- English classes.
- Mentoring programs.
- Partial grants of certification.
- Experience exchange with colleagues around the world.
Company Overview
Company H1B Sponsorship