[Remote] Lead Data Software Engineer
Note: The job is a remote job and is open to candidates in USA. EPAM Systems is seeking a Lead Data Software Engineer to combine hands-on technical contribution with leadership accountability on mission-critical data projects. The role focuses on building scalable data pipelines and services, shaping architecture, improving delivery processes, guiding technical teams, and overseeing production support and deployment.
Responsibilities
- Construct and uphold the codebase behind ETL and ELT pipelines, along with large batch, micro-batch, and streaming systems
- Build the infrastructure needed to extract, transform, and load data efficiently from diverse sources using ADF, Spark, Kafka, or related technologies
- Pinpoint, plan, and implement internal process improvements, including automating manual tasks, refining data delivery, and adapting infrastructure to enhance scalability
- Design and launch data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other associated UI and API tools
- Sustain governance over delivery management and production processes, in keeping with the selected delivery model
- Serve as the principal contact for delivery-related issues with senior leadership and stakeholders, including escalations, upsells, and ramp-downs
- Guide technical direction across the delivery process, ensuring the architecture remains solid and forward-looking while implementation satisfies quality expectations
- Compose user stories together with their associated acceptance criteria within an agile/scrum framework
- Align contributions across multiple disciplines and stakeholders to maintain delivery momentum
- Verify that project delivery follows customer processes and methodologies, drawing on strong familiarity with various delivery models and an agile-oriented mindset
- Create a continuous delivery risk management framework that supports proactive decision-making throughout the delivery lifecycle
- Observe and improve delivery productivity as time progresses
- Function as a technical resource for Data Engineers, helping ensure their deliverables meet quality and timeliness expectations
- Take responsibility for production support and deployment activities
Skills
- At least 5 years of experience in a similar role
- A minimum of one year of experience leading and managing teams
- Strong command of core Python for data engineering tasks
- Skilled in SQL for data querying and processing
- Hands-on experience with Apache Spark for processing data at scale
- Familiarity with Anthropic Claude Code
- Experience with Databricks applied to data engineering and analytics work
- Excellent English proficiency (B2 level or higher)
- Experience with Apache Kafka for handling streaming data flows
- Working familiarity with Java
- Hands-on experience with PySpark
- Exposure to Scala
- Experience with Spark Streaming
Benefits
- International projects with top brands
- Work with global teams of highly skilled, diverse peers
- Healthcare benefits
- Employee financial programs
- Paid time off and sick leave
- Upskilling, reskilling and certification courses
- Unlimited access to the LinkedIn Learning library and 22,000+ courses
- Global career opportunities
- Volunteer and community involvement opportunities
- EPAM Employee Groups
- Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn
Company Overview
Company H1B Sponsorship