[Remote] Senior Data Software Engineer
Note: The job is a remote job and is open to candidates in USA. EPAM Systems is seeking a Senior Data Software Engineer to join its Data Practice and work across diverse client domains and technologies. The role focuses on building data ingestion and transformation pipelines, optimizing data platforms, collaborating with cross-functional teams, and maintaining the integrity and security of big data systems.
Responsibilities
- Implement data ingestion from diverse sources utilizing technologies including RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP
- Research and utilize Big Data technologies for effective data ingestion
- Process and transform data using tools such as Spark and various Cloud Services
- Understand and execute project-specific business logic through programming languages supported by the primary data platform
- Optimize data retrieval, develop dashboards, and perform data validation
- Collaborate with diverse teams including data scientists, analysts, and IT professionals
- Provide thought leadership on Big Data best practices and technology trends
- Maintain and ensure integrity and security of big data sources and platforms
- Perform troubleshooting, debugging, and upgrading of big data systems and applications
Skills
- Bachelor's degree in Computer Science, Mathematics or related technical field
- 5+ years experience in software development with Big Data technologies
- Advanced knowledge of Python, Scala, or Java
- Proficient with Spark and Databricks and/or Snowflake
- Experience with cloud platforms such as Azure, Google Cloud Platform, Amazon Web Services
- Demonstrated experience with big data models, databases, and tools
- Strong understanding of different data file formats like JSON, Parquet, Avro
- Hands-on experience with SQL and NoSQL databases, including Cassandra and MongoDB
- Proficiency in data warehousing solutions, ETL processes
- Proven ability to work within a fast-paced, team-oriented environment
- Detail-oriented with excellent analytical and problem-solving skills
- Knowledge of software development methodologies and best practices
- Exceptional oral and written communication skills in English (B2+)
- Experience with Hadoop, Spark, Kafka, Oozie, Airflow, HDFS, YARN
- Experience with message queues, especially Kafka
- Production experience in search technologies such as Solr, OpenSearch, or Lucene
Benefits
- Hybrid by design mode and opportunity to work remotely within Poland
- Chance to work abroad for up to 60 days annually
- Business-driven relocation opportunities
- Career development programs
- Thought leadership, mentoring, soft skills and well-being programs
- Certification (Anthropic, Gemini, GCP, Azure, AWS)
- English classes
- Participation in the Employee Stock Purchase Plan with a 15% discount
- Benefits package (health insurance, multisport, shopping vouchers)
- Referral bonuses up to $2,000
- Offices featuring entertainment and relaxation zones, table tennis and football, free snacks, coffee and more
- Corporate, social and well-being events
- Supportive team and agile, startup-like culture
Company Overview
Company H1B Sponsorship