[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Randstad Digital is hiring professionals for contract technology opportunities. The Data Engineer will design and develop APIs, web applications, data pipelines, data models, cloud infrastructure, automated tests, and scalable AWS-based data solutions.
Responsibilities
- Backend & APIs: Design, develop, and implement secure RESTful and GraphQL APIs, microservices, and low-latency data services integrated with data pipelines using Python, Boto3, and AWS services
- Frontend UI: Build and maintain responsive, modular web applications utilizing React, JavaScript, HTML, and CSS
- Data Pipelines & ETL: Architect, build, and maintain high-performance batch and near-real-time ETL pipelines using pySpark, AWS Glue, AWS Batch, or similar tools, orchestrated with tools like Apache Airflow. Process diverse data formats across SQL data warehouses and unstructured sources, collaborating cross-functionally to deliver scalable data solutions
- Data Modeling & Storage: Optimize performance and design schema models across relational PostgreSQL, SQL Server and NoSQL DynamoDB databases, along with data warehouses like Snowflake
- DevOps & Infrastructure: Manage infrastructure monitoring with CloudWatch, incident response, and CI/CD pipelines leveraging Jenkins, Docker, Kubernetes/EKS, and Git/GitHub. Experience utilizing and developing within AWS services. Troubleshoot and resolve issues related to AWS services and infrastructure
- Testing: Establish rigorous automated unit and integration test suites to ensure high reliability and system stability
- Cloud Optimization: Optimize data storage and processing using cloud-native services and technologies such as AWS S3, AWS Glue, AWS Batch, Lambda, and related AWS services
Skills
- Education: Bachelors
- Languages & Frameworks: Python, Advanced SQL, JavaScript, HTML, CSS, React
- Data Engineering & Analytics: Apache Spark, pySpark, Snowflake, AWS Glue, AWS Batch, ETL pipeline design, Apache Airflow
- Databases & Storage: AWS S3, Relational databases PostgreSQL, SQL Server, NoSQL DynamoDB
- API & Backend Development: REST API design, GraphQL/Apollo, Boto3, API contracts, microservices, low-latency API integration
- AWS Infrastructure & Cloud Services: Lambda, ECS, EC2, RDS, Route53, S3, CloudWatch, serverless architectures
- DevOps & Testing: Jenkins, Docker, Kubernetes/EKS, CI/CD pipelines, Git/GitHub, automated testing unit/integration
- Languages & Frameworks: Nice to have: Java, Kotlin, C#
- API & Backend Development: Nice to have: SQS/SNS messaging
- Strategic Nice-to-Haves: IAM, cybersecurity data environments, access governance, identity platforms, Spring Batch, event-driven architectures
Benefits
- Medical insurance offerings (all benefits are based on eligibility)
- Prescription insurance offerings (all benefits are based on eligibility)
- Dental insurance offerings (all benefits are based on eligibility)
- Vision insurance offerings (all benefits are based on eligibility)
- AD&D insurance offerings (all benefits are based on eligibility)
- Life insurance offerings (all benefits are based on eligibility)
- Short-term disability (all benefits are based on eligibility)
- A 401K plan (all benefits are based on eligibility)
Company Overview
Company H1B Sponsorship