[Remote] Data Engineer

Note: The job is a remote job and is open to candidates in USA. Quantum World Technologies Inc. is seeking a Data Engineer to build and maintain secure, scalable, and automated data pipelines. The role focuses on data ingestion, transformation, CI/CD implementation, automated testing, monitoring, and collaboration with data modelers and architects.

Responsibilities

• Data Pipelines: Develop configuration driven ingestion and transformation pipelines using AWS Glue, Lambda, and Redshift
• Automation: Implement CI/CD pipelines for automated build, test, and deployment of data products
• Testing: Establish automated test frameworks for schema validation, data quality, and performance testing
• Monitoring: Set up monitoring and observability dashboards for product level metrics (CloudWatch, custom metrics)
• Collaboration: Work with data modelers and architects to ensure alignment with business requirements

Skills

• Proficiency in Python, SQL, and shell scripting
• Hands on experience with AWS services (Glue, Redshift, S3, Lambda, CloudWatch)
• Experience with CI/CD tools (Terraform, Jenkins, AWS CodePipeline)
• Strong knowledge of ETL/ELT processes and frameworks
• Strong problem solving, collaboration, and communication skills

Company Overview