[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Code17Tek is seeking a Senior AWS Data Engineer to design, develop, and support scalable cloud-based data solutions. The role focuses on building AWS data pipelines, data lakes, lakehouse solutions, integrations, orchestration workflows, monitoring, security, and CI/CD processes while collaborating with technical and business stakeholders.
Responsibilities
- Design and develop scalable ETL/ELT data pipelines using AWS services
- Build and maintain data lakes and lakehouse solutions using Amazon S3
- Develop data-processing workflows using AWS Glue, Python, PySpark, and SQL
- Work extensively with either Databricks or Snowflake for data transformation, storage, and analytics
- Integrate data from databases, APIs, files, streaming systems, and third-party platforms
- Design efficient data models and optimize pipelines for performance, scalability, reliability, and cost
- Implement data-quality checks, error handling, monitoring, logging, and alerting
- Develop workflow orchestration using Apache Airflow, AWS Step Functions, or similar tools
- Work with services such as Amazon Redshift, Lambda, EMR, Kinesis, and Athena as required
- Implement CI/CD processes using GitHub Actions, Jenkins, AWS CodePipeline, or similar tools
- Apply security, governance, encryption, and access-control standards using AWS IAM and related services
- Collaborate with architects, analysts, data scientists, and business stakeholders to deliver reliable data solutions
Skills
- • 5+ years of experience in data engineering
- • 3+ years of hands-on experience building data solutions on AWS
- • Strong experience with AWS Glue, Amazon S3, Lambda, and other AWS data services
- • Strong hands-on experience with either Databricks or Snowflake
- • Proficiency in Python, PySpark, and SQL
- • Experience developing scalable ETL/ELT pipelines and data-integration solutions
- • Strong understanding of data lakes, data warehouses, lakehouse architecture, and medallion architecture
- • Experience integrating structured, semi-structured, and unstructured data
- • Knowledge of data modeling, performance optimization, data quality, and production monitoring
- • Experience working with REST APIs and data formats such as JSON, XML, CSV, and Parquet
- • Strong communication and problem-solving skills
- • Experience with Amazon Redshift, EMR, Athena, Kinesis, or MSK
- • Experience with Apache Airflow or AWS Step Functions
- • Knowledge of Terraform or AWS CloudFormation
- • Experience with CI/CD and automated deployment processes
- • Familiarity with AWS security, governance, and cost-optimization practices
- • AWS, Databricks, or Snowflake certification is a plus
Benefits
- Remote work arrangement
- Full-Time / Contract employment
Company Overview