[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. SoftStandard Solutions is seeking an experienced Data Engineer/Python Developer to develop data pipelines, backend applications, and scalable data processing solutions. The role focuses on building and optimizing ETL/ELT workflows, Python applications, Spark-based processing pipelines, database integrations, and cloud data workflows while ensuring data quality and collaborating with cross-functional teams.
Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using Python and SQL
- Develop Python-based applications, scripts, APIs, and automation solutions
- Build and optimize data processing pipelines using PySpark/Apache Spark
- Work with relational and NoSQL databases for data ingestion, transformation, and storage
- Implement data quality, validation, monitoring, and error-handling processes
- Develop and maintain workflows using tools such as Airflow, Azure Data Factory, or Databricks
- Integrate data from APIs, databases, files, and cloud-based sources
- Optimize SQL queries and data pipelines for performance and scalability
- Collaborate with data scientists, analysts, software engineers, and business stakeholders
- Follow CI/CD, Git, Agile, and data engineering best practices
Skills
- 4–5 years of professional experience in Data Engineering/Python Development
- Strong proficiency in Python and SQL
- Hands-on experience with Pandas, NumPy, PySpark, and REST APIs
- Strong understanding of ETL/ELT, data warehousing, data modeling, and database concepts
- Experience with Apache Spark and distributed data processing
- Experience with at least one cloud platform: AWS, Azure, or GCP
- Knowledge of Databricks, Airflow, Azure Data Factory, or similar orchestration tools
- Experience with PostgreSQL, MySQL, SQL Server, Snowflake, or similar databases
- Strong knowledge of Git, CI/CD, testing, and Agile methodologies
- Microsoft Certified: Fabric Data Engineer Associate (DP-700)
- Databricks Certified Data Engineer Associate
- Google Cloud Professional Data Engineer
- AWS Certified Data Engineer – Associate
Company Overview
Company H1B Sponsorship