Senior Data Engineer

Senior Data Engineer The company and our mission: Zartis is a global AI transformation and technology consulting partner where talented engineers and technologists work on cutting edge innovation. We partner with ambitious organizations to design, build, and scale technology solutions that deliver real impact. Our teams bring deep expertise in AI driven platforms, secure API architectures, and cloud native engineering. You will work on meaningful projects that accelerate the adoption of advanced technologies, from strategy and discovery through to full product delivery, helping turn complex challenges into measurable outcomes. With engineering hubs across EMEA and LATAM, and long term partnerships in financial services, healthcare and life sciences, and energy and climate, we offer opportunities to work on projects that truly matter. Here, you will not just build technology, you will drive business impact and grow your career alongside industry leaders. We are looking for a Senior Data Engineer to work on a project in the media sector that has a strong background in ETL development and data pipeline operations. The project: Our teammates are talented people that come from a variety of backgrounds. We’re committed to building an inclusive culture based on trust and innovation. You will be part of a distributed team taking over a large-scale enterprise BI platform serving a major US media company. This is an operational environment — not greenfield — and the work matters every day. You will help keep data flowing reliably from hundreds of external sources, investigate and resolve pipeline issues, and work on the transformation logic that runs on raw data in the database. The platform handles data from 500+ external sources across 100+ providers, with ETL orchestration via SSIS and Prefect, and data ingestion from S3, Azure Blob, SFTP, and other sources. The team is remote, and some timezone flexibility toward US East Coast hours is appreciated. What you will do: Maintain and enhance ETL pipelines across 123 SSIS jobs spanning 8 data domains Manage data ingestion from diverse sources including S3, Azure Blob, SFTP, APIs, and manual/fragile integrations Investigate, debug, and resolve pipeline failures in a live production environment Develop and improve data transformation logic — understanding not just the how, but the why Implement data quality checks, validation rules, and error handling Monitor pipeline health and contribute to observability improvements Collaborate with the broader data engineering and analytics team to support platform stability and evolution Support the ongoing infrastructure migration from IBM Cloud to AWS What you will bring: Proven experience in ETL pipeline design and maintenance in a production environment Hands-on experience with orchestration tools such as SSIS, Prefect, Airflow, dbt, or Azure Data Factory Strong SQL and Python skills Experience with data ingestion across multiple patterns — cloud storage, SFTP, APIs, and real-world messy/fragile sources Solid understanding of data transformation logic and data modelling principles Experience with data quality, validation, error handling, and monitoring Comfortable working within complex legacy systems and established team workflows Good communication skills and a proactive approach to problem-solving Nice to have: Familiarity with SSIS or Prefect specifically Experience with AWS data services (S3, Glue, etc.) Background in media, ad-tech, or content analytics data Experience supporting platform migrations (IBM Cloud to AWS or similar) What we offer: 100%Remote Work WFH allowance: Monthly payment as financial support for remote working. Career Growth: We have established a career development program accessible for all employees with a 360º feedback that will help us to guide you in your career progression. Training: For Tech training at Zartis, you have time allocated during the week at your disposal. You can request from a variety of options, such as online courses (from Pluralsight and Educative.io, for example), English classes, books, conferences, and events. Mentoring Program: You can become a mentor in Zartis or you can receive mentorship, or both. Zartis Wellbeing Hub (Kara Connect): A platform that provides sessions with a range of specialists, including mental health professionals, nutritionists, physiotherapists, fitness coaches, and webinars with such professionals as well. Multicultural working environment: We organize tech events, webinars, parties, and activities to do online team-building games and contests.