[Remote] Data Engineer
Note: The job is a remote job and is open to candidates in USA. Gofer is seeking an experienced Data Engineer for a 12+ month contract engagement supporting enterprise data integration solutions in the banking sector. The role focuses on designing, developing, testing, deploying, monitoring, and governing data pipelines using Informatica IDMC/IICS/CDI and Snowflake, while collaborating with data, platform, governance, security, and IT teams.
Responsibilities
- ETL/ELT Development: Design, build, and maintain data pipelines using Informatica IDMC, including mappings, mapplets, transformations, and task flows. Develop and optimize SQL-based transformations in Snowflake across staging, integration, and curated layers. Implement reusable frameworks for error handling, data cleansing, parameterization, and pipeline orchestration
- Data Quality & Testing: Perform unit, integration, and regression testing for new or modified pipelines. Execute post-load reconciliation, validation rules, completeness checks, and anomaly detection. Implement automated data quality workflows using IDMC and/or Snowflake Tasks & Streams
- Environment & Release Management: Support migration of Informatica IDMC artifacts between Dev and Prod environments. Ensure IDMC pipelines, connections, and Secure Agent configurations are deployment-ready
- Operational Support: Monitor pipeline executions, address load failures, and resolve data quality and processing issues. Diagnose root causes related to schema drift, source system changes, or unexpected data patterns. Collaborate with Platform Administrators to support scheduled workflows in JAMS
- Governance, Documentation & Metadata: Develop and maintain mapping documents, data flow diagrams, and end-to-end lineage documentation. Ensure datasets meet governance requirements including glossary alignment, classification, and usage rules. Maintain metadata accuracy within governance tools and Snowflake information schema
- Security & Compliance: Ensure pipelines adhere to data handling standards including PII protections, masking, and role-based access controls. Participate in audit support, access reviews, and change control processes. Collaborate with IT Security and Risk teams to implement approved security controls in accordance with enterprise standards
Skills
- 5+ years of hands-on experience designing, developing, and supporting enterprise-scale data integration solutions, including mappings, mapplets, taskflows, parameterisation, reusable frameworks, batch and incremental ingestion, and ETL/ELT development
- 5+ years of advanced SQL development experience including complex query optimization, performance tuning, ELT development, and transformation implementation within Snowflake environments
- 5+ years of experience with Git-based source control and Azure DevOps for collaborative development, branching strategies, pull requests, code reviews, work item management, and release management
- 5+ years of experience designing, implementing, and supporting CI/CD pipelines for Informatica IDMC/IICS and Snowflake deployments using Azure DevOps, GitHub Actions, GitLab CI/CD, or equivalent platforms
- Experience with Informatica Data Quality (CDQ) including data profiling, validation rules, reconciliation processes, exception handling, and automated quality controls
- Working knowledge of Informatica Cloud Data Governance & Catalog (CDGC) including metadata management, data lineage, business glossary alignment, and governance processes
- Experience monitoring pipeline executions, troubleshooting failures, resolving data integration issues, and optimizing ETL/ELT performance in enterprise production environments
- Familiarity with PII data handling standards, masking techniques, and role-based access control implementation
- Ability to develop and maintain technical documentation including mapping documents, data flow diagrams, and lineage documentation
- Experience in the Financial Services industry
- Experience supporting regulatory compliance initiatives within data governance frameworks
- Familiarity with JAMS or similar enterprise job scheduling platforms
Company Overview