[Remote] Data Engineer (ETL & Databricks)
Note: The job is a remote job and is open to candidates in USA. Kentro is a federal consulting and technology solutions company that delivers innovative solutions and supports mission success for government customers. The Data Engineer will implement, enhance, and administer a modern Databricks data platform, developing scalable ETL/ELT pipelines and supporting data governance, Master Data Management, reporting, and analytics initiatives.
Responsibilities
- Develop, maintain, and optimize Databricks notebooks, workflows, and ETL/ELT pipelines
- Build and maintain data ingestion pipelines using PySpark, SQL, and Delta Lake
- Support Medallion Architecture (Bronze, Silver, Gold) and Lakehouse implementations
- Assist with performance tuning, cluster optimization, and operational support
- Support Unity Catalog, data governance, and security best practices
- Support enterprise Master Data Management initiatives
- Assist with data quality, matching, standardization, and data stewardship activities
- Work with enterprise data governance teams to improve metadata, lineage, and business glossary initiatives
- Help ensure consistency and integrity of enterprise data across multiple systems
- Partner with business users to understand reporting requirements
- Support MI/BI reporting initiatives
- Develop datasets supporting dashboards and analytics
- Troubleshoot data quality and reporting issues
- Participate in Agile ceremonies
- Work with cross-functional technical teams
- Document technical solutions and data flows
- Participate in code reviews and knowledge sharing
Skills
- Bachelor's degree in Computer Science, Information Systems, Data Engineering, or a related technical field
- Minimum of 5 years of experience designing, developing, and supporting enterprise data solutions using Databricks
- Minimum of 5 years of experience with SQL and Python/PySpark
- Experience developing ETL/ELT pipelines and working with Delta Lake and Lakehouse architecture
- Experience working within AWS cloud environments
- Experience supporting enterprise data governance and data quality initiatives
- Experience working in Agile development environments
- Must possess an active Databricks certification, such as: Databricks Certified Data Engineer Associate, Databricks Certified Data Engineer Professional, Databricks Certified Data Analyst Associate, Databricks Certified Machine Learning Associate, Other current Databricks certifications
- US Citizen
- Willing and able to obtain and maintain Public Trust Clearance
- Must meet updated ID requirements
- AWS Databricks
- AWS services (S3, IAM, Lambda, Glue, EMR, Redshift, Athena, CloudFormation, CloudWatch)
- Apache Spark
- Delta Lake
- Unity Catalog
- Master Data Management (MDM)
- Informatica MDM
- Reltio
- Profisee
- Snowflake
- Data Governance
- Data Catalog
- Metadata Management
- Data Lineage
- Power BI or Tableau
- Jira / Agile methodologies
- Federal consulting experience
- Experience supporting Public Trust programs
Benefits
- Remote work arrangement
- Paid time off
- Healthcare benefits
- Supplemental benefits
- 401k including an employer match
- Discount perks
- Rewards
- Education reimbursement for certifications, degrees, or professional development; reimbursement amounts may fluctuate due to IRS limitations
- Flexibility to take a course, complete a certification, or pursue other professional growth and networking
- Funds for virtual and in-person activities, including happy hours, holiday events, fitness and wellness events, and annual celebrations
- Hosting and attendance at charity galas and events
Company Overview