[Remote] Data Engineer, Databricks

Note: The job is a remote job and is open to candidates in USA. KeyLogic is seeking a Data Engineer to support the Department of Energy with Databricks-based data engineering solutions. The role focuses on designing, building, maintaining, and optimizing scalable data pipelines and infrastructure while ensuring reliable data integration, processing, quality, and availability.

Responsibilities

• Design, build, and maintain scalable data pipelines using Databricks
• Develop and implement infrastructure as code solutions with Terraform
• Collaborate with cross-functional teams to understand data requirements and deliver robust solutions
• Optimize data workflows for performance, reliability, and scalability
• Monitor, troubleshoot, and resolve issues related to data processing and infrastructure
• Ensure data quality and integrity throughout the data lifecycle
• Automate repetitive tasks to improve efficiency and reduce manual intervention

Skills

• U.S. Citizenship
• 2+ years of engineering experience on Databricks and large-scale big data projects (Delta Lake, DLT, Apache Spark, unity Catalog)
• Bachelor's Degree
• 4+ years of experience in Python, Java, or equivalent. Comfortable with evaluation tooling, logging, monitoring, and observability
• Experience with government contracting

Benefits

• Remote work

Company Overview