[Remote] Senior Databricks Platform & Application Engineer
Note: The job is a remote job and is open to candidates in USA. Sibitalent Corp is seeking a Senior Databricks Platform & Application Engineer to design, develop, deploy, and support applications on the Databricks platform. The role focuses on Databricks platform management, CI/CD, security and governance, Python application development, production support, and PostgreSQL and data pipeline optimization.
Responsibilities
- Design, develop, and deploy applications on the Databricks platform
- Manage and optimize Databricks Workspaces, SQL Warehouses, and Delta Lake architecture
- Implement and maintain Unity Catalog for governance and access management
- Support production Databricks applications and troubleshoot platform-related issues
- Monitor platform performance, reliability, and scalability
- Implement CI/CD pipelines for Databricks applications and data workflows
- Configure IAM roles, service principals, secrets management, and access controls
- Ensure compliance with security and governance standards
- Automate deployment and operational processes
- Develop and maintain Python-based applications hosted on Databricks
- Build APIs, automation scripts, and backend services
- Implement application monitoring, logging, and troubleshooting
- Support production incidents and performance optimization
- Design and optimize PostgreSQL databases
- Write complex SQL queries and develop reporting solutions
- Manage Delta Lake tables and data pipelines
- Ensure data quality, integrity, and performance
Skills
- • 10+ years of overall experience in Data Engineering/Application Engineering
- • 3+ years of hands-on Databricks experience
- • Proven experience taking Databricks-hosted applications from development to production
- • Strong experience in production support , troubleshooting, and operational management
- • Experience implementing CI/CD and security best practices for Databricks environments
Benefits
- Remote work arrangement
Company Overview