[Remote] Databricks Engineer Certified - Remote
Note: The job is a remote job and is open to candidates in USA. AbarVa is an AI-native enterprise transformation company whose Nexus platform connects business, technology, data, vendors, programs, risks, and value. The Data Engineer will design and build Databricks ingestion pipelines and data foundations, develop governed data products for analytics and natural-language AI consumption, and ensure data quality, lineage, and traceability.
Responsibilities
- Design and build ingestion pipelines from core operational, transactional, and financial source systems into Databricks
- Develop and deploy a reusable metadata-driven ingestion framework
- Build with AI coding assistants as part of the standard development loop - specify, generate, review, test - and know where the assistant is wrong
- Model and curate data for natural-language consumption through Databricks Genie and Claude on Bedrock: clear semantics, defined metrics, described columns, certified tables
- Develop data products, not one-off pipelines - a named consumer, a contract, quality expectations, and documentation someone else can use without asking you
- Profile, analyze, and document source and legacy datasets; identify data quality issues and surface them with evidence
- Recover and re-implement business logic from legacy data warehouses being decommissioned
- Build Delta Lake medallion pipelines and apply Unity Catalog governance - tenant isolation, entitlements, lineage
- Partner with data governance and MDM workstreams on lineage, quality, and identity
Skills
- Active Databricks certification - Data Engineer Associate or Professional
- 3+ years data engineering (5+ preferred)
- Advanced SQL; Python; PySpark
- Delta Lake, Unity Catalog, medallion architecture, workflow orchestration
- AWS - S3, IAM, VPC/networking fundamentals
- Demonstrated use of AI coding assistants (Claude Code, OpenAI Codex, GitHub Copilot) in production development
- Data profiling and analysis - able to open an unfamiliar dataset and explain what's in it
- Product mindset - designs to a consumer and a decision, not to a ticket
- Authorized to work in the United States on a permanent basis without employer sponsorship, now or in the future
- Location: Remote within the United States, with occasional travel
- 5+ years data engineering
- Databricks Genie / AI-BI, or Anthropic Claude on AWS Bedrock
- Semantic modeling, metric layers, or building datasets for natural-language query
- Regulated data environments - PHI, PII, or financial data under audit
- Legacy warehouse migration (Netezza, Exadata, Teradata)
- Dbt, Airflow, Git-based CI/CD, Terraform
Benefits
- Benefits are provided.
- Remote within the United States
- Full-time, W2 only
Company Overview