[Remote] Lead, Data Engineer
Note: The job is a remote job and is open to candidates in USA. L3Harris Technologies is seeking a Lead Data Engineer to join their Enterprise Data and AI team. This role involves overseeing data ETL/ELT pipelines, maintaining data frameworks, and developing scalable data solutions to empower decision-makers with reliable data across the organization.
Responsibilities
- Provide architectural oversight for the company’s data platform and related initiatives, ensuring alignment with company standards and best practices
- Assist development initiatives with design reviews, offering guidance on architecture and data modeling
- Lead design reviews for proposed solutions, including data sourcing, data pipelines, data models, and ontology resources, providing actionable feedback to enhance design scalability
- Assist and develop architectural artifacts, perform requirements decomposition, and develop other documentation to support the software development lifecycle (SDLC)
- Support the SDLC process by participating in data architecture review sessions, reviewing proposed solutions for compliance with architectural standards
- Oversee and provide guidance for data pipelines, ensuring scalability, reusability, and performance
- Utilize Palantir Foundry to perform data integration and ontology management to support big data analytics at scale
- Collaborate with cross-functional teams to define data governance, metadata, and ontology standards, ensuring consistency and clarity across the data platform and enterprise
- Remain current with emerging data technologies and frameworks to recommend improvements to the data platform architecture
Skills
- Bachelor's Degree and minimum 9 years prior Palantir experience or Graduate Degree and a minimum of 7 years of prior Palantir experience. In lieu of degree, minimum 13 years of prior Palantir experience
- Minimum of 4 years of experience with Data Pipeline development or ETL tools such as Palantir Foundry, Azure Data Factory, SSIS, or Python
- Minimum of 4 years of experience in Data Integration
- Experience supporting or implementing solutions that leverage Generative AI capabilities, including Retrieval-Augmented Generation (RAG), semantic search, and LLM integration
- Experience with Palantir Foundry tools such as Ontology Manager, Compass, Code Repository, Solution Designer, OSDK, AI FDE, and AIP Analyst
- Understanding of BI (Business Intelligence) & DW (Data Warehouse) development methodologies
- Experience with Python, Pandas, Databricks, JavaScript, Typescript or other scripting languages
- Experience with AI tools such as OpenAI, Palantir AIP, Snowflake Cortex, or similar
- Hands on Experience with design, development of Data Pipelines in Palantir Foundry Pipeline Builder or Code Repository, or similar technologies leveraging PySpark and Spark SQL
- Familiarity with SDLC processes and architecture review or data governance board processes
Benefits
- Health and disability insurance
- 401(k) match
- Flexible spending accounts
- EAP
- Education assistance
- Parental leave
- Paid time off
- Company-paid holidays
Company Overview
Company H1B Sponsorship