Data Engineer - 100% Remote
About the Role
The organization is seeking a Data Engineer to develop and maintain scalable data solutions for complex engineering, business, and mission-related challenges. This remote position focuses on data pipeline development, systems integration, data governance, data quality, and large-scale data processing. You will work with technologies such as Palantir Foundry, Databricks, Python, Spark, Scala, and SQL to build reliable data pipelines and support data-driven decision-making. The role also involves working with machine learning models or generative AI, integrating APIs, and supporting applications related to the Department of War (DoW) mission and associated datasets.
Key Responsibilities
Analyze science, engineering, business, and other data-processing problems to develop and implement solutions for complex applications, system administration issues, and network concerns. Perform systems management and integration, improve existing computer systems, and review system capabilities, workflows, and scheduling limitations. Analyze or recommend commercially available software when needed. Implement and enforce data governance policies and procedures in accordance with regulatory requirements and industry best practices. Troubleshoot data-related problems and develop solutions to complex data challenges. Collaborate with data scientists, analysts, and stakeholders to provide timely, accurate data insights and support decision-making. Use big data technologies to process and analyze large datasets efficiently. Perform data cleansing, data integration, and data quality assurance to maintain dataset accuracy and integrity. Build and optimize scalable, reliable, high-performance data pipelines. Work with cross-functional teams to understand data requirements and design appropriate data models and architectures. Design, develop, and implement end-to-end data pipelines using ETL processes and technologies including Databricks, Python, Spark, Scala, JavaScript/JSON, and SQL.
Required Qualifications
Active Secret security clearance. 3–10 years of directly related experience and a bachelor's or master's degree in a related field. At least 3 years of experience as a Data Engineer. Experience building applications within Palantir Foundry, including Workshop, Ontology Manager, and Gaia. Experience with machine learning models and/or generative AI. Experience working with APIs. Previous experience with Advana or the War Data Platform. Experience with the Department of War (DoW) mission and associated datasets. Understanding of data modeling and visualization, database design principles, and data governance practices. Experience working with large datasets and applying big data technologies to process and analyze data efficiently. Proficiency in ETL processes and hands-on experience with Databricks, Python, Spark, Scala, JavaScript/JSON, SQL, and Jupyter Notebooks. Location and Work Arrangement This is a remote position. An active Secret security clearance is required.