[Remote] Data Pipeline Engineer | Remote
Note: The job is a remote job and is open to candidates in USA. Crossing Hurdles is seeking a Software Engineer specializing in Human Data Platforms. The role involves building and shipping features across various technologies while developing and maintaining data pipelines to ensure efficient data processing.
Responsibilities
- Build and ship features across backend and frontend technologies, including Python/FastAPI and React/Next.js/TypeScript
- Develop and maintain data pipelines for evaluation and model control layers to ensure efficient data processing
- Own and manage secure document pipelines, ensuring proper permissions and preventing data leakage
- Create and enhance OCR and search systems for processing PDFs, images, and scanned documents
- Parse and enforce complex nested JSON structures to support data integrity and application functionality
- Debug and scale pipelines and storage systems while improving performance, reliability, and overall system design
Skills
- Have strong relevant experience in building applications using Python (FastAPI) and React
- Be comfortable working across the entire technology stack
- Possess solid fundamentals in APIs, SQL, async systems, and data modeling
- Have experience with cloud platforms such as AWS, GCP, or Azure
- Demonstrate the ability to work with complex data systems or pipelines
Company Overview