[Remote] Sr. Machine Learning Engineer

Note: The job is a remote job and is open to candidates in USA. Compunnel Inc. is seeking a Senior Machine Learning Engineer to help lead the design and validation of AI-driven product capabilities within the legal technology domain. The role focuses on using Python and large language models to define, build, evaluate, and deploy scalable solutions for complex legal workflows while partnering with data scientists and cross-functional teams.

Responsibilities

• Design, build, and deploy scalable machine learning and generative AI solutions for legal technology products
• Develop and optimize NLP, LLM, and Retrieval-Augmented Generation (RAG) applications for production environments
• Engineer agentic AI workflows and multi-step reasoning systems to automate complex legal processes
• Implement and improve retrieval systems, including vector databases, semantic search, lexical search, and hybrid search architectures
• Build and maintain ML pipelines, APIs, model serving infrastructure, and cloud-based AI platforms
• Establish MLOps best practices for model deployment, monitoring, observability, versioning, and lifecycle management
• Evaluate and optimize model performance, latency, scalability, and cost efficiency across AI applications
• Partner with product managers, legal subject matter experts, data scientists, and software engineers to deliver business-focused AI solutions
• Troubleshoot production ML systems, identify performance bottlenecks, and implement continuous improvements
• Provide technical leadership and mentorship on machine learning engineering, LLM architecture, and AI platform best practices

Skills

• 7-10+ years of AI/machine learning engineering experience (building RAG systems end-to-end, deploying through production) – needs to come from career start in software/python engineering, then have moved more into MLE
• Experience designing agentic workflows and using generative AI based techniques ( ex: prompt engineering, RAG system end to end builds)
• Experience with unstructured data (text, documents) – document processing, NLP/text, embeddings/retrievals, agentic, etc
• Strong experience with and creating production-grade ML systems at scale
• Strong LLM, Generative AI, RAG deployment experience (implementations, as well as evaluations – end-to-end)
• Experience following deployment lifecycle of product build and maintenance/new feature development)
• Experience working alongside data scientist through production deployment/cycle
• Strong python background
• 100% Remote, but need to work EST hours

Benefits

• 100% remote work arrangement, with work required during EST hours
• Contract position

Company Overview

Company H1B Sponsorship