[Remote] Sr AI Context Engineer

Note: The job is a remote job and is open to candidates in USA. Government Employees Health Association, Inc. (G.E.H.A) is a nonprofit member association that provides health and dental benefits to federal employees, retirees, and their families. The Senior AI Context Engineer transforms enterprise information into high-quality context for AI applications by developing extraction, chunking, vector indexing, retrieval, security, compliance, and evaluation workflows. The role collaborates with AI architects, developers, and enterprise partners to support secure and accurate GenAI solutions.

Responsibilities

• Extraction & Chunking: Build and refine advanced structured and unstructured information parsing, layouts processing, and chunking workflows (converting PDFs, clinical notes, data, and policy docs) into high-quality contextual units for LLMs in partnership with cross-functional teams
• Semantic Search & Reranking: Implement hybrid search mechanics, metadata routing, and reranking logic to drastically improve retrieval precision and minimize model hallucinations
• Agentic Context Services: Design context payload specifications and metadata structures that feed into Model Context Protocol (MCP) servers and LLM orchestration tools built by application developers
• Index Design & Optimization: Recommends and implements vector indexing strategies, embedding schemes, and semantic query designs inside enterprise-provisioned vector stores (e.g., Pinecone, pgvector, Azure AI Search) to ensure high-performance, low-latency retrieval
• Vector Metadata: Design and manage sophisticated metadata tagging schemes to enable precise filtering, hybrid search, and domain-specific context retrieval
• Retrieval Evaluation & Groundedness: Establish automated evaluation frameworks to continuously monitor retrieval relevance, context quality, groundedness scores, and embedding drift over time
• Healthcare Context Compliance: Ensure all document processing and contextual payloads strictly adhere to HIPAA and HITRUST standards, implementing automated masking and tokenization for Protected Health Information (PHI)
• Context-Level Access Control: Ensure role-based access control (RBAC) rules within vector metadata, ensuring AI search queries only return contextual snippets that the active user is authorized to see
• Auditing & Hand-off Lineage: Maintain context tracking and audit logs for prompt payloads, establishing clean data hand-off specifications when transitioning validated innovation prototypes to enterprise Data & Analytics or IT teams
• Reference Pattern Alignment: Build upon the reference architectures, CI/CD templates, and "golden paths" established by the Sr. AI Solutions Architect
• Product Support: Work alongside the AI Product Owner and AI Full Stack Developers to rapidly supply high-accuracy context layers for upcoming GenAI features

Skills

• * Experience: 5+ years of experience in backend software engineering, applied machine learning/search, or data-centric application development
• * GenAI & RAG Focus: 1–2 years of hands-on experience specifically optimizing AI and RAG architectures, prompt context strategies, and vector retrieval pipelines for LLM applications
• * Programming & Tooling: Advanced proficiency in Python and SQL, alongside familiarity with modern orchestration tools (e.g., Airflow, Prefect, Temporal)
• * Unstructured Content Parsing: Deep experience using parsing frameworks (e.g., LlamaIndex, Unstructured.io, LangChain document loaders) to process complex layouts, tables, and unstructured documents
• * Vector & Search Engines: Hands-on experience working with vector databases, embeddings, and semantic search platforms (e.g., Pinecone, pgvector, Weaviate, Qdrant, Azure AI Search)
• * Evaluation Frameworks: Familiarity with RAG and LLM context evaluation frameworks (e.g., Ragas, TruLens, Arize Phoenix) to measure retrieval recall, precision, and groundedness
• * Data Security & Privacy: Practical experience handling sensitive healthcare data (PHI/PII) within high-compliance software environments
• * Must have the ability to provide a non-cellular High Speed Internet Service such as Fiber, DSL, or cable Modems for a home office
• * A minimum standard speed for optimal performance of 30x5 (30mpbs download x 5mpbs upload) is required
• * Latency (ping) response time lower than 80 ms
• * Hotspots, satellite and wireless internet service is NOT allowed for this role
• * A dedicated space lacking ongoing interruptions to protect member PHI / HIPAA information
• While this is a remote opportunity, at this time G.E.H.A does not hire employees from U.S. territories or the following states: Alaska, Hawaii, California, Washington, Oregon, Colorado, Wyoming, Montana, New York, Connecticut, Vermont, Pennsylvania, Maine

Benefits

• Incentive plan
• Health/Vision/Dental benefits effective day one
• 401(k) retirement plan: company match – dollar for dollar up to 4% employee contribution (pretax or Roth options) plus a 6% annual company contribution
• Robust employee well-being program
• Paid Time Off
• Personal Community Enrichment Time
• Company-provided Basic Life and AD&D
• Company-provided Short-Term & Long-Term Disability
• Tuition Assistance Program
• Remote opportunity
• Hybrid and work-from-home options for many of our roles

Company Overview

Company H1B Sponsorship