AI Backend Engineer (Agent Systems)

About the Company

Our client is a stealth AI startup backed by one of Southeast Asia's leading technology companies and is currently building its global founding team.

The company is developing an AI-native communication platform designed to simplify everyday tasks by integrating AI directly into conversations. Instead of switching between multiple applications, users can plan, organize, compare, research, and complete tasks within a single intelligent assistant.

Serving a market of billions of users still relying on traditional productivity tools, the platform focuses on delivering reliable AI workflows, persistent context, multi-step reasoning, and seamless task execution. The mission is to create an AI assistant that significantly improves productivity while making everyday work simpler and more intuitive.

About the Role

Our client is seeking a AI Backend Engineer to build and operate the backend infrastructure that powers AI-driven experiences across its products. The role focuses on owning the inference and orchestration layer that sits between AI models and end users, ensuring every interaction is fast, reliable, scalable, and cost-efficient.

Working closely with engineering and AI teams, this position will play a key role in designing production-grade backend services, optimizing system performance, and delivering robust AI-powered features across mobile and desktop platforms.

Key Responsibilities

• Build, maintain, and operate backend systems that power AI-enabled features in production.
• Design and implement AI inference pipelines, orchestration layers, and service architectures around AI models.
• Develop scalable, high-performance APIs that integrate seamlessly with frontend applications and machine learning systems.
• Optimize system performance by improving inference latency, throughput, caching, batching, and streaming capabilities.
• Own production operations, including monitoring, logging, alerting, and incident response.
• Troubleshoot and resolve issues within distributed systems to ensure service reliability and stability.
• Continuously improve backend architecture and production systems based on operational insights and real-world usage.
• Collaborate with cross-functional teams to deliver reliable, scalable, and high-quality AI-powered solutions.

Requirements

• Strong backend engineering experience in production environments.
• Proven experience building and operating high-throughput, low-latency backend services.
• Experience designing scalable APIs and distributed systems.
• Familiarity with AI inference patterns, including Large Language Models (LLMs), embeddings, and multimodal AI systems.
• Strong debugging and troubleshooting skills within distributed production environments.
• Demonstrated ability to deliver production-ready solutions while iterating based on real-world system performance.
• Excellent analytical, problem-solving, and collaboration skills.

Technical Skills

Experience with the following technologies is preferred:

• Python
• Node.js
• PyTorch
• OpenAI, Anthropic, or open-source Large Language Models (LLMs)
• SQL and NoSQL databases
• Kubernetes
• Docker

Originally posted on