[Remote] Principal Technical Program Manager- Agent Quality and API Governance
Note: The job is a remote job and is open to candidates in USA. Atlassian is hiring a Principal Technical Program Manager to lead technical strategy and cross-functional execution for its agent integration, quality, and API governance platform layers. The role focuses on reliable agent-tool integrations, agent quality measurement and observability, API governance and runtime controls, and coordinating technical roadmaps across teams.
Responsibilities
- Drive standardized tool-calling interfaces, action schemas, and integration patterns across internal and external ecosystems
- Partner with Security and Identity teams on authentication, token exchange, permission scopes, tenant isolation, and credential management
- Improve onboarding and lifecycle management for teams and partners adding tools, skills, and automated actions
- Define practical quality measures for agent accuracy, task completion, tool selection, groundedness, safety, and user experience
- Establish representative test sets and eval benchmarks, golden scenarios, and regression practices for prompt, model, tool, and workflow changes
- Partner with engineering teams on agent traces and telemetry that make multi-step execution, tool failures, latency, and quality issues diagnosable
- Lead rate limiting, tenant quotas, concurrency controls, and traffic-shaping strategies across agent APIs and automation triggers
- Establish safeguards for runaway loops and downstream failures, including timeouts, retries, backoff, circuit breakers, and graceful degradation
- Drive API standards, versioning, backward compatibility, breaking-change management, and deprecation practices
- Drive API monetization capabilities such as standardization of API units, metering, integration across all experiences and interfaces
- Turn ambiguous, multi-team problems into clear roadmaps, milestones, ownership models, and technical decision documents
- Facilitate trade-offs such as synchronous versus asynchronous tool execution, live versus offline quality signals, and global versus tenant-scoped controls
Skills
- 8–10+ years of experience in Technical Program Management, Platform Product Management, software engineering, or a related technical discipline
- Experience delivering API platforms, distributed backend systems, developer ecosystems, automation platforms, or AI/ML integrations
- Strong understanding of API architecture, distributed rate limiting, quotas, concurrency controls, resilience patterns, and API lifecycle governance
- Working knowledge of agent execution, function calling, tool binding, action schemas, and integration protocols
- Understanding of agent quality measurement, including task success, accuracy, representative test cases, and human or model-assisted evaluation
- Ability to engage deeply and partner with senior engineers on technical reviews, RFCs, sequence diagrams, and failure-mode analysis
- Proven ability to create structure, clarify ownership, and deliver outcomes in evolving and ambiguous platform domains
- Experience with standardized AI agents, agentic workflows and agent-tool protocols (e.g., Model Context Protocol - MCP, OpenAPI-based tool ecosystems)
- Familiarity with offline LLM evaluation harnesses, synthetic benchmarking, and red-teaming pipelines
- Experience with developer-facing integration ecosystems, app marketplaces, workflow engines, or automation platforms
- Familiarity with agent observability, distributed tracing, OpenTelemetry, and quality or evaluation tooling
- Background in multi-cloud, distributed deployment strategies (AWS, GCP, Azure) and hybrid inferencing infrastructure
- Experience defining platform metrics that connect technical health, adoption, reliability, and user outcomes
Benefits
- Health and wellbeing resources
- Paid volunteer days
- May also be eligible for benefits, bonuses, commissions, and equity
Company Overview
Company H1B Sponsorship