[Remote] AI Engineer – Agentforce & Data Cloud
Note: The job is a remote job and is open to candidates in USA. Kelly is seeking an AI Engineer with hands-on Salesforce Agentforce and Data Cloud experience to design, test, optimize, and support AI-powered agent solutions. The role focuses on developing evaluation frameworks, validating integrations and workflows, monitoring agent performance, and improving AI behavior through testing and optimization.
Responsibilities
- Design and optimize Agentforce agents, prompts, instructions, tools, and workflows
- Leverage Salesforce Data Cloud to support grounded and context-aware AI experiences
- Develop AI evaluation frameworks and test plans covering accuracy, hallucinations, safety, consistency, and instruction following
- Perform regression testing and track defects using Azure DevOps
- Monitor AI/agent performance using Arize AI or similar observability tools
- Analyze agent behavior and recommend improvements to prompts, workflows, and architecture
- Validate APIs, integrations, retrieval pipelines, and agent workflows
- Support CI/CD, automation, Agile ceremonies, and technical documentation
Skills
- W2 ONLY – This is a W2 contract opportunity
- Salesforce Agentforce – MUST HAVE
- Salesforce Data Cloud – MUST HAVE
- 5–10 years of experience in software engineering, QA, automation, business systems analysis, or related technical roles
- 1+ year of experience with Generative AI, LLMs, prompt engineering, or conversational AI
- Experience with Azure DevOps, REST APIs, and JSON
- Strong analytical, troubleshooting, and communication skills
- Arize AI / AI observability
- Azure OpenAI, OpenAI, Anthropic, or Gemini
- RAG and vector databases
- Python, SQL, JavaScript, or C#
- AI evaluation and test automation
Benefits
- W2 contract opportunity
Company Overview