App Security Expert

We are sharing a specialised remote consulting opportunity for experienced Application Security Professionals with strong expertise in secure software development, vulnerability assessment, LLM security, AI-powered static application security testing, and agent-based security architecture to contribute their technical knowledge to advanced AI training and evaluation initiatives. Selected professionals will design realistic application security evaluation scenarios, develop controlled testing fixtures, assess secure and vulnerable code implementations, and create structured evaluation materials for advanced AI systems. The work combines practical application security engineering with deterministic testing, synthetic vulnerability assessment, technical documentation, and security-focused AI benchmarking. Prior experience with AI training projects is not required. Key Responsibilities - Application Security Engineering & Vulnerability Assessment - Design and evaluate realistic application security scenarios involving modern software architectures and secure development practices - Analyse application codebases for security weaknesses, implementation errors, and potential vulnerabilities - Assess secure and vulnerable code implementations using established application security principles - Apply advanced security knowledge to evaluate vulnerability identification, remediation approaches, and secure coding practices - Develop technically rigorous application security challenges reflecting real-world engineering and security assessment requirements - LLM Security & Agent-Based Architecture - Evaluate application security risks associated with large language models and AI-powered software systems - Design controlled security evaluation scenarios addressing relevant OWASP LLM risks, including Sensitive Information Disclosure and Excessive Agency - Assess security considerations involving agent permissions, tool access, data handling, and system boundaries - Review security architecture concepts for traditional applications and AI agent-based systems - Contribute expert insights to the evaluation of secure AI application design and agent security practices - Synthetic Security Fixtures & Deterministic Testing - Design and implement small, purpose-built application fixtures containing controlled security vulnerabilities or secure reference implementations - Develop deterministic test cases to support consistent and reproducible application security evaluations - Create structured security-context manifests describing relevant application conditions and evaluation requirements - Prepare detailed reference solutions and evaluation criteria to distinguish vulnerable implementations from secure alternatives - Assess whether synthetic security tasks accurately represent meaningful and realistic application security challenges - AI-SAST Evaluation & Security Benchmarking - Evaluate AI-assisted static application security analysis methodologies and their effectiveness across controlled testing scenarios - Review AI-generated vulnerability assessments, secure coding recommendations, and application security findings - Identify inaccuracies in security classifications, technical reasoning, remediation suggestions, and evaluation outputs - Refine security benchmarking tasks to improve their technical relevance, consistency, and assessment quality - Provide structured expert feedback supporting improvements in AI-based application security analysis and vulnerability evaluation - Security Documentation & Collaborative Quality Assurance - Produce clear technical documentation covering security fixtures, testing methodologies, assessment criteria, and evaluation findings - Review security evaluation materials for accuracy, completeness, reproducibility, and technical clarity - Communicate detailed application security insights through structured written feedback and professional discussions - Collaborate with technical contributors to review security assessments and improve evaluation workflows - Support continuous improvement of application security testing methodologies, quality standards, and AI evaluation processes Ideal Profile - Extensive professional experience in application security, secure software development, cybersecurity engineering, or CyberSWE-related roles - Approximately 5+ years of relevant professional experience is preferred - Strong understanding of application security principles, secure coding practices, vulnerability assessment, and remediation methodologies - Familiarity with OSWE-level application security concepts, advanced web application testing, and practical vulnerability analysis - Strong knowledge of LLM security risks and emerging security considerations involving AI-powered applications - Experience with AI-assisted static application security testing (AI-SAST) or related security evaluation methodologies - Demonstrated understanding of OWASP application security guidance and relevant OWASP LLM security categories - Experience designing, reviewing, or evaluating security architecture for traditional software applications or AI agent-based systems - Practical expertise in developing, securing, testing, and reviewing application codebases - Ability to identify complex application vulnerabilities and evaluate technically appropriate remediation approaches - Familiarity with security considerations involving agent permissions, tool integration, data exposure, and application trust boundaries - Experience creating controlled security testing scenarios, synthetic vulnerability fixtures, or reproducible evaluation environments is highly desirable - Strong understanding of deterministic testing, structured assessment criteria, and technical validation methodologies - Ability to distinguish secure implementations from vulnerable code using clear, technically justified evaluation criteria - Strong analytical reasoning, technical problem-solving, and security assessment capabilities - Excellent written and verbal communication skills, including the ability to explain sophisticated security concepts clearly - Experience producing detailed technical documentation, security reports, or structured engineering feedback - Ability to collaborate effectively with multidisciplinary technical teams in a remote environment - Strong attention to detail and commitment to accurate, reproducible, and actionable security assessments - Prior experience contributing to AI training or model evaluation projects is not required Engagement Details - Freelance / contract engagement - Fully remote - Compensation: $40–$80/hour - 10 available openings - Specialised consulting role spanning application security, LLM security, AI-SAST evaluation, secure software development, and agent-based