Cybersecurity Specialist - AI Training and Evaluation

About Verita AI

Verita AI builds high-trust data pipelines that enable AI systems to understand real-world workflows across specialized professional domains. We work with domain experts to teach models how complex technical work actually happens in practice, from routine security operations to high-stakes incident response and threat analysis.

Brief Description

We're hiring Cybersecurity specialists to help train and evaluate AI systems on real-world security workflows. You will translate deep security expertise into structured tasks and evaluate AI outputs for technical accuracy, risk awareness, practical applicability, and adherence to established security frameworks.

What You'll Do

• Author high-quality, realistic cybersecurity tasks grounded in professional security operations, including threat detection, vulnerability analysis, incident triage, hardening, and policy review
• Define evaluation criteria and expected outputs so AI-generated security work can be assessed for accuracy, completeness, and appropriate risk prioritization
• Review and evaluate AI-generated security analysis and recommendations for technical correctness and real-world applicability
• Provide detailed feedback to improve AI outputs across security reasoning, tool usage, and defensive strategy
• Document security logic, threat rationale, and framework references clearly

Domain Focus

• Vulnerability assessment and penetration testing
• Incident detection, triage, and response
• Security architecture review and hardening

Interested in remote work opportunities in Cyber Security? Discover Cyber Security Remote Jobs featuring exclusive positions from top companies that offer flexible work arrangements.

• Threat modeling and attacker TTP analysis
• Compliance and framework alignment (NIST, CIS, OWASP, MITRE ATT&CK)
• Cloud security posture and configuration review

Tools & Context

You'll work with, or help AI systems reason about, the same tools and artifacts used in professional cybersecurity environments, including:

• SIEM platforms, log analysis, and alert triage workflows
• Vulnerability scanners and penetration testing tools (Nmap, Burp Suite, Metasploit, Nessus, etc.)
• Network analysis tools (Wireshark, tcpdump, Zeek)
• Security frameworks and standards (NIST CSF, MITRE ATT&CK, CIS Benchmarks, OWASP Top 10)
• Cloud security tooling (AWS Security Hub, Azure Defender, GCP Security Command Center)
• Scripting for automation and analysis (Python, Bash, PowerShell)
• Incident response playbooks and forensic documentation

Requirements

• 3+ years of professional experience in cybersecurity, in roles such as security analyst, penetration tester, incident responder, security engineer, or security architect

Browse our curated collection of remote jobs across all categories and industries, featuring positions from top companies worldwide.

• Relevant certifications (CISSP, CEH, OSCP, GIAC, CompTIA Security+, or equivalent) or demonstrable hands-on expertise
• Understanding of both offensive and defensive perspectives
• Ability to write clear, well-scoped security tasks with realistic scenarios and unambiguous evaluation criteria

You May Be a Good Fit If

• You've responded to real incidents, triaged real alerts, or tested real systems, not just completed labs
• You can explain why a finding matters in business terms, not just technical ones
• You're comfortable reasoning about attacker behavior and can map TTPs to defensive actions
• You prefer flexible, contract-based engagements over traditional full-time roles

How Engagements Work

• Fully remote, contract-based work
• Minimum commitment: 10 hours per week
• Compensation is hourly, aligned with experience and impact, with payments issued through Deel
• Performance and contribution quality are tracked to support future opportunities