Orion Innovation
Senior QA Analyst / Tester
RemoteUnited States only
- Role
- Security
- Experience
- Senior
- Company size
- Enterprise
Salary not disclosed
Check eligibility
Open to US only. Set where you work from to check your eligibility.
No BS summary
Senior Red Team / QA tester for AI models with 5+ years in penetration testing/red team or AI red team. Must have strong offensive testing skills (prompt injection, adversarial datasets), Python and testing tools experience, and be able to work US-remote across time zones. Requires cybersecurity/CS or equivalent experience.
Core skills
AI red teamingprompt injection
Required skills
penetration testingred team operationsPythonRubyGoC++PowerShellbashSPLXGarakTextAttackPyRITBurp SuiteMetasploitNessusCobalt StrikeMythicC2NMAPsqlmapHTTPDNSFTPGenerative AIAgentic AIA2AMCP
Optional skills
OSCPGPENGPXNAI Red Teamer Job Role Path (HackTheBox)AISEC+GASAEGOAAOSAI+
What you'll do
- Design and execute comprehensive adversarial testing campaigns against AI models, including but not limited to large language models, multimodal systems, and autonomous agents.
- Research attack vectors and prompt injection techniques to identify model vulnerabilities, jailbreaks, and unintended behaviors.
- Evaluate and introduce AI Security tools that decrease mean time to detect and respond to AI-specific threats.
- Conduct red team exercises simulating real-world deployment scenarios and edge cases.
- Systematically probe for bias, toxicity, misinformation generation, and other harmful outputs across diverse contexts and demographics.
- Improve firm’s security posture against emerging AI threats; concentration on executing standardized security tests.
- Create adversarial datasets and benchmarks to evaluate model robustness under various attack conditions.
- Collaborate with security teams (e.g., GSOC, member firm security teams, developers) to perform red teaming activities, and document and present findings, vulnerabilities, and remediation recommendations.
- Develop and maintain process documentation, create reports on testing activities, track operational metrics, and perform other programmatic tasks to support the AI Red Team.
What they require
- Minimum 5 years of penetration testing, red team operations, or AI Red Team experience.
- Computer science, information technology, programming, development, Artificial Intelligence, or cybersecurity degree (Bachelor's or higher preferred) or equivalent work experience.
- Background in AI red teaming, red teaming, or offensive cyber operations.
- Understanding of Artificial Intelligence, Machine Learning, software applications, cloud computing, and networking.
- Excellent communication and stakeholder management skills.
- Ability to work effectively across geographies and time zones.
Orion Innovation is a global business and technology services firm delivering business transformation and product development rooted in digital strategy, experience design, and engineering.
IT ServicesEnterprise
Salary not disclosed