Back to search

AI Content Safety Quality Assurance

Abu Dhabi Permanent View Job Description
You will focus on identifying and mitigating risks associated with AI-generated content, ensuring adherence to safety and ethical standards. Your deep understanding of LLM APIs, combined with your technical expertise in Python, will allow you to develop and execute effective testing strategies.
  • Save Job
  • Instrumental role ensuring the safety, security, and reliability of LLMs
  • Passionate about AI technologies and content safety, this role is for you

About Our Client

An entity supporting the technology strategy and digital transformation initiatives of a major financial firm.

Job Description

  • Content Safety Testing: Design, develop, and execute comprehensive test plans to ensure the security and reliability of content generated by large language models.
  • LLM Integration: Work with LLM APIs (e.g., OpenAI's API) to integrate AI models into automated testing workflows, ensuring consistent and thorough content evaluation.
  • Prompt Engineering: Leverage prompt engineering skills to enhance testing strategies and optimize LLM behaviour for safe and reliable output.
  • Defect Identification & Resolution: Identify and document content safety issues or model behaviour concerns, and collaborate with AI developers to resolve them.
  • Automation & Scripting: Develop automated testing scripts using Python to streamline LLM testing processes and ensure scalable and efficient content safety evaluations.

The Successful Applicant

  • Master's or Bachelor's degree in Computer Science, Engineering, or a related field
  • Proficient in Python programming and comfortable working with LLM APIs (e.g., OpenAI)
  • Experienced in testing the safety, security, and reliability of AI-generated content
  • Knowledgeable in prompt engineering techniques and how they can enhance content safety
  • Passionate about AI technologies and committed to ensuring the ethical and secure use of AI-generated content
  • At least 1 year of hands-on experience with LLM APIs

What's on Offer

  • Opportunity to work with cutting edge technologies and support the development of ethical and secure AI use cases
  • Excellent overall compensation package and benefits
Contact
Matt Jones
Quote job ref
JN-102024-6554309

Job summary

Sector
Technology
Subsector
Senior Technical
Industry
Financial Services
Location
Abu Dhabi
Contract type
Permanent
Consultant name
Matt Jones
Job reference
JN-102024-6554309