Bristol
Full Time
Permanent
£65,000 - £85,000 per annum
An exciting opportunity has arisen due to continued growth and investment across our platforms for a Lead Quality Engineer. You will have demonstrable experience in GenAI Tools as well as experience with some or all Chatbots, API, Assistants. You are an advocate for Quality Engineering within the project team and the wider organisation and relishes being at the forefront of QE expertise in the organisation and the wider testing community. But this is not just about tech! We require a thought leader with persuasion and gravitas to be able to take the organisation on the AI QE journey.
A bit about the job:
The role will see you establishing a GEN AI QE capability, leading through coaching, and developing to embed a culture of innovation and continuous improvement. You will evaluate the E2E process, working on behalf of the customer to get a quality outcome as well as evaluate the ROI for each activity focussing on the benefit at the smallest level.
You will design QE Outcomes that evaluate the GenAI solution and capabilities and building automated frameworks to execute these requirements against all relevant GenAI capabilities (i.e. LLMs, guardrails, security (inc data governance), hallucination, toxicity, guardrails/policies, ethical, model poisoning, adherence to Aviva policies).
You will also specialise in AI content review/auditing, assessing quality, accuracy and appropriateness of content through a detailed engineering understanding of the GenAI.
Your experience will include core engineering knowledge (DevSecOps, distributed system principles for large scale workloads, auto scaling/load balancing), GenAI engineering knowledge (LLM’s and associated capabilities,). Automation frameworks & testing tools as well as knowledge of languages for test automation (Python, Java).
Skills and experience we’re looking for:
What you’ll get for this role:
Our purpose - with you today, for a better tomorrow – is a promise we make to our colleagues too. And one of the ways we live up to that promise is by investing in you. We have so much to offer when it comes to being an Aviva colleague.