AI Solutions Quality Assurance Analyst

Build your big career with the firm that does Big Law, Better. McDermott Will & Schulte is a leading global law firm that brings together more than 1,750 lawyers and 1,400 business professionals. We celebrate excellence, collaboration, and community and have been recognized as a top workplace by USA Today, Fortune, The American Lawyer, Vault and others. We are also certified by Great Place to Work. 

At McDermott, we don’t just invest in your future, we accelerate your career – wherever it may lead. That includes supporting you both in and outside of the office. 

With us, you’ll find: 

A firm where everyone belongs: Our award-winning culture prioritizes warmth and authenticity — we encourage you to be yourself!  

Enthusiasm for all perspectives: We’re smarter and stronger when everyone has a voice and a seat at the table. We welcome unique viewpoints and ideas, and we make opportunities for you and your career to thrive.  

Support to feel your best and do your best: Wellness is integral to building a successful career and a rich life. That’s why our benefits program supports your physical, emotional, mental, and financial health, with an emphasis on work-life balance.  

Real rewards for real work: We offer generous compensation packages that recognize hard work and excellence.   

Job Description:

McDermott, Will & Schulte LLP is building one of the most ambitious AI programs in the legal industry — and quality is not an afterthought. As we deploy AI-powered solutions across legal practices and operational teams, we need someone who can own the full quality lifecycle: from unit tests and edge cases through system testing, performance, and CI/CD pipeline integration. The AI Solutions QA Analyst partners directly with our Analysts and engineering team to ensure every solution we ship is tested, reliable, and production-ready — leveraging AI itself to do it faster and more thoroughly than traditional QA ever could.

WHY MWS:

Shape quality standards for an entirely new category of legal AI solutions — from the ground up 

Work with frontier AI tools to build and run tests faster than traditional QA methods allow 

High-visibility role reporting to Director of QA with direct impact on every solution the team ships 

Remote-first, technically rigorous team that takes production quality seriously 

WHAT YOU'LL DO:

Own the full QA lifecycle for AI-powered solutions — from unit and integration testing through system, performance, and scalability testing 

Partner with Analysts to generate and evaluate test cases using AI-assisted tools, with particular focus on boundary conditions, edge cases, and AI output validation 

Work with the engineering team to define and integrate automated test suites into the Azure DevOps CI/CD pipeline for each solution 

Define system-level test strategies in collaboration with the Director of QA, covering functional, regression, and non-functional testing requirements 

Coordinate with the dedicated security team to translate security testing guidance into solution-specific security test cases 

Evaluate AI solution reliability across varied inputs — ensuring consistent, predictable behavior under real-world conditions 

Maintain test documentation, defect tracking, and quality metrics that give leadership clear visibility into solution readiness 

Champion a quality culture across the delivery team — making testing a natural part of the development workflow, not a gate at the end 

WHAT YOU BRING: 

4+ years of formal QA experience, including writing and executing test scripts across the full testing lifecycle 

Strong experience with unit, integration, system, and regression testing — both manual and automated 

Hands-on experience integrating test suites into CI/CD pipelines