AI Automation Quality Engineer

Grade: 056 FLSA Status: Exempt Company Description By working at Harvard University, you join a vibrant community that advances Harvard's world-changing mission in meaningful ways, inspires innovation and collaboration, and builds skills and expertise. We are dedicated to creating a diverse and welcoming environment where everyone can thrive. Why join Harvard University Central Administration? Harvard University's Central Administration (CADM) is a 5,000+ employee organization that supports the university's overall excellence by understanding and serving the needs of its schools, students, faculty, staff, alumni, and surrounding communities. Through dynamic and collaborative partnerships, CADM provides high-quality and efficient services to the schools to help them achieve their goals. Harvard University Information Technology (HUIT) is a community of Information Technology professionals committed to understanding our users and devoted to making it easier for faculty, students, and staff to teach, research, learn, and work through the effective use of information technology.  We are recruiting an IT workforce that has both breadth in their ability to collaborate and innovate across disciplines – and depth in specific areas of expertise.  HUIT offers opportunities for IT professionals to learn and work in a unique technology landscape and service-focused environment.  If you are a technically proficient, nimble, user-focused and accountable IT professional who also connects with the importance of collaborating well in a team environment we are looking for you! More About HUIT: Our Mission: huit.harvard.edu/about We empower the Harvard community with essential and transformative technologies to advance education, knowledge, and discovery. HUIT’s core values are: Human-centered University-focused Innovation-driven Team-oriented IT Academy (designed for IT Staff): HUIT’s IT Academy aims to enable each IT staff person to grow professionally and become a trusted partner to her or his team. The IT Academy is built on the belief that every IT staff member across the University (including technology employees at each school and campus) can grow in her or his area of expertise as well as building strong people and project management skills. Learn more here: https://itacademy.harvard.edu/ .

Job-Specific Responsibilities: The AI Automation Quality Engineer leads the next generation of quality engineering for the my.harvard portal, moving beyond traditional QA to design intelligent, agent-based testing capabilities that automatically analyze requirements, understand application code, generate reusable test assets, and continuously improve HUIT’s testing strategy. This role combines strong software testing experience with modern AI engineering concepts, including Retrieval-Augmented Generation (RAG), large language models (LLMs), agentic workflows, and test automation frameworks. Working closely with Business Analysts, developers, and product owners, the AI Automation Quality Engineer helps build an autonomous QA platform that accelerates delivery while improving software quality. AI-Powered Test Generation: Design and implement AI agents that read Jira user stories, acceptance criteria, architectural documentation, and business rules to automatically generate comprehensive functional, integration, regression, accessibility, and API test scenarios Code-Aware Testing: Build agents capable of analyzing Django, FastAPI, and frontend codebases to understand application behavior, identify impacted components, and generate reusable test cases with high coverage RAG & Knowledge Engineering: Develop Retrieval-Augmented Generation (RAG) pipelines that leverage Jira, Confluence, Git repositories, existing test suites, architecture documentation, API specifications,