Search Quality Operations Manager

You will design and operate a system for large-scale production of Relevance datasets to improve shopping search quality. Your responsibilities include establishing evaluation criteria, managing inter-evaluator variance, and recruiting and managing inspection teams to scale operations. Experience in designing structures for LLM-based data production and human-in-the-loop verification is required. You must also have experience in improving operational processes based on metrics.