Quality Operations Lead
HumanSignal
The future of AI — whether in training or evaluation, classical ML or agentic workflows — starts with high-quality data.
At HumanSignal, we’re building the platform that powers the creation, curation, and evaluation of that data. From fine-tuning foundation models to validating agent behaviors in production, our tools are used by leading AI teams to ensure models are grounded in real-world signal, not noise.
Our open-source product, Label Studio, has become the de facto standard for labeling and evaluating data across modalities — from text and images to time series and agents-in-environments. With over 250,000 users and hundreds of millions of labeled samples, it’s the most widely adopted OSS solution for teams working on building AI systems.
Label Studio Enterprise builds on that traction with the security, collaboration, and scalability features needed to support mission-critical AI pipelines — powering everything from model training datasets to eval test sets to continuous feedback loops.We started before foundation models were mainstream, and we’re doubling down now that AI is eating the world. If you're excited to help leading AI teams build smarter, more accurate systems — we’d love to talk.
HumanSignal is seeking a Quality Control Lead to ensure world-class data quality across our Label Studio platform and Data Creation Laboratory operations. In this role, you will be the ultimate authority on the integrity and usefulness of the data we manufacture and deliver to customers. You will drive accountability across our highest-impact projects—tackling complex quality challenges head-on while leading strategic initiatives that enable reliable, scalable delivery as we grow.
Our Data Creation Laboratories don't just label existing data—we manufacture purpose-built datasets from scratch in controlled environments. This means quality control takes on new dimensions: you're not just checking annotations, you're ensuring that the human-generated data we create meets the exacting standards required by frontier AI labs and enterprises pushing the boundaries of what's possible.
You Will:
- Build and lead a high-performing team of quality control specialists who set the standard for data excellence
- Collaborate with delivery teams and laboratory operations to interpret, refine, and exceed customer requirements
- Manage day-to-day operations including workload planning, resource allocation, and performance reporting
- Design and implement scalable quality frameworks and best practices that grow with the organization
- Champion initiatives that drive improvements in quality, operational efficiency, and customer satisfaction
- Serve as the ultimate standard-bearer for data quality, ensuring HumanSignal is recognized as the most trusted source of training data in AI
Ideally You'd Have:
- Bachelor's degree in Computer Science, Engineering, Operations, or a related discipline
- 4+ years of experience leading teams or scaling complex operational or technical processes
- Strong analytical capabilities and problem-solving skills, with proficiency in SQL and meticulous attention to detail
- Demonstrated experience building systems, processes, and teams across diverse customer segments or product offerings
- Hands-on background in operations management, product management, or management consulting at a top-tier firm
- Track record of taking initiative and driving results in cross-functional technical environments
Nice to Haves:
- Master's degree in Computer Science, Engineering, Operations, or a related field
- Experience in AI/ML data operations or services
- Background working in high-growth, dynamic startup environments
- Experience building and scaling teams from the ground up
About HumanSignal
At HumanSignal, we're building the infrastructure for the next generation of AI. Our Label Studio platform powers data operations for leading organizations worldwide, while our Data Creation Laboratories manufacture the purpose-built datasets that breakthrough AI applications require.
We believe the next frontiers in AI won't be unlocked by scraping what's left on the web—they'll be built on human-created data that captures the complexity of how systems need to see, hear, reason, and react. Through controlled environments and operational excellence, we're enabling researchers and enterprises to innovate without being constrained by data availability.
We work with frontier AI labs, Fortune 500 enterprises, and government agencies who are pushing the boundaries of what's possible with AI. Join us in building the data that will build the future.
We are proud to be an inclusive and equal opportunity workplace. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability status, gender identity, or Veteran status.
At HumanSignal we pay based on regional compensation market rate ranges across the globe. We are hiring for this role across North and South America as well as Europe. The base cash compensation range is $90,000 to $140,000 USD. These ranges are provided by market data and are in good faith. The final offer details are determined by several factors including candidate experience, expertise, as well as applicable industry knowledge and may vary from the pay ranges listed above.