Quality Specialist - Data Annotation
- Role
- QA
- Experience
- Mid
- Employment
- Full-time
- Company size
- Startup
Open to US only. Set where you work from to check your eligibility.
No BS summary
Quality specialist with 2+ years in data annotation and QA, including reviewing and calibrating other annotators’ work. Must know enterprise annotation platforms such as Encord/CVAT/Labelbox/SuperAnnotate and be comfortable with complex 2D/3D annotation. US-based remote-first role with medical, dental, vision, and 401k benefits.
Core skills
Required skills
ABOUT AUGMODO
Augmodo is at the forefront of spatial computing, using AI and wearable technology to transform physical retail spaces into dynamic digital environments. Our wearable devices capture real-time 3D mapping and inventory data, empowering retail teams to work smarter while giving businesses unprecedented visibility into their physical operations.
ROLE OVERVIEW
As a Quality Specialist with Augmodo, you will be a part of a small group of individuals who will collaborate across multiple teams to define our Quality goals.
This role is about setting the quality standard, not just doing production work. You’ll be a trusted expert—the person we turn to for tough edge cases and the one who creates the benchmark data others are measured against. You'll work closely with our Computer Vision and Data Operations teams to help improve and define our quality pipeline.
AREAS OF FOCUS
- Golden datasets & ground truth: Curate and maintain the critical benchmark datasets with our team, used to certify annotators, score vendors, and measure pipeline drift.
- Certification & training: Create and update training materials and certification tests (measuring precision and speed) required for vendor and annotator onboarding.
- Drift monitoring & scoring: Periodically evaluate annotators against benchmark data to identify drift and help manage QA metrics and scoring models for the Data Ops Hub.
- Quality audits: Conduct rigorous, double-blind quality audits to ensure a gold standard across computer-vision datasets.
- Production labeling: Serve as a high-trust annotator to directly handle production labeling when critical (P0) needs arise.
SKILLS & QUALIFICATIONS
- Experience: 2+ years in data annotation and quality assurance, including reviewing and calibrating other annotators' work.
- Technical Tooling: Experience with Encord or equivalent enterprise annotation platforms (e.g., CVAT, Labelbox, SuperAnnotate); comfort with complex 2D/3D annotation (bounding boxes, polygons, masks).
- Judgment & Attention to Detail: Exceptional ability to spot, track, and adjudicate out-of-stock products and edge cases across large video datasets — and to define a defensible standard for them.
- Communication: Strong verbal and written skills to document standards clearly, justify quality decisions, and collaborate with a global, cross-functional team.
WHY JOIN AUGMODO?
- Ownership: You set the standard the entire labeling operation is measured against — not a cog in the pipeline, but the team that defines it.
- Impact: Help build the world's first passive inventory tracking system for the "Augmented Workforce," and the quality system that lets it scale.
- Innovation: Work at the cutting edge of Spatial AI with a venture-backed startup scaling globally.
- Flexibility: Join a remote-first culture that values transparency, speed, and precision.
Augmodo offers benefits inclusive of medical, dental, vision, and 401k
The salary range for this role is $45,000 USD - $65,000 USD +equity
Augmodo is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran, or disability status.
What you'll do
- Collaborate across multiple teams to define Quality goals.
- Set the quality standard rather than just doing production work.
- Act as a trusted expert for tough edge cases.
- Create benchmark data others are measured against.
- Work closely with Computer Vision and Data Operations teams to help improve and define the quality pipeline.
- Curate and maintain critical benchmark datasets with the team, used to certify annotators, score vendors, and measure pipeline drift.
- Create and update training materials and certification tests measuring precision and speed for vendor and annotator onboarding.
- Periodically evaluate annotators against benchmark data to identify drift.
- Help manage QA metrics and scoring models for the Data Ops Hub.
- Conduct rigorous, double-blind quality audits to ensure a gold standard across computer-vision datasets.
- Serve as a high-trust annotator to directly handle production labeling when critical P0 needs arise.
What they require
- 2+ years in data annotation and quality assurance, including reviewing and calibrating other annotators' work.
- Experience with Encord or equivalent enterprise annotation platforms, e.g., CVAT, Labelbox, SuperAnnotate.
- Comfort with complex 2D/3D annotation, including bounding boxes, polygons, masks.
- Exceptional ability to spot, track, and adjudicate out-of-stock products and edge cases across large video datasets — and to define a defensible standard for them.
- Strong verbal and written skills to document standards clearly, justify quality decisions, and collaborate with a global, cross-functional team.
Benefits
- Ownership: You set the standard the entire labeling operation is measured against — not a cog in the pipeline, but the team that defines it.
- Impact: Help build the world's first passive inventory tracking system for the "Augmented Workforce," and the quality system that lets it scale.
- Innovation: Work at the cutting edge of Spatial AI with a venture-backed startup scaling globally.
- Flexibility: Join a remote-first culture that values transparency, speed, and precision.
- Medical benefits.
- Dental benefits.
- Vision benefits.
- 401k.
- Equity.
Augmodo is at the forefront of spatial computing, using AI and wearable technology to transform physical retail spaces into dynamic digital environments. Its wearable devices capture real-time 3D mapping and inventory data for retail teams and businesses.