Title
Annotator
Duration
6 months
Location
REMOTE (8AM-5PM SAN FRANCISCO)
Pay: $37-41hr
Interviews: ONE ASSESSMENT
Openings
75
Start Date
June 9th, 2026
This role offers flexible hours typically aligned with 9–5 PM PST, though schedules and durations will vary based on project needs, with opportunities for recurring work; candidates must be licensed real estate agents located in the Seattle area to ensure local market knowledge.
Must-Haves
- Minimum of 3+ years of active experience as a licensed real estate agent or broker, demonstrating a deep understanding of the real estate transaction process.
- Demonstrated deep interest and curiosity in Artificial Intelligence, including experience reviewing or evaluating AI-generated content.
- Bachelor's degree in English, Linguistics or a related field.
- Experience working on Natural Language Processing projects with a focus on transcriptions, localization, translation.
- Excellent attention to detail and analytical skills.
- Ability to work effectively in a collaborative team environment.
Plusses
- Experience with copywriting, User Experience authoring, content development around voice and brand guidelines.
- Experience with Machine-generated Speech evaluation, Search Results Evaluation, Search Query Categorization
- Experience following or managing complex processes, and working both independently and with a team to achieve a goal.
Responsibilities
- Review and/or evaluate annotated data to ensure it meets quality standards and project requirements.
- Provide feedback and guidance to engineers to improve accuracy.
- Collaborate with engineers and data scientists to optimize model performance based on annotated data.
- Develop and maintain annotation guidelines and best practices.
- Provide training data to engineers to establish Ground Truth data.
- Provide input/examples on Training content.
- Identify gaps in training content and suggest improvements.
Description
Our client is searching for a large group of Annotators to join their teams. The team sits at the intersection of AI/ML innovation and real estate, leveraging technologies like generative AI, large language models, and multimodal systems to power products such as automated home tours, chatbots, and personalized recommendations, with the Annotation Judge playing a key role in evaluating and improving AI-driven interactions by assessing conversation quality, chatbot accuracy, and classification outputs; this position works cross-functionally with operations, engineering, and data science teams, requiring strong attention to detail, language nuance, and the ability to help define scalable annotation standards for global contributors. This role offers flexible hours typically aligned with 9–5 PM PST, though schedules and durations will vary based on project needs, with opportunities for recurring work; candidates must be licensed real estate agents located in the Seattle area to ensure local market knowledge, and while roles are remote, only applicants who submit a PDF resume with a completed candidate questionnaire and achieve a minimum score of 80/110 will be considered, as there is no interview process.
Benefits packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.
