Let's begin! Ground Truth Ops Specialist (13717)

Other Jobs To Apply

This a Full Remote job, the offer is available from: North America, Europe

 

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways. Moody’s is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment, we’re advancing AI to move from insight to action—enabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence.

If you are excited about this opportunity but do not meet every single requirement, please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship, lead with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. 

Skills and Competencies

  • Experience running or supporting AI data labeling and annotation efforts, including campaign management, QA, or vendor coordination
  • Hands-on familiarity with professional AI labeling platforms such as Labelbox, Dataloop, Scale, or similar tools
  • Strong analytical mindset with the ability to interpret label distributions, consensus metrics, and error patterns
  • Working knowledge of Python for analysis and automation, including use of Jupyter notebooks
  • Comfort working with spreadsheets and basic analysis using SQL and/or Python
  • Strong operational and project management skills, with the ability to manage multiple concurrent campaigns
  • High attention to detail and rigor in documentation, taxonomy definition, and QA processes
  • Clear written and verbal communication skills for collaboration with technical teams and external vendors
  • Ability to give and receive feedback constructively to improve labeling instructions and outcomes
  • Exposure to computer vision, geospatial data, or ML workflows is an advantage

Education

  • Master's degree in a quantitative, analytical, or technical field

Responsibilities

This role owns the end-to-end lifecycle of ground truth data collection campaigns, translating machine learning needs into high-quality labeled datasets that power core computer vision products.

  • Partner with ML and Data Science leads to translate model requirements into clear label taxonomies and concrete labeling tasks
  • Design and run internal gold-standard campaigns to validate taxonomies and ensure coverage of edge cases
  • Configure and manage annotation projects, including uploading imagery, geometries, and metadata, and exporting labeled data
  • Coordinate with external labeling vendors, including taxonomy training, example walkthroughs, and ongoing feedback
  • Evaluate vendor performance using gold datasets, confusion matrices, and quality reports to determine readiness for scale
  • Launch and monitor production labeling campaigns, tracking throughput, SLAs, and overall progress
  • Triage worker questions, resolve taxonomy ambiguities, and proactively identify tooling or workflow issues
  • Monitor label quality and consensus metrics, initiating additional vote rounds or manual QA where needed
  • Review low-agreement areas of interest and propose taxonomy refinements, clarifications, or deprecations
  • Build final ground truth datasets, ensuring quality thresholds are met and data is clearly documented for ML consumption
  • Maintain campaign status and documentation so stakeholders have clear visibility into data readiness
  • Contribute to continuous improvement of ground truth processes, tooling, and best practices

About the Team

You will join Cape by Moody’s, a team focused on delivering highly precise property insights derived from aerial imagery and advanced machine learning. Ground truth data is central to the team’s mission, and this role works closely with data scientists, ML engineers, and product partners across Europe and North America in a collaborative, remote-friendly environment.

Moody’s is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender expression, gender identity or any other characteristic protected by law.

Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy, including remediation of positions in those holdings as necessary.

 
This offer from "Moody's Analytics" has been enriched by Jobgether.com and got a 77% flex score.
Back to blog

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...