Robotics teams

Data format

What's in a Zeth episode and how it's delivered.

Each accepted clip becomes an episode: the video plus labels your pipeline can train on. The schema below is version 0.1 and will be finalised with launch partners.

Download a sample episode (JSON)

FieldContents
episode_idUnique episode identifier
missionMission code, task name and category
video1080p, 30 fps, head-mounted first-person view, audio removed
contextCountry, setting (for example home/kitchen), surface, lighting and objects present
stepsTimestamped, step-by-step natural language descriptions of the task
hand_pose21 keypoints per hand per frame, in camera coordinates
privacyConfirms faces and screens are blurred and audio removed
qaAutomated and human review results
licenseLicense version the clip was contributed under

Diversity

Missions run in homes across many countries, so the same task appears in different kitchens, bedrooms, lighting and with different objects. Filter by country, setting and objects to build the mix you need.