We're researchers at MIT running an experiment to help computers learn how to recognize social interactions

Have you ever wanted to have a robot that helps around the home and takes care of you? You'll be helping make that happen by showing them what kinds of social interactions there are.

What you'll do:

  1. Read the instructions and answer the quizzes
  2. Watch 10 short videos, answering questions after each video.
  3. Each video is an animated clip describing an environment with creatures and objects

Important: You cannot go back to previous videos, so please pay attention to each one.

Bonus Pay: You can earn a performance bonus based on your answers in the main experiment (after the quizzes). Every 100 points = $1.00 bonus. Bonus is capped at $1.00. Your running point total will be shown throughout the main experiment.
Submission Policy: We will reject submissions from participants who score low points in the main experiment. Please pay close attention to each video and answer carefully.

Instructions

Please pay attention to the following instructions. You will need to pass 4 quizzes before proceeding to the main experiment.

Bonus Pay: Points are awarded during the main experiment, not during these quizzes. Every 100 points = $1.00 bonus. Bonus is capped at $1.00. Your cumulative score will be shown throughout the main experiment.
Rejection Policy: We will reject submissions from participants who answer most comprehension-check questions incorrectly. Please read each instruction page carefully before answering.

Each animated video has:

  • Entities: creatures (trapezoids) or objects (circles). Entities can be of different colors and sizes. Bigger entities are heavier.
  • Landmarks: colored squares that creatures may try to get to or move objects to.
  • Walls: black lines, creatures and objects can't move through walls.

Creatures - Actions

A creature can move, push, and grab things. They cannot move through walls.

Creatures - Knowledge about the environment

A creature only knows the locations of entities it can see or touch. They cannot see through walls.

Below, the red creature can see the green creature and pink object, but not the blue object.

In this video, the red creature must first find the blue object before it can move it.

Creatures - Goals

A creature can have a personal goal (like getting to a landmark or moving an object) or a social goal (helping or hindering another creature).

Goal: Get to yellow landmark

Creatures - Relations

A relation between creatures can be described as Adversarial, Neutral, or Friendly.

Example: Friendly relationship

Creatures - Strength

Creatures can have different strengths. Strength is not associated with size. In the video below, the red agent is stronger.

Incorrect. Please review the instructions carefully and try the quiz again.
Warning: If you answer this comprehension check incorrectly more than two times (3 or more wrong attempts), the study will end early and your submission will not be approved.

Quiz 1: Knowledge

Can see ?

Does know where is?

Warning: If you answer this comprehension check incorrectly more than two times (3 or more wrong attempts), the study will end early and your submission will not be approved.

Quiz 2: Goals

What is 's personal goal?

Warning: If you answer this comprehension check incorrectly more than two times (3 or more wrong attempts), the study will end early and your submission will not be approved.

Quiz 3: Relations

What is 's social goal?

Warning: If you answer this comprehension check incorrectly more than two times (3 or more wrong attempts), the study will end early and your submission will not be approved.

Quiz 4: Strength

Which creature is stronger?

Congratulations!

You answered all quiz questions correctly. Great job!

You will now start the main experiment.

We will reject bad-faith attempts that fail most of the trials.

Round {{stim_id + 1}} / {{stimuli_set.length}}
Video

Please watch the video.

Questions will appear here when the video finishes.

Top Goal for Red Agent
Each agent has exactly one goal. Select the goal that best describes this agent.
{{$index + 1}}.
Physical goal
Social goal
Go to landmark
{{opt.label}}
Move object to landmark
→ {{opt.label}}
→ {{opt.label}}
Top Goal for Green Agent
Each agent has exactly one goal. Select the goal that best describes this agent.
{{$index + 1}}.
Physical goal
Social goal
Go to landmark
{{opt.label}}
Move object to landmark
→ {{opt.label}}
→ {{opt.label}}
How would you describe the creatures' relationship?
Answered: {{answeredCount}} / {{totalRequired}}
Please answer all questions before proceeding.
Demographics
If not filled in automatically, please type it in. This is used to pay your bonus.
Final Feedback

{{quizFeedbackData && quizFeedbackData.wasCorrect ? '✓ Correct!' : '✗ Incorrect'}}

{{quizFeedbackData.quizName}} — Round Results

Correct Answers:

{{item.question}}
✓ {{item.answer}}
You have now answered this comprehension check incorrectly 3 times. The study will end when you click below.
⚠ You have {{3 - quizFeedbackData.wrongAttempts}} attempt(s) remaining for this question before the study ends early. Please review the instructions carefully and try again.

Study Ended Early

You answered the same comprehension-check question incorrectly more than two times.

As noted in the instructions, the study has been ended early. Submissions that do not meet our comprehension requirements cannot be approved.

Thank you for your time. You may now close this window.

Final point balance
{{totalPoints}}
No bonus is earned for early terminations.

Round {{trialFeedbackData && trialFeedbackData.trialNum}} / {{trialFeedbackData && trialFeedbackData.totalTrials}} — Results

Score Breakdown

Red Agent Goal
Your answer: {{trialFeedbackData.participantGoal1}} Ground truth: {{trialFeedbackData.goal1GT}}
{{trialFeedbackData.goal1Correct ? '+5' : '−5'}} pts
Green Agent Goal
Your answer: {{trialFeedbackData.participantGoal2}} Ground truth: {{trialFeedbackData.goal2GT}}
{{trialFeedbackData.goal2Correct ? '+5' : '−5'}} pts
Relationship
Your answer: {{trialFeedbackData.participantRelation}} Ground truth: {{trialFeedbackData.relationGT}}
{{trialFeedbackData.relCorrect ? '+5' : '−5'}} pts
This Round
{{trialFeedbackData.pointsDelta >= 0 ? '+' : ''}}{{trialFeedbackData.pointsDelta}} pts
Total Points
{{trialFeedbackData.cumulativePoints}} pts
Estimated Bonus
${{(trialFeedbackData.cumulativePoints / 100 > 0 ? trialFeedbackData.cumulativePoints / 100 : 0).toFixed(2)}}

Experiment Complete!

Thank you for participating.

Comprehension Bonus Summary
Total Points
{{totalPoints}}
Estimated Bonus
${{(totalPoints / 100 > 0 ? totalPoints / 100 : 0).toFixed(2)}}
(Rate: 100 points = $1.00 bonus)
Completion Code
C16R5HIW
Please copy and paste this code back into the survey to receive credit.