Side-by-side image comparison — Step-by-step instructions
The challenge

We have a set of 3 icons in 3 pairs. We need to find out which icon people prefer and determine the top icon out of the set. We ask performers to look at the icons and choose the one they prefer and then we aggregate these results to obtain the top icon. Here’s what this might look like:

Video: 5 basic steps to run a project
Create
a project
Create
a task pool
Upload a file
with data
Launch
the pool
Get the
results

Create a project

Interface code

{
  "view": {
    "type": "view.list",
    "items": [
      {
        "type": "layout.side-by-side",
        "items": [
          {
            "type": "view.image",
            "url": {
              "type": "data.input",
              "path": "initial_image"
            }
          },
          {
            "type": "view.image",
            "url": {
              "type": "data.input",
              "path": "image_new"
            }
          }
        ],
        "controls": {
          "type": "view.list",
          "items": [
            {
              "type": "field.radio-group",
              "label": "Which icon do you like more?",
              "options": [
                {
                  "label": "Left",
                  "value": "LEFT"
                },
                {
                  "label": "Right",
                  "value": "RIGHT"
                },
                {
                  "label": "Loading error",
                  "value": "404"
                }
              ],
              "data": {
                "type": "data.output",
                "path": "result"
              },
              "validation": {
                "type": "condition.required"
              }
            }
          ]
        }
      }
    ]
  },
  "plugins": [
    {
      "1": {
        "type": "action.set",
        "data": {
          "type": "data.output",
          "path": "result"
        },
        "payload": "LEFT"
      },
      "2": {
        "type": "action.set",
        "data": {
          "type": "data.output",
          "path": "result"
        },
        "payload": "RIGHT"
      },
      "3": {
        "type": "action.set",
        "data": {
          "type": "data.output",
          "path": "result"
        },
        "payload": "404"
      },
      "type": "plugin.hotkeys"
    }
  ]
}

Create a task pool

Upload a file with data

Dataset
Prepare a TSV file with tasks as shown in our example.
License: CC BY 4.0

Launch the pool

Get the results

Aggregation
Aggregate the results.
Application for corporate training
We are offering corporate training to help you solve existing challenges and develop
an internal team of Crowd Science Architects (CSA).
Mon Aug 02 2021 17:45:03 GMT+0300 (Moscow Standard Time)