Sentiment analysis — Step-by-step instructions

The challenge

We have a set of customer reviews, and we need to classify them as “Positive” or “Negative”. We ask performers to read a review and decide which category it belongs to. Here’s what it might look like:

Video: 6 basic steps to run a project
Create
a project
Create
a task pool
Upload a file
with data
Create
control tasks
Launch
the pool
Get the
results

Create a project

Interface code

{
  "view": {
    "type": "view.list",
    "items": [
      {
        "type": "view.group",
        "content": {
          "type": "view.text",
          "content": {
            "type": "data.input",
            "path": "review"
          }
        }
      },
      {
        "type": "view.group",
        "label": "Is this review positive or negative?",
        "content": {
          "type": "view.list",
          "items": [
            {
              "type": "view.text"
            },
            {
              "type": "view.list",
              "direction": "horizontal",
              "items": [
                {
                  "type": "field.radio-group",
                  "options": [
                    {
                      "label": "Positive",
                      "value": "pos"
                    }
                  ],
                  "data": {
                    "type": "data.output",
                    "path": "sentiment"
                  }
                },
                {
                  "type": "field.radio-group",
                  "options": [
                    {
                      "label": "Negative",
                      "value": "neg"
                    }
                  ],
                  "data": {
                    "type": "data.output",
                    "path": "sentiment"
                  }
                }
              ],
              "validation": {
                "type": "condition.required",
                "data": {
                  "type": "data.output",
                  "path": "sentiment"
                }
              }
            }
          ]
        }
      }
    ]
  },
  "plugins": [
    {
      "1": {
        "type": "action.set",
        "data": {
          "type": "data.output",
          "path": "sentiment"
        },
        "payload": "pos"
      },
      "2": {
        "type": "action.set",
        "data": {
          "type": "data.output",
          "path": "sentiment"
        },
        "payload": "neg"
      },
      "type": "plugin.hotkeys"
    },
    {
      "type": "plugin.toloka",
      "layout": {
        "kind": "scroll",
        "taskWidth": 650
      }
    }
  ]
}

Create a task pool

Upload a file with data

Dataset
Prepare a TSV file with tasks as shown in our example.
Origin
License: CC BY-NC-SA 4.0

Create control tasks

Launch the pool

Get the results

Application for corporate training
We are offering corporate training to help you solve existing challenges and develop
an internal team of Crowd Science Architects (CSA).
Thu Sep 09 2021 13:01:12 GMT+0300 (Moscow Standard Time)