A Crowdsourcing Engine for Mechanized Labor
Crowdsourcing is an established approach for producing and analyzing data that can be represented as a human-assisted computation system. This paper presents a crowdsourcing engine that makes it possible to run a highly customizable hosted crowdsourcing platform controlling the entire annotation pro...
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Ivannikov Institute for System Programming of the Russian Academy of Sciences
2018-10-01
|
| Series: | Труды Института системного программирования РАН |
| Subjects: | |
| Online Access: | https://ispranproceedings.elpub.ru/jour/article/view/657 |
| _version_ | 1818566518288416768 |
|---|---|
| author | D. A. Ustalov |
| author_facet | D. A. Ustalov |
| author_sort | D. A. Ustalov |
| collection | DOAJ |
| description | Crowdsourcing is an established approach for producing and analyzing data that can be represented as a human-assisted computation system. This paper presents a crowdsourcing engine that makes it possible to run a highly customizable hosted crowdsourcing platform controlling the entire annotation process including such elements as task allocation, worker ranking and result aggregation. The approach and the implementation have been described, and the conducted experiment shows promising preliminary results. |
| first_indexed | 2024-12-14T01:54:43Z |
| format | Article |
| id | doaj.art-31266e7bab774b87ad7b6f5153472b60 |
| institution | Directory Open Access Journal |
| issn | 2079-8156 2220-6426 |
| language | English |
| last_indexed | 2024-12-14T01:54:43Z |
| publishDate | 2018-10-01 |
| publisher | Ivannikov Institute for System Programming of the Russian Academy of Sciences |
| record_format | Article |
| series | Труды Института системного программирования РАН |
| spelling | doaj.art-31266e7bab774b87ad7b6f5153472b602022-12-21T23:21:15ZengIvannikov Institute for System Programming of the Russian Academy of SciencesТруды Института системного программирования РАН2079-81562220-64262018-10-0127335136410.15514/ISPRAS-2015-27(3)-25657A Crowdsourcing Engine for Mechanized LaborD. A. Ustalov0ИММ УрО РАНCrowdsourcing is an established approach for producing and analyzing data that can be represented as a human-assisted computation system. This paper presents a crowdsourcing engine that makes it possible to run a highly customizable hosted crowdsourcing platform controlling the entire annotation process including such elements as task allocation, worker ranking and result aggregation. The approach and the implementation have been described, and the conducted experiment shows promising preliminary results.https://ispranproceedings.elpub.ru/jour/article/view/657краудсорсингмеханизированный трудчеловеко-машинные вычисленияназначение заданийоценка труда участниковагрегация ответов |
| spellingShingle | D. A. Ustalov A Crowdsourcing Engine for Mechanized Labor Труды Института системного программирования РАН краудсорсинг механизированный труд человеко-машинные вычисления назначение заданий оценка труда участников агрегация ответов |
| title | A Crowdsourcing Engine for Mechanized Labor |
| title_full | A Crowdsourcing Engine for Mechanized Labor |
| title_fullStr | A Crowdsourcing Engine for Mechanized Labor |
| title_full_unstemmed | A Crowdsourcing Engine for Mechanized Labor |
| title_short | A Crowdsourcing Engine for Mechanized Labor |
| title_sort | crowdsourcing engine for mechanized labor |
| topic | краудсорсинг механизированный труд человеко-машинные вычисления назначение заданий оценка труда участников агрегация ответов |
| url | https://ispranproceedings.elpub.ru/jour/article/view/657 |
| work_keys_str_mv | AT daustalov acrowdsourcingengineformechanizedlabor AT daustalov crowdsourcingengineformechanizedlabor |