| URL: | http://www.mitre.org/publications/technical-papers/crowdsourcing-and-curation-perspectives |
| Full name: | |
| Description: | Crowdsourcing is increasingly utilized for performing tasks in both natural language processing and biocuration. This perspective piece reviews four case studies to explore broader questions, including: 1) Expertise and the kinds of expertise required for different tasks; 2)crowdsourcing applied to biocuration that uses a micro-tasking approach combining automated entity extraction with human judgments on relationships between those entities (so-called ‘hybrid curation’); 3) the use of crowdsourcing to verify (and refine) existing network models for disease-related pathways derived from literature curation and transcriptomics data; snd 4) the challenges of capturing adequate computable metadata for metagenomics and the need for crowdsourced data. |
| Year founded: | 2016 |
| Last update: | |
| Version: | |
| Accessibility: |
Unaccessible
|
| Country/Region: | United States |
| Data type: | |
| Data object: |
NA
|
| Database category: | |
| Major species: |
NA
|
| Keywords: |
| University/Institution: | MITRE Corporation |
| Address: | The MITRE Corporation, Bedford, MA, USA |
| City: | |
| Province/State: | |
| Country/Region: | United States |
| Contact name (PI/Team): | Lynette Hirschman |
| Contact email (PI/Helpdesk): | lynette@mitre.org |
|
Crowdsourcing and curation: perspectives from biology and natural language processing. [PMID: 27504010]
Crowdsourcing is increasingly utilized for performing tasks in both natural language processing and biocuration. Although there have been many applications of crowdsourcing in these fields, there have been fewer high-level discussions of the methodology and its applicability to biocuration. This paper explores crowdsourcing for biocuration through several case studies that highlight different ways of leveraging 'the crowd'; these raise issues about the kind(s) of expertise needed, the motivations of participants, and questions related to feasibility, cost and quality. The paper is an outgrowth of a panel session held at BioCreative V (Seville, September 9-11, 2015). The session consisted of four short talks, followed by a discussion. In their talks, the panelists explored the role of expertise and the potential to improve crowd performance by training; the challenge of decomposing tasks to make them amenable to crowdsourcing; and the capture of biological data and metadata through community editing.Database URL: http://www.mitre.org/publications/technical-papers/crowdsourcing-and-curation-perspectives. |