Using crowd-based data selection to improve the predictive power of search trend data

Erik Brynjolfsson, Tomer Geva, Shachar Reichman

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Large-scale data generated by crowds provide a myriad of opportunities for monitoring and modeling people's intentions, preferences, and opinions. A crucial step in analyzing such "Big Data" is identifying the relevant data items that should be provided as input to the modeling process. Interestingly, this important step has received limited attention in previous research. This paper proposes a novel crowdbased approach to this data selection problem: leveraging crowds to amplify the predictive capacity of search trend data (Google Trends). We developed an online word association task that taps into people's "thought-collection" process when thinking about a focal term. We empirically tested this method in two domains that have been used as test-beds for prediction. The method yields predictions that are equivalent or superior to those obtained in previous studies (using alternative data selection methods) and to predictions obtained using various benchmark data selection methods.

Original languageEnglish
Title of host publication35th International Conference on Information Systems "Building a Better World Through Information Systems", ICIS 2014
PublisherAssociation for Information Systems
ISBN (Print)9781634396943
StatePublished - 2014
Event35th International Conference on Information Systems: Building a Better World Through Information Systems, ICIS 2014 - Auckland, New Zealand
Duration: 14 Dec 201417 Dec 2014

Publication series

Name35th International Conference on Information Systems "Building a Better World Through Information Systems", ICIS 2014

Conference

Conference35th International Conference on Information Systems: Building a Better World Through Information Systems, ICIS 2014
Country/TerritoryNew Zealand
CityAuckland
Period14/12/1417/12/14

Keywords

  • Big data
  • Prediction
  • Search trend

Fingerprint

Dive into the research topics of 'Using crowd-based data selection to improve the predictive power of search trend data'. Together they form a unique fingerprint.

Cite this