Downloading Wisdom from Online Crowds
Source: Wharton School, University of Pennsylvania (via SSRN)

The internet contains billions of documents, is there useful information in the number of websites about different topics? We propose, based on the premise that the occurrence of a phenomenon increases the likelihood that people write about it, that the relative frequency of documents discussing a phenomenon can be used to proxy for the corresponding occurrence-frequency. After establishing the conditions under which such proxying is likely to be successful, we construct proxies for a number of demographic variables in the US and for corruption across US states and countries, obtaining average correlations with occurrence-frequencies of 0.46 and 0.61 respectively. We also replicate results from two separate published papers establishing the correlates of corruption. Finally, we construct the first index of corruption in US cities and study its correlates.

Several options available for retrieval of full text (PDF; 284 KB).

See also: Predictions and Perceptions: Downloading Wisdom from Online Crowds (Knowledge@Wharton)

This entry was posted on Thursday, August 9th, 2007 at 11:48 am and is filed under Internet, Social and cultural issues. You can follow any responses to this entry through the RSS 2.0 feed. Responses are currently closed, but you can trackback from your own site.