Workshop on Standards and Practices in Large-Scale Social Media Research

26 May, 2015 – Oxford, UK
Held in Conjunction with ICWSM 2015


A number of recent papers have raised concerns about methodological practices in large-scale studies of social behavior, particularly those using social media data. Unaddressed, such concerns could call into question much work being done by the research community. The goal of this workshop is to encourage constructive and informed debate on these topics with the goal of producing a body of peer-reviewed work and a working paper of methodological recommendations for the community.

Specifically, this workshop will consider methodological issues that may threaten the validity, reproducibility, and generalizability of large-scale social media research studies. This year’s workshop will bring together papers and discussions on a range of topics including:

  • Constraints on and opportunities for data sharing
  • Publication practices (e.g., paper length limits, standards about supplementary materials)
  • Standards for statistical analysis
  • Quantifying and accounting for platform specific biases (platform design, user base, platform-specific behavior, platform storage policies)
  • Code sharing/publications practices

The workshop will include a host of events including invited reports on particular topics, accepted paper presentations, posters, and brainstorming/discussion sessions.

A crucial outcome of the workshop will be a set of recommendations to the broader ICWSM community on the topics covered during the workshop.