Webinar: Web-scraping for Social Science Research: Websites as a Source of Data

Logo for UK Data Service
Learn More

Before you apply - don't miss out!

Subscribe to our weekly update on new listings

By registering you agree to our terms & conditions and privacy policy.

You can unsubscribe anytime using the link in the bottom of the email.

You will receive an email asking you to confirm your subscription

UK Data Service
Start - End
23 Apr - 23 Apr
Study Options
Contact Name
Christine Dorisamy-Pillai
Contact Email

Vast swathes of our social interactions and personal behaviours are now conducted online and/or captured digitally. In addition to common sources such as social media/network platforms and text corpora, websites and online databases contain rich information of relevance to social science research. Thus, computational methods for collecting data from the web are an increasingly important component of a social scientist’s toolkit.

This free webinar, organised by the UK Data Service, is the second in a series of three on how to collect data from the web using computational methods.

Specifically, this webinar delineates the value, logic and process of capturing data stored on websites. Presented by Dr Diarmuid McDonnell of the UK Data Service, this webinar will cover the step-by-step process of collecting data from a web page, including providing sample code written in the popular Python programming language. It demonstrates web-scraping techniques for capturing real-time information on the Covid-19 pandemic, as well as for the author’s own research specialism (charitable organisations).

Webinar one, on 27 March, will provide an example of a published piece of social research that utilised web-scraping techniques to generate a novel, linked administrative dataset to evaluate a regulatory intervention.

Webinar three, on 30 April, will demonstrate how to use application programming interfaces (APIs) to download data from the web, again using the Python programming language.
There is also a parallel webinar series focusing on getting, storing and manipulating data that illustrates a variety of complementary techniques for collecting data from the web.

Learn More

Featured Courses


June 09, 2020

National Centre for Research Methods

London, UK

July 22, 2020

National Centre for Research Methods

Southampton, UK

May 19, 2020

Physalia Courses

April 24, 2020

National Centre for Research Methods

Southampton, UK

May 07, 2020


May 06, 2020


May 05, 2020

University of Southampton

Southampton, UK

April 03, 2020


May 04, 2020


Sheffield, UK

July 01, 2020

Our Partners

Logo for Nhs
Logo for Waikato
Logo for Quiagen
Logo for Roche
Logo for Ucla

Like what you see?