- Home
- Administrative data
- Our research
- About us
- Contact us
- News and events
- BLOG - Access to secure data during the Covid-19 pandemic - a model for the future?
- Covid-19 and Care Homes: Advances in Administrative Data Research during the pandemic
- DATA INSIGHTS -Deprivation and informal care at the end of life
- BLOG - Reflections on engaging with children & young people about data
- NEWS - Innovative new residential linkage tool launched
- BLOG SERIES - Dramatic increase in deaths at home- No.4
- DATA INSIGHTS - Youth Movements, Social Mobility and Health Inequalities
- NEWS - New report warns of deepening poverty crisis for Scottish families
- New report on Infants Born into Care in Scotland
- Spotlight on Dr Elizabeth Lemmon
- Spotlight on Jan Savinc
- BLOG - Covid-19 fines in Scotland: What we know so far
- BLOG - The value of social science and administrative data research in Scotland: how we are helping respond to COVID-19
- NEWS - Joining together with Research Data Scotland to co-host existing public panel on data
- DATA INSIGHTS - Exploring illegal drug consignments in Scotland
- DATA INSIGHTS -Linking two administrative data sets about looked after children
- NEWS - ADR UK grants 20 PhD studentship opportunities focused on quantitative research using linked administrative data
- NEWS – ADR Scotland data ambassadors launched
- Spotlight on Peter Christen
- The importance of administrative data
- Virtual Conference - Data Linkage: Information to Impact
- An Introduction to Data Science for Administrative Data Research course - March 2023
- BLOG SERIES - Dramatic increase in deaths at home - No.7
- BLOG SERIES - Dramatic increase in deaths at home
- BLOG SERIES - Dramatic increase in deaths at home- No.3
- DATA INSIGHTS - Investigating the effects of class composition and class size on pupils’ attainment in Scottish primary schools
- NEWS - New opportunity to join ADR Scotland’s Public Panel
- BLOG - Engaging the public through our public panel
- BLOG - Exploring the potential of synthetic data
- Children’s Health in Care in Scotland (CHiCS)
- DATA INSIGHTS - Automatic Coding of Occupations: Methods to create the Scottish Historic Population Database (SHPD)
- DATA INSIGHTS - Selective schools: do they improve health?
- DATA INSIGHTS - Were people who died at home less likely to attend hospital at the end of life during the Covid pandemic?
- EVENT - Active Travel: New Data, New Insights
- EVENT - Holyrood Evidence Week: Doing Data Better for Policy and Public Good
- EVENT - Unlocking criminal justice data in Scotland: Findings from Data First
- IPDLN Conference - Data linkage research: informing policy and practice
- NEWS - Making nursing data available to inform policy
- NEWS - New report on The Impact of Covid-19 on Children’s Care Journeys in Scotland: An Analysis of the Administrative Data on 'Looked After' Children
- NEWS - Updated report on Infants Born into Care in Scotland
- Scout and Guide participation boosts later life health
- BLOG - Geospatial Ambitions
- BLOG - Taking historical death records and developing a database for future analysis
- BLOG - Unlocking criminal justice data
- DATA INSIGHTS - Community mortality due to Covid-19
- DATA INSIGHTS - What makes people more likely to cycle to work?
- Future-proofing investment into administrative data research announced in Scotland
- NEWS - Understanding the dynamics of the nursing workforce: the potential of routinely collected data
- Spotlight on Joanna Soraghan
- Spotlight on Katherine Falconer
- Why misconceptions about population data can lead to bad outcomes
- ADR Scotland publishes its strategy for 2022-2026
- BLOG - Developing and re-shaping our public panel
- BLOG - Review of the recent DWP Areas of Research Interest Workshop
- BLOG: Developing a cross-national research agenda on crime and convictions
- BLOG: Working together to make a difference with data
- DATA INSIGHTS - Homelessness duration in Scotland: how long does rehousing take?
- DATA INSIGHTS - Occupation and COVID-19 deaths: Scotland in a comparative perspective
- DATA INSIGHTS -The health and economic benefits of active commuting in Scotland
- EVENT - ADR UK Conference 2023
- EVENT - RSE The secret world of data
- NEWS - New comic on children's rights and data
- NEWS - Report published on our children’s engagement pilot study
- NEWS - When did fines issued by the police for breaking Covid rules peak?
- Scotland’s portfolios: Research and Statistical Data - building a new approach to thematic data linkage
- Spotlight on Cecilia Macintyre
- Spotlight on Dr Evan Williams
- Spotlight on Fernando Pantoja
- Spotlight on Laurie Berrie
- ADR Scotland Winter Partnership Session - **internal event**
- BLOG - AGEING AND HOMELESSNESS IN SCOTLAND
- BLOG - Can we use linked administrative data to identify social disadvantage?
- BLOG - Commuting and its impact on health
- BLOG - The Dynamics of the Nursing Workforce in the UK: Using data to support our nurses
- BLOG: Growing up in kinship care
- Congratulations to Alastair McAlpine, the new Chief Statistician for Scottish Government
- DATA INSIGHTS - Analysing a season of death and excess mortality in Scotland’s past
- EVENT - ADR UK Virtual Half Day event
- EVENT - HDR UK Conference: Data for global health and society
- EVENT - Introduction to Data Science for Administrative Data Research course (IDS-ADR)
- Event - Public data for public good: towards better understanding children's lives
- NEWS - ADR Scotland's first flagship dataset
- NEWS - Data research initiative secures £90 m funding extension
- NEWS: Our role supporting the new Covid-19 research data service in Scotland
- Spotlight on Gina Anghelescu
- Spotlight on Michelle K Jamieson
- Webinar - An Introduction to Looked-After Children Dataset
- ADR Scotland Away Day (**for staff only**)
- BLOG - An Inside Job: Using Criminology, Police Data and a Lot of Nouse
- BLOG - Improving justice data to promote data justice in Scotland
- BLOG - Location of death in 2020: a changing trend from hospitals to homes
- BLOG - Reflecting on the ADR UK Conference: Insights from our new PhD Researchers
- BLOG - Seeking feedback on Research Data Scotland’s core principles via our public panel
- BLOG - What skills, training and support are required by those wishing a career as an administrative data researcher?
- BLOG No. 9 - Final blog in this 'deaths at home' series
- BLOG SERIES - Dramatic increase in deaths at home - No. 6
- BLOG SERIES - Dramatic increase in deaths at home - No.8
- BLOG SERIES - Dramatic increase in deaths at home- No.5
- BLOG: 5 things I've learnt about working with policymakers...
- BLOG: Automating Coding for Large Historical Datasets
- BLOG: COVID-19- How increased deaths at home impact the carer community
- DATA INSIGHTS -Postal deliveries of drugs in Scotland
- EVENT - 'Getting things done with data in government'
- EVENT - Linking public sector data for research: an ADR UK showcase event
- EVENT Seminar - Administrative data for social policy research: potential and pitfalls
- NEWS - ADR Scotland launches new podcast series
- NEWS - Additional funding for Understanding Children’s Lives and Outcomes
- NEWS - Engaging children and young people
- NEWS: Police use of Fixed Penalty Notices under the Covid-19 regulations in Scotland: A new data report highlights links with deprivation and inequality
- NEWS: Police use of the new Covid-19 powers: Using administrative data to analyse and evaluate practice
- Research Data Scotland - New user forum
- Spotlight on Dr Patricio Troncoso
- Spotlight on Renata Samulnik
- Summary of ADR Scotland Winter Partnership session
- Directorship of the International Population Data Linkage Network (IPDLN) for 2021-22.
- BLOG: In the light of experience: InterRAI and the final thousand days of life
- Multiple health conditions and social care
- NEWS - Susan McVie elected as Fellow of the Academy of Social Sciences
- SCADR relocates to the Bayes Centre
- EVENT: Four day introduction to using administrative data for social and health research
- BLOG: The value of administrative data: DALYs and the Scottish Burden of Disease study
- BLOG: Where to start with parliamentary and policy engagement
- EVENT - International Conference on Administrative Data Research, Cardiff
- EVENT - Using data to realise the potential of the 'Last 1000 days'
- EVENT: TalkingData: ADR Scotland mini-summit
- EVENT: “Let’s use data to save time, money and lives”: ADR Scotland partners gather for mini-summit
- EVENTS: ADR Scotland researchers present at international conference in Cardiff
BLOG - Can we use linked administrative data to identify social disadvantage?
In this blog, Dr Serena Pattaro from our centre shares her reflections on the value of longitudinal administrative data as a reliable alternative or complement to survey data.
My research, in collaboration with Nick Bailey and Chris Dibben and recently published in Social Indicators Research, illustrates the huge potential of using longitudinal linked administrative data to identify social disadvantage.
Motivation
This research started off with a substantive question concerning the link between employment and poverty. We know that paid work is central to poverty risks but it is less known how much work is needed to help people exit poverty. It is also unclear how important stability of employment is for lifting people out of poverty. We wanted to know whether we can capture labour market histories through administrative data in ways that remain meaningful for identifying poverty risks.
Related to the substantive question, we also had a methodological question. So, for example, we know that administrative data from the benefits and tax systems are widely used in the UK to construct indicators of social disadvantage. Key examples are Free School Meals and Indices of Multiple Deprivation that are used both by researchers but also by policy makers to identify and target resources to pupils, schools and communities in the most deprived areas or circumstances. These indicators are often based on cross-sectional measures, which are measured at one point in time. In our research, we asked: can we do any better than this? Can we identify social disadvantage using longitudinal (measured over time) rather than cross-sectional measures?
What we did
I reconstructed individual labour market histories using routinely collected administrative data on welfare benefits from DWP and annual earnings from employment from HMRC. These were linked to data from a large national survey, the Poverty and Social Exclusion Survey UK (PSE-UK) conducted in 2012. I used the survey data to compare and validate both the cross-sectional and longitudinal indicators of social disadvantage from administrative data.
I was lucky to join a team of researchers who were involved with the design and analysis of the PSE-UK. It was relatively straightforward for us to access the linked administrative-survey data, because the survey participants had already provided consent for their survey data to be linked to administrative data. In addition, the data linkage itself was carried out internally by DWP analysts who linked both DWP and HMRC admin records to PSE-UK via their sponsored Family and Resources Survey (FRS) conducted in 2010/11. FRS is an annual survey which is often used to produce official national statistics on income and poverty. In 2010/11 respondents were asked to provide permission to be re-contacted in a follow-up survey (PSE-UK 2012).
What we found
My research shows that the longitudinal measures reconstructed from administrative data match closely survey responses and help to improve predictions of poverty risks, compared to measures based on cross-sectional data. This is the first research using admin data linked to poverty data from the Poverty and Social Exclusion Survey. The results are broadly in line with prior research which was commissioned by DWP. This was conducted by Stephen McKay to evaluate the linkage between FRS 2010/11 data and admin records from DWP and HMRC. The results are reported in his DWP working paper Evaluating approaches to Family Resources Survey data linking in 2012. Our research takes this one step further: we test how the longitudinal admin data measures performed when including these in a model predicting current poverty risks, in contrast to comparable survey measures and cross-sectional admin measures.
Working with limitations of linked administrative data
There are of course some limitations when using administrative data. For example, I had to work with a limited set of welfare benefits, mainly Jobseeker’s Allowance and Income Support, and this only covered paid employment and not self-employment. Another important issue is that unemployment captured by administrative data may be different from unemployment as reported by survey respondents. We need to be aware of these discrepancies when making sense of the results we find from our research.
Despite these limitations, we can still show that there are clear gains when moving from cross-sectional to longitudinal administrative measures and from a single domain - welfare benefits - to two domains where we add earnings in our modelling exercise.
This article was published on 06 Feb 2020