- Home
- Administrative data
- Our research
- About us
- Contact us
- News and events
- BLOG - Access to secure data during the Covid-19 pandemic - a model for the future?
- Covid-19 and Care Homes: Advances in Administrative Data Research during the pandemic
- DATA INSIGHTS -Deprivation and informal care at the end of life
- NEWS - Innovative new residential linkage tool launched
- BLOG SERIES - Dramatic increase in deaths at home- No.4
- DATA INSIGHTS - Youth Movements, Social Mobility and Health Inequalities
- NEWS - New report warns of deepening poverty crisis for Scottish families
- New report on Infants Born into Care in Scotland
- Spotlight on Dr Elizabeth Lemmon
- Spotlight on Jan Savinc
- BLOG - The value of social science and administrative data research in Scotland: how we are helping respond to COVID-19
- DATA INSIGHTS - Exploring illegal drug consignments in Scotland
- DATA INSIGHTS -Linking two administrative data sets about looked after children
- NEWS – ADR Scotland data ambassadors launched
- The importance of administrative data
- Virtual Conference - Data Linkage: Information to Impact
- BLOG SERIES - Dramatic increase in deaths at home - No.7
- BLOG SERIES - Dramatic increase in deaths at home
- BLOG SERIES - Dramatic increase in deaths at home- No.3
- DATA INSIGHTS - Investigating the effects of class composition and class size on pupils’ attainment in Scottish primary schools
- NEWS - New opportunity to join ADR Scotland’s Public Panel
- BLOG - Exploring the potential of synthetic data
- DATA INSIGHTS - Automatic Coding of Occupations: Methods to create the Scottish Historic Population Database (SHPD)
- DATA INSIGHTS - Selective schools: do they improve health?
- EVENT - Active Travel: New Data, New Insights
- EVENT - Holyrood Evidence Week: Doing Data Better for Policy and Public Good
- BLOG - Geospatial Ambitions
- BLOG - Taking historical death records and developing a database for future analysis
- DATA INSIGHTS - Community mortality due to Covid-19
- Future-proofing investment into administrative data research announced in Scotland
- NEWS - Understanding the dynamics of the nursing workforce: the potential of routinely collected data
- Spotlight on Katherine Falconer
- ADR Scotland publishes its strategy for 2022-2026
- BLOG: Developing a cross-national research agenda on crime and convictions
- BLOG: Working together to make a difference with data
- DATA INSIGHTS - Homelessness duration in Scotland: how long does rehousing take?
- DATA INSIGHTS - Occupation and COVID-19 deaths: Scotland in a comparative perspective
- DATA INSIGHTS -The health and economic benefits of active commuting in Scotland
- IPDLN Conference - Data linkage research: informing policy and practice
- Spotlight on Dr Evan Williams
- Spotlight on Fernando Pantoja
- Spotlight on Laurie Berrie
- ADR Scotland Winter Partnership Session - **internal event**
- BLOG - AGEING AND HOMELESSNESS IN SCOTLAND
- BLOG - Can we use linked administrative data to identify social disadvantage?
- BLOG - Commuting and its impact on health
- BLOG - The Dynamics of the Nursing Workforce in the UK: Using data to support our nurses
- BLOG: Growing up in kinship care
- DATA INSIGHTS - Analysing a season of death and excess mortality in Scotland’s past
- EVENT - ADR UK Virtual Half Day event
- Event - Public data for public good: towards better understanding children's lives
- NEWS - Data research initiative secures £90 m funding extension
- NEWS: Our role supporting the new Covid-19 research data service in Scotland
- Spotlight on Michelle K Jamieson
- Webinar - An Introduction to Looked-After Children Dataset
- BLOG - An Inside Job: Using Criminology, Police Data and a Lot of Nouse
- BLOG - Improving justice data to promote data justice in Scotland
- BLOG - Location of death in 2020: a changing trend from hospitals to homes
- BLOG - Seeking feedback on Research Data Scotland’s core principles via our public panel
- BLOG - What skills, training and support are required by those wishing a career as an administrative data researcher?
- BLOG No. 9 - Final blog in this 'deaths at home' series
- BLOG SERIES - Dramatic increase in deaths at home - No. 6
- BLOG SERIES - Dramatic increase in deaths at home - No.8
- BLOG SERIES - Dramatic increase in deaths at home- No.5
- BLOG: 5 things I've learnt about working with policymakers...
- BLOG: Automating Coding for Large Historical Datasets
- BLOG: COVID-19- How increased deaths at home impact the carer community
- DATA INSIGHTS -Postal deliveries of drugs in Scotland
- EVENT - 'Getting things done with data in government'
- EVENT - Linking public sector data for research: an ADR UK showcase event
- EVENT Seminar - Administrative data for social policy research: potential and pitfalls
- NEWS - Additional funding for Understanding Children’s Lives and Outcomes
- NEWS - Engaging children and young people
- NEWS: Police use of Fixed Penalty Notices under the Covid-19 regulations in Scotland: A new data report highlights links with deprivation and inequality
- NEWS: Police use of the new Covid-19 powers: Using administrative data to analyse and evaluate practice
- Research Data Scotland - New user forum
- Spotlight on Dr Patricio Troncoso
- Summary of ADR Scotland Winter Partnership session
- Directorship of the International Population Data Linkage Network (IPDLN) for 2021-22.
- BLOG: In the light of experience: InterRAI and the final thousand days of life
- Multiple health conditions and social care
- NEWS - Susan McVie elected as Fellow of the Academy of Social Sciences
- SCADR relocates to the Bayes Centre
- EVENT: Four day introduction to using administrative data for social and health research
- BLOG: The value of administrative data: DALYs and the Scottish Burden of Disease study
- BLOG: Where to start with parliamentary and policy engagement
- EVENT - International Conference on Administrative Data Research, Cardiff
- EVENT - Using data to realise the potential of the 'Last 1000 days'
- EVENT: TalkingData: ADR Scotland mini-summit
- EVENT: “Let’s use data to save time, money and lives”: ADR Scotland partners gather for mini-summit
- EVENTS: ADR Scotland researchers present at international conference in Cardiff
- SafePod Network
BLOG - Taking historical death records and developing a database for future analysis
This week, our researcher Eilidh Garrett talks about her work on the Scottish Historic Population Database (SHPD) which is transforming the accessibility of historical records for future research and analysis.
Over the course of the Covid-19 pandemic, we have received regular reports of death rates from our own nation and the rest of the world, showing how valuable data can be. However, it became apparent that the daily tolls of death could not be directly compared across the United Kingdom because calculation methodologies and inclusion criteria vary. Understanding how difficult it has been during Covid-19 to accurately compare information even between neighbouring nations, makes it easier to understand how hard it can be to compare and contrast causes of death over several decades or even centuries.
Understanding death records over time
Researchers involved in the Scottish Historic Population Database project (SHPD) have had the difficult task of comparing and contrasting causes of death in Scotland from 1855 - when civil registration of vital events began - until 1973 when they became automated. During this period, there were numerous changes and developments in:
- scientific understanding
- medical training and traditions
- recording practices and priorities
...all of which made it even more challenging to reach a meaningful interpretation of the causes of death recorded.
To gain the fullest possible understanding of the reason for a death, the term(s) provided on a Death Certificate are often not enough. Meaningful interpretation of series of mortality statistics published by a government or statistical authority, such as the World Health Organisation (WHO), requires even more care. Researchers must be aware of the legislation at that time surrounding the medical certification, the registering of the death and the death certificate. Questions our researchers considered included:
- Were there guidelines on how causes of death were to be recorded on both the medical and death certificates, and, if so, who laid them out?
- Which categories of death were given greatest prominence? Why?
- Do particular terms mean the same across different times or in different languages?
- Who was expected to register a death or report how a person had died, and was it compulsory?
- Was the register kept by the Church or by the State?
- How were statistics compiled?
From Deathbed to Database
This project seeks to create the SHPD research database, which contains machine-readable information on each of the 25.6 million or so births, marriages or deaths that took place in Scotland between 1855 and 1973.
Together with a team at the University of Cambridge and a number of European partners, we have developed a coding system for causes of death to enable analysis of the information found on individual death certificates. This system, named ‘ICD10h’, is based on the WHO’s International Classification of Diseases, 10th revision (ICD10).
While ICD10 contains many thousands of diseases, conditions and events which may cause ill health or death, it does not contain historical disease descriptions such as ‘childbed fever’, ‘teething’, ‘strangled by a peat creel’ or ‘found dead on privvy’. These descriptions had to be incorporated into the ICD10h system and new codes created for them. This enables researchers to assess how particular terms have evolved over time or have now been superseded as medical knowledge advances.
A dictionary of historic causes in a variety of languages is also being built up to encourage international comparison of mortality.
Future research
The data held in the SHPD database will allow researchers to analyse the demographic, social, economic and medical histories of Scotland across the nineteenth and twentieth centuries in unprecedented detail and from a number of new perspectives.
This article was published on 01 Dec 2021