Creating a Historical Migration Dataset from Finnish Church Records, 1800-1920

2025-06-09

AI Summary

This study addresses the challenge of transforming unstructured, handwritten church migration records from Finland (1800–1920) into structured demographic data for historical population analysis. The corpus comprises 200,000 archival pages and over 6 million individual migration entries—previously inaccessible to quantitative research due to their handwritten, non-digitized nature. Method: We propose the first end-to-end deep learning pipeline for historical handwritten documents, integrating layout analysis, table detection, cell classification, and handwritten text recognition (HTR) to achieve fully automated, large-scale digitization and structural extraction. Contribution/Results: The resulting spatiotemporally aligned, open-access database achieves state-of-the-art accuracy in historical document processing. Applied to the Elimäki parish case study, it enables integrated micro–macro analyses—including urbanization patterns, family migration chains, and disease diffusion—thereby establishing a reusable methodological framework and infrastructural resource for digital humanities and historical population geography.

Technology Category

• Humans and AI: Crowd Sourcing and Human Computation
• Natural Language Processing: Information Extraction
• Data Mining & Knowledge Management: Intelligent Query Processing

Application Category

• Web Mining and Content Analysis: Bridging structured and unstructured data
• Graph Algorithms and Modeling for the Web: Graph neural networks and deep learning approaches for Web-related graphs
• Economics, Online Markets and Human Computation: Data quality aspects of human-annotated datasets

Abstract

This article presents a large-scale effort to create a structured dataset of internal migration in Finland between 1800 and 1920 using digitized church moving records. These records, maintained by Evangelical-Lutheran parishes, document the migration of individuals and families and offer a valuable source for studying historical demographic patterns. The dataset includes over six million entries extracted from approximately 200,000 images of handwritten migration records. The data extraction process was automated using a deep learning pipeline that included layout analysis, table detection, cell classification, and handwriting recognition. The complete pipeline was applied to all images, resulting in a structured dataset suitable for research. The dataset can be used to study internal migration, urbanization, and family migration, and the spread of disease in preindustrial Finland. A case study from the Elim""aki parish shows how local migration histories can be reconstructed. The work demonstrates how large volumes of handwritten archival material can be transformed into structured data to support historical and demographic research.

Problem

• Creating structured dataset from Finnish church migration records
• Automating extraction of handwritten records using deep learning
• Studying historical migration, urbanization, and disease spread

Innovation

• Automated deep learning pipeline for data extraction
• Processed 200,000 handwritten record images
• Generated structured dataset for migration research