The INRIA DataLake: A Generic and Scalable Ecosystem of Pipelines for HAL Applied to Software Mentions Tracking

2026-07-10

AI Summary

This work addresses the challenge of efficiently accessing structured scholarly publications and associated software metadata within research knowledge bases. To this end, the authors propose a generic and extensible interoperable pipeline architecture built upon the shared Grid’5000/ABACA infrastructure, integrating modules for document preprocessing, information extraction, software mention recognition, and visualization. Designed to support multi-team collaboration, user validation, and external interoperability, the system demonstrates its utility through a daily tracking application of software mentions in the HAL open archive, significantly enhancing the visibility of research software and advancing open science practices. Experimental results confirm that the pipeline efficiently processes large-scale scientific literature and enables automated extraction and visual representation of software mentions within the HAL portal.

Abstract

Research repositories contain a large amount of scientific knowledge, but access to structured articles and specialised information, such as datasets or software metadata, remains limited. In this paper, we present the INRIA DataLake project, which provides an ecosystem of scalable and interconnected pipelines for preparing scientific literature, extracting structured information, and applying specialised treatments. Using a large-scale shared infrastructure, Grid'5000/ABACA, we demonstrate our ecosystem through a concrete use case: extracting software mentions from scientific articles deposited daily and visualising them after validation in the HAL research portal. Our results show that the system can efficiently process large volumes of scientific literature while supporting user validation and interoperability with external systems. Designed to grow by integrating additional pipelines and sharing the preparation effort across research groups, this project already contributes to open science through improved visibility and tracking of research software.

Problem

• software mentions
• research repositories
• structured information
• scientific literature
• open science

Innovation

• DataLake
• scalable pipelines
• software mentions extraction
• interoperability
• open science