Nyxus: A Next Generation Image Feature Extraction Library for the Big Data and AI Era

2026-03-12

AI Summary

This work addresses the challenge that existing feature extraction methods struggle to simultaneously achieve computational efficiency, accuracy, and cross-domain consistency when processing terabyte- to petabyte-scale 2D/3D image data. To this end, we propose Nyxus—a high-performance feature extraction framework that supports out-of-core computation and CPU/GPU parallel acceleration, featuring a unified architecture for programmable feature optimization and multi-platform deployment. Nyxus offers diverse interfaces including a Python package, command-line tools, a Napari plugin, and an OCI container, making it broadly applicable to biomedical domains such as radiomics and cellular analysis. Benchmark evaluations demonstrate that Nyxus significantly enhances the efficiency and scalability of large-scale AI workflows in both cloud and high-performance computing environments.

Technology Category

• Computer Vision: Medical and Biological Imaging
• Machine Learning: Dimensionality Reduction/Feature Selection
• Humans and AI: Other Foundations of Human Computation & AI

Application Category

• Systems and Infrastructure for Web, Mobile and WoT: Applied ML and AI for Web-based mobile applications
• Search and Retrieval-Augmented AI: Efficiency and scalability of Web search engines
• Web Mining and Content Analysis: Large pretrained models with web data

Abstract

Modern imaging instruments can produce terabytes to petabytes of data for a single experiment. The biggest barrier to processing big image datasets has been computational, where image analysis algorithms often lack the efficiency needed to process such large datasets or make tradeoffs in robustness and accuracy. Deep learning algorithms have vastly improved the accuracy of the first step in an analysis workflow (region segmentation), but the expansion of domain specific feature extraction libraries across scientific disciplines has made it difficult to compare the performance and accuracy of extracted features. To address these needs, we developed a novel feature extraction library called Nyxus. Nyxus is designed from the ground up for scalable out-of-core feature extraction for 2D and 3D image data and rigorously tested against established standards. The comprehensive feature set of Nyxus covers multiple biomedical domains including radiomics and cellular analysis, and is designed for computational scalability across CPUs and GPUs. Nyxus has been packaged to be accessible to users of various skill sets and needs: as a Python package for code developers, a command line tool, as a Napari plugin for low to no-code users or users that want to visualize results, and as an Open Container Initiative (OCI) compliant container that can be used in cloud or super-computing workflows aimed at processing large data sets. Further, Nyxus enables a new methodological approach to feature extraction allowing for programmatic tuning of many features sets for optimal computational efficiency or coverage for use in novel machine learning and deep learning applications.

Problem

• big image data
• feature extraction
• computational scalability
• cross-domain comparison
• image analysis

Innovation

• feature extraction
• out-of-core computing
• scalable image analysis
• multi-domain biomedical features
• GPU/CPU acceleration