Structure of Classifier Boundaries: Case Study for a Naive Bayes Classifier

📅 2022-12-08
🏛️ arXiv.org
📈 Citations: 2
Influential: 0
📄 PDF
🤖 AI Summary
This paper addresses the challenge of vast and structurally complex decision boundaries in DNA read mapping to reference genomes in next-generation sequencing (NGS). It investigates the boundary properties of naïve Bayes classifiers under graph-structured input spaces. To this end, the authors propose “neighborhood similarity” — a novel uncertainty measure that is both theoretically interpretable and universally computable, overcoming the reliance of conventional Bayesian confidence on model outputs. Leveraging graph-model-driven boundary analysis, neighborhood distribution statistics, and uncertainty quantification, the study reveals the high-dimensional complexity of decision boundaries and proves that the proposed measure simultaneously captures intrinsic Bayesian uncertainty. Moreover, it seamlessly extends to black-box classifiers lacking built-in confidence mechanisms. Empirically, neighborhood similarity significantly enhances classification interpretability and robustness, offering a principled framework for uncertainty-aware read mapping in NGS applications.
📝 Abstract
Whether based on models, training data or a combination, classifiers place (possibly complex) input data into one of a relatively small number of output categories. In this paper, we study the structure of the boundary--those points for which a neighbor is classified differently--in the context of an input space that is a graph, so that there is a concept of neighboring inputs, The scientific setting is a model-based naive Bayes classifier for DNA reads produced by Next Generation Sequencers. We show that the boundary is both large and complicated in structure. We create a new measure of uncertainty, called Neighbor Similarity, that compares the result for a point to the distribution of results for its neighbors. This measure not only tracks two inherent uncertainty measures for the Bayes classifier, but also can be implemented, at a computational cost, for classifiers without inherent measures of uncertainty.
Problem

Research questions and friction points this paper is trying to address.

Analyzes boundary structure of naive Bayes classifiers
Studies uncertainty in DNA read assignment to genomes
Introduces Neighbor Similarity as new uncertainty measure
Innovation

Methods, ideas, or system contributions that make the work stand out.

Introduces Neighbor Similarity as uncertainty measure
Applies to classifiers without inherent uncertainty measures
Analyzes boundary structure in graph-based Bayes classifiers
🔎 Similar Papers
💼 Related Jobs
No related jobs found.
A
A. Karr
Temple University, Department of Statistics, Operations, and Data Science and Fraunhofer USA Center Mid-Atlantic
Z
Zac Bowen
Fraunhofer USA Center Mid-Atlantic
A
A. Porter
University of Maryland, Department of Computer Science, and Fraunhofer USA Center Mid-Atlantic