Task-Conditioned Synthetic Data Generation for Improving Machine Learning Performance in Agricultural Prediction Tasks

2026-07-04

AI Summary

This study addresses the challenge of scarce or low-quality real-world training data in agricultural prediction tasks by proposing a Task-Conditioned Synthetic Data Generation (TCSDG) framework. TCSDG introduces, for the first time in agricultural data synthesis, a task-conditioning mechanism that integrates Bayesian networks with TabICL—a Transformer-based tabular foundation model—to generate high-quality synthetic data tailored to downstream tasks. The approach synergistically combines teacher–student knowledge distillation with in-context learning strategies. Evaluated across 12 experimental sites, TCSDG significantly outperforms six baseline methods in 89% of crop classification tasks and 74% of yield prediction tasks, demonstrating consistent effectiveness across both task types—making it the only synthetic data generation approach to achieve stable performance gains in both domains.

Abstract

Machine Learning (ML) algorithms have been widely used to estimate agricultural variables across diverse contexts. However, because the quantity and quality of training data strongly influence performance of ML algorithms, their use can be constrained by limited or incomplete reference data. Synthetic Data Generation (SDG) offers a practical approach to address this issue by producing artificial but realistic samples that preserve key characteristics of the original data. Building on teacher-student knowledge transfer and in-context learning for tabular data, this study proposes a Task-Conditioned SDG (TCSDG) algorithm that pairs a Bayesian Network generator with a transformer-based tabular foundation model (TabICL). The proposed algorithm was evaluated on two agricultural prediction tasks: crop yield prediction and crop type classification. Six benchmark SDG algorithms were also utilized to compare their performance with that of TCSDG. Across twelve study sites, two training-data fractions, four multiplication ratios, and three predictive ML algorithms, augmenting the original data with TCSDG-generated synthetic data improved ML performance in 89% of the crop type classification experiments and 74% of the crop yield prediction experiments. TCSDG also substantially outperformed benchmark SDG algorithms and was the only method to consistently improve ML performance across both tasks at the aggregate level. The study demonstrates that carefully designed and processed synthetic data can improve ML performance in precision-agriculture applications. TCSDG offers a practical and extensible framework for generating synthetic data that supports downstream ML agricultural prediction. The full implementation of TCSDG is publicly available as open source at https://github.com/HamidEbrahimy/TCSDG.

Problem

• synthetic data generation
• agricultural prediction
• machine learning performance
• data scarcity
• tabular data

Innovation

• Task-Conditioned Synthetic Data Generation
• Tabular Foundation Model
• Bayesian Network
• In-Context Learning
• Agricultural Prediction