Generative Multiform Bayesian Optimization
Bayesian optimization (BO) of expensive black-box functions over complex input spaces—such as discrete or non-Euclidean domains—remains challenging. Existing generative BO (GBO) methods suffer from suboptimal convergence and solution quality due to reliance on a single latent space and inability to handle variable-dimensional inputs robustly. Method: We propose a multimodal generative BO framework featuring: (i) parallel optimization across multiple cooperative latent spaces; (ii) a generative model (VAE/GAN) with positive-correlation constraints to preserve fidelity between latent representations and objective values; and (iii) two cross-space information exchange strategies to reconcile the trade-off between dimension selection and the accuracy–convergence rate balance. Results: Evaluated on airfoil design, cantilever beam optimization, and area maximization tasks, our method achieves significantly faster convergence and higher-quality solutions than both single-latent-space GBO and conventional BO under limited evaluation budgets.