Alternative Mixed Integer Linear Programming Optimization for Joint Job Scheduling and Data Allocation in Grid Computing

📅 2025-02-01
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
Joint optimization of task scheduling and data placement in grid computing remains challenging due to their strong interdependence. Method: This paper proposes a unified optimization framework formulated as a Mixed-Integer Quadratically Constrained Program (MIQCP). We design the first Alternating Optimization–based Mixed-Integer Linear Programming (MILP) solution framework: variables are alternately fixed, non-linear constraints are linearized, and commercial solvers (Gurobi/CPLEX) are iteratively invoked. Unlike conventional heuristic approaches, our method guarantees global optimality and exhibits strong robustness. Contribution/Results: Experiments demonstrate that our approach significantly outperforms existing independent or joint heuristic methods in computational efficiency, resource utilization, and scalability to large-scale grid environments. Moreover, it shows low sensitivity to hyperparameter perturbations, confirming its practical reliability and generalizability.

Technology Category

Application Category

📝 Abstract
This paper presents a novel approach to the joint optimization of job scheduling and data allocation in grid computing environments. We formulate this joint optimization problem as a mixed integer quadratically constrained program. To tackle the nonlinearity in the constraint, we alternatively fix a subset of decision variables and optimize the remaining ones via Mixed Integer Linear Programming (MILP). We solve the MILP problem at each iteration via an off-the-shelf MILP solver. Our experimental results show that our method significantly outperforms existing heuristic methods, employing either independent optimization or joint optimization strategies. We have also verified the generalization ability of our method over grid environments with various sizes and its high robustness to the algorithm hyper-parameters.
Problem

Research questions and friction points this paper is trying to address.

Grid Computing
Task Scheduling
Data Allocation
Innovation

Methods, ideas, or system contributions that make the work stand out.

Mixed-Integer Quadratically Constrained Programming
Decomposition Strategy for MILP
Simultaneous Task Scheduling and Data Allocation
🔎 Similar Papers
No similar papers found.
Shengyu Feng
Shengyu Feng
Carnegie Mellon University
Combinatorial OptimizationLanguage Models
J
Jaehyung Kim
Yonsei University, Seoul, South Korea
Y
Yiming Yang
Carnegie Mellon University, Pittsburgh, PA, USA
J
Joseph Boudreau
University of Pittsburgh, Pittsburgh, PA, USA
Tasnuva Chowdhury
Tasnuva Chowdhury
The European Organization for Nuclear Research (CERN), Geneva and Brookhaven National Laboratory
Particle Physics
Adolfy Hoisie
Adolfy Hoisie
Department Chair, Brookaven National Laboratory
Computer sciencecomputer architecturemodeling and simulation
R
Raees Khan
University of Pittsburgh, Pittsburgh, PA, USA
O
Ozgur O. Kilic
Brookhaven National Laboratory, Upton, NY, USA
S
S. Klasky
Oak Ridge National Laboratory, Oak Ridge, TN, USA
T
T. Korchuganova
University of Pittsburgh, Pittsburgh, PA, USA
P
P. Nilsson
CERN
V
V. M. Outschoorn
CERN
D
David K. Park
Brookhaven National Laboratory, Upton, NY, USA
N
N. Podhorszki
Oak Ridge National Laboratory, Oak Ridge, TN, USA
Yihui Ren
Yihui Ren
Brookhaven National Laboratory
artificial intellegencephysicsnetwork sciencecomputer science
Frédéric Suter
Frédéric Suter
Oak Ridge National Laboratory, IEEE Senior member
Computer ScienceWorkflowSchedulingSimulation
Sairam Sri Vatsavai
Sairam Sri Vatsavai
Research Associate, Brookhaven National Lab
AI Accelerator ModellingSilicon PhotonicsReservoir ComputingPhotonic Network on Chip
W
Wei Yang
SLAC National Accelerator Laboratory, Menlo Park, CA, USA
Shinjae Yoo
Shinjae Yoo
Brookhaven National Lab
Machine Learning
T
T. Maeno
CERN
A
A. Klimentov
Brookhaven National Laboratory, Upton, NY, USA