Assessing the Impact of Model Assumptions in Network Meta-Regression: A Simulation Study

2026-07-20

AI Summary

This study addresses the lack of clear guidance in selecting network meta-regression (NMR) models, where misspecification can induce bias in treatment effect estimates. Through 120 simulated evidence network scenarios, it systematically compares standard network meta-analysis with four NMR variants—differing by common or independent, and consistency or inconsistency interaction terms—across varying levels of heterogeneity, network density, and multi-arm trial structures. The work reveals, for the first time, how specific network characteristics influence NMR bias and confidence interval coverage, demonstrating that omitting effect modification leads to overestimation of treatment effects. Independent-interaction NMR performs robustly in dense networks, whereas consistency-interaction models are better suited for networks containing multi-arm studies. The study advocates aligning model assumptions with underlying network features to ensure reliable evidence synthesis for informed decision-making.

Abstract

Network meta-regression (NMR) extends network meta-analysis (NMA) by synthesizing evidence on multiple treatments while adjusting for potential effect modifiers. By accounting for effect modification, NMR can reduce between-study heterogeneity and improve the validity of relative treatment effects, providing insight regarding characteristics impacting treatment performance. However, choosing between available NMR models is complex, as each model addresses a similar, but unique research question, and the performance of available NMR models under varying network structures, between-study heterogeneity, and interaction assumptions remains unclear. We evaluated the consequences of model misspecification in a simulation study of 120 evidence-network scenarios designed to reflect potential complications in evidence networks introduced by trial design, heterogeneity levels, and interaction assumptions. We compared the standard interaction-free NMA model with four NMR parameterizations differing in across-comparison interaction assumptions (common vs. independent interactions) and interaction consistency assumptions (with or without consistency). Standard NMA models generally overestimated treatment effects when effect modification was present. NMR models with independent across-comparison interactions maintained appropriate confidence interval coverage in dense networks generated with their corresponding consistency assumptions. However, their coverage deteriorated in sparse networks with between-study heterogeneity. Models assuming consistent interactions are advantageous in networks with multi-arm studies. Ignoring effect modification in NMA can lead to biased treatment effect estimates. When effect modification is anticipated, thoughtful alignment between network structure and NMR assumptions can reduce bias and misleading precision, supporting more reliable medical decision making.

Problem

• network meta-regression
• model assumptions
• effect modification
• heterogeneity
• interaction consistency

Innovation

• network meta-regression
• effect modification
• model misspecification
• interaction consistency
• simulation study