In our article "Pattern-mixture model in network meta-analysis of binary missing outcome data: one-stage or two-stage approach?" we compare the exact likelihood (one-stage approach) with the approximate normal likelihood (two-stage approach) for the synthesis of trials on a binary outcome in the presence of missing outcome data (MOD). Inititally, we perform an empirical study that includes 29 networks of interventions from several health-fields. Then, we complement the empirical results with a simulation study on a triangle network.
You can download the package with the developed functions directly from GitHub or use the R package devtools:
install.packages("devtools")
devtools::install_github("LoukiaSpin/One-stage-vs-two-stage-PM-models", build_vignettes = T)
The dataset with all 29 analysed networks can be found in the namesake folder in two formats:
- the .txt file with the dataset being in the wide format, where each trial occupies one line and as many columns for each extracted information (number of observed events, MOD, and randomised participants) as the number of investigated interventions (i.e. arm-based data);
- the .RData files with the dataset being prepared as a list of networks. We have prepared the dataset to be specific to the analysis approach:
- a wide format for the one-stage approach (One-stage model_NMA Dataset.RData) as explained in the first point.
- a long format for the two-stage approach (Two-stage model_NMA Dataset.RData) where each trial occupies as many lines as the number of possible comparisons and the analysed information comprises the corresponsing log odds ratios (OR) and their standard errors obtained by applying the pattern-mixture (PM) model upfront (i.e. contrast-based data).
The code to perform the empirical analysis for the one-stage and two-stage approaches can be found in the folder R scripts/Empirical study. The analysis is performed separately for each approach to obtain the results for the necessary parameters as a .txt file:
- use the R script Full RE-NMA Consistency_One-stage model.R for the one-stage approach to perform a Bayesian random-effects network meta-analysis (NMA) with consistency equations and accommodation of multi-arm trials based on the code of Dias et al. [1] (Example 1(c) in the Appendix, there) for arm-based data that we extended to incorporate the PM model for binary data (Spineli et al. [2]).
- use the R script Full RE-NMA Consistency_Two-stage model.R for the two-stage approach to perform a Bayesian random-effects NMA with consistency equations and accommodation of multi-arm trials based on the code of Dias et al. [1] (Example 7(a) in the Appendix, there) for contrast-based data.
Both R scripts load the .txt file Empirical prior distributions for between-trial variance that is located in the folder Dataset. This file includes the parameters mean and standard deviation (as well as the median and third quartile) of the log-normal distribution for τ2 that is specific to the intervention-comparison type and outcome type as investigated in each network. We referred to Turner et al. [3] to select the proper empirically-based distribution for each network.
Furthermore, both R scripts 'call' the corresponding models (in .txt format) from the folder Model scripts to perform the NMA.
The folder Output/Empirical study includes the posterior results in .txt files for the following model parameters per approach:
- the NMA log OR for comparisons with the reference intervention of each network (LOR_One-stage_Results.txt, and LOR_Two-stage_Results.txt),
- the within-trial log ORs (theta_One-stage_Results.txt, and theta_Two-stage_Results.txt), and
- the τ2, one for each network (tausq_One-stage_Results.txt, and tausq_Two-stage_Results.txt).
At the end of the R scripts mentioned above, we have added the necessary code to obtain and save these results as .txt straightforwardly.
- Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence synthesis for decision making 2: a generalized linear modeling framework for pairwise and network meta-analysis of randomized controlled trials. Med Decis Mak. 2013;33(5):607–17.
- Spineli LM. An empirical comparison of Bayesian modelling strategies for missing binary outcome data in network meta-analysis. BMC Med Res Methodol. 2019; 19(1):86.
- Turner RM, Jackson D, Wei Y, Thompson SG, Higgins JP. Predictive distributions for between-study heterogeneity and simple methods for their application in Bayesian meta-analysis. Stat Med. 2015; 34(6):984–98.
The code to generate the 1,000 triangle networks of two-arm trials is provided as .R file Generate triangles_Simulation part A in the folder R scripts/Simulation study. Alternatively, you can use directly the .RData file 1000 simulated two-arm networks with the generated triangles to proceed with the analysis.
For the analysis of the generated triangles, we provide the code as .R file Analyse generated triangles_Simulation part B in the folder R scripts/Simulation study. This R script 'calls' the .txt files Full RE-NMA One-stage IMOR Pattern-mixture model and Full RE-NMA Two-stage IMOR Pattern-mixture model_Two-arm trials to perform NMA under the one-stage and two-stages approaches, respectively.
This is the third simulation study on MOD in NMA following two previous relevant studies [1,2].
- Spineli LM, Kalyvas C, Pateras K. Participants’ outcomes gone missing within a network of interventions: Bayesian modeling strategies. Stat Med. 2019;38(20):3861–79.
- Spineli LM, Kalyvas C. Comparison of exclusion, imputation and modelling of missing binary outcome data in frequentist network meta-analysis. BMC Med Res Methodol. 2020;20(1):48,