Class effect NMA analysis using MBNMAdose

Although MBNMAdose is intended to be used for dose-response Model-Based Network Meta-Analysis (MBNMA), it can also be adapted to perform standard Network Meta-Analysis (NMA), and this allows users to take advantage of some of the additional features of MBNMAdose, such as modelling class effects, for use in standard NMA. As well as fitting class effect models, MBNMAdose also allows for nodes-splitting to check for consistency in these models.

To illustrate how this can be done we will use a dataset of inhaled medications for Chronic Obstructive Pulmonary Disease (COPD) from the netmeta package:

library(netmeta)
#> Loading required package: meta
#> Loading required package: metadat
#> Loading 'meta' package (version 7.0-0).
#> Type 'help(meta)' for a brief overview.
#> Readers of 'Meta-Analysis with R (Use R!)' should install
#> older version of 'meta' package: https://tinyurl.com/dt4y5drs
#> Loading 'netmeta' package (version 2.9-0).
#> Type 'help("netmeta-package")' for a brief overview.
#> Readers of 'Meta-Analysis with R (Use R!)' should install
#> older version of 'netmeta' package: https://tinyurl.com/kyz6wjbb
data("Dong2013")

# Rename column names to match those used in MBNMAdose
Dong2013 <- Dong2013 %>%
    rename(studyID = id, r = death, n = randomized)

Performing standard NMA using mbnma.run()

The simplest use is in a network that includes a placebo treatment. In this dataset we do not have any dose-response information, so there is no value in performing a MBNMA. However, if we assume that every active treatment in the network is a separate “agent” with a dose of 1, and that the Placebo treatment has a dose of 0, then we can use the data in MBNMAdose, and by modelling a linear dose-response function we estimate parameters that are identical to a standard NMA model.

# Define agents and assign a dose of 1 to all agents
Dong2013 <- Dong2013 %>%
    dplyr::rename(agent = treatment) %>%
    dplyr::mutate(dose = dplyr::case_when(agent == "Placebo" ~ 0, agent != "Placebo" ~
        1))

Note that if there is an intervention within the dataset that has been administered at multiple doses, you can force the dataset to be analysed either as a “split” network (in which different doses are assumed to have independent effects) by assigning each of them a separate agent name (e.g. “warfarinlow”, “warfarinhigh”), or as a “lumped” network (in which different doses are assumed to have the same effect) by simply assigning both doses a dose of 1. Further details of “lumping” and “splitting” and the implications of these assumptions can be found in [@pedder2021cons].

Once we have reassigned the doses within the dataset we can create an "mbnma.network" object and create a network plot:

network <- mbnma.network(Dong2013)
summary(network)
#> Description: Network 
#> Number of studies: 41 
#> Number of treatments: 6 
#> Number of agents: 6 
#> Median (min, max) doses per agent (incl placebo): 2 (2, 2)
#> Agent-level network is CONNECTED
#> Ttreatment-level network is CONNECTED
plot(network)

We can then use a linear dose-response MBNMA to analyse the data. The coefficients for the linear slope of the dose-response function are mathematically equivalent to the basic treatment effect parameters estimated in a standard NMA. Note that the results are equivalent in both models (allowing for Monte-Carlo error from the MCMC sampling). The only difference is that the placebo parameter (beta.1[1]) that is equal to zero is not given in the output.

nma.linear <- mbnma.run(network, fun = dpoly(degree = 1), n.iter = 50000)
#> `likelihood` not given by user - set to `binomial` based on data provided
#> `link` not given by user - set to `logit` based on assigned value for `likelihood`
print(nma.linear)
#> Inference for Bugs model at "C:\Users\hp17602\AppData\Local\Temp\Rtmpesrqof\file80a476113ab2", fit using jags,
#>  3 chains, each with 50000 iterations (first 25000 discarded), n.thin = 25
#>  n.sims = 3000 iterations saved. Running time = 15.6 secs
#>           mu.vect sd.vect    2.5%     25%     50%     75%   97.5%  Rhat n.eff
#> beta.1[2]   0.029   0.080  -0.132  -0.027   0.029   0.082   0.189 1.001  2200
#> beta.1[3]  -0.073   0.080  -0.231  -0.127  -0.072  -0.019   0.090 1.001  3000
#> beta.1[4]  -0.228   0.087  -0.404  -0.289  -0.227  -0.168  -0.060 1.002  1200
#> beta.1[5]  -0.086   0.064  -0.210  -0.129  -0.086  -0.042   0.041 1.001  3000
#> beta.1[6]   0.420   0.189   0.054   0.292   0.418   0.546   0.791 1.003   710
#> totresdev 108.633   9.716  91.466 101.809 108.031 114.793 129.373 1.001  3000
#> deviance  414.333   9.716 397.166 407.508 413.730 420.493 435.072 1.001  3000
#> 
#> For each parameter, n.eff is a crude measure of effective sample size,
#> and Rhat is the potential scale reduction factor (at convergence, Rhat=1).
#> 
#> DIC info (using the rule: pV = var(deviance)/2)
#> pV = 47.2 and DIC = 461.5
#> DIC info (using the rule: pD = Dbar-Dhat, computed via 'rjags::dic.samples')
#> pD = 42.6 and DIC = 452.7
#> DIC is an estimate of expected predictive error (lower deviance is better).
nma <- nma.run(network, n.iter = 50000)
print(nma)
#> $jagsresult
#> Inference for Bugs model at "C:\Users\hp17602\AppData\Local\Temp\Rtmpesrqof\file80a4608d56a4", fit using jags,
#>  3 chains, each with 50000 iterations (first 25000 discarded), n.thin = 25
#>  n.sims = 3000 iterations saved. Running time = 14.15 secs
#>           mu.vect sd.vect    2.5%     25%     50%     75%   97.5%  Rhat n.eff
#> d[1]        0.000   0.000   0.000   0.000   0.000   0.000   0.000 1.000     1
#> d[2]        0.032   0.085  -0.128  -0.025   0.029   0.089   0.207 1.001  2300
#> d[3]       -0.076   0.081  -0.241  -0.132  -0.074  -0.021   0.077 1.002  1300
#> d[4]       -0.227   0.089  -0.406  -0.286  -0.226  -0.166  -0.052 1.001  3000
#> d[5]       -0.085   0.065  -0.215  -0.129  -0.085  -0.042   0.040 1.002  1900
#> d[6]        0.424   0.186   0.070   0.293   0.421   0.549   0.796 1.003   680
#> totresdev 108.727   9.271  92.089 102.109 108.087 114.702 128.209 1.003   960
#> deviance  414.426   9.271 397.788 407.808 413.786 420.402 433.908 1.003   970
#> 
#> For each parameter, n.eff is a crude measure of effective sample size,
#> and Rhat is the potential scale reduction factor (at convergence, Rhat=1).
#> 
#> DIC info (using the rule: pV = var(deviance)/2)
#> pV = 42.9 and DIC = 457.3
#> DIC is an estimate of expected predictive error (lower deviance is better).
#> 
#> $trt.labs
#> [1] "Placebo_0"  "ICS_1"      "LABA_1"     "LABA-ICS_1" "TIO-HH_1"  
#> [6] "TIO-SMI_1" 
#> 
#> $UME
#> [1] FALSE
#> 
#> attr(,"class")
#> [1] "nma"

We can also show the equivalence of results using get.relative() to compare relative effects from both models:

rels <- get.relative(nma.linear, nma)

Without a placebo, estimation is very similar, but requires renaming and recoding the network reference intervention to "Placebo". This is not strictly necessary, as MBNMAdose can handle dose-response datasets that do not include placebo (or dose=0), but it will ensure that parameter estimates are equivalent between the NMA and MBNMA models and will make it easier to estimate relative effects. We illustrate this with the Surgical Site Infection dataset.

# Ensure that Suture-absorbable is the network reference
ssi <- ssi_closure %>%
    dplyr::mutate(agent = factor(trt, levels = c("Suture-absorbable", unique(ssi_closure$trt)[-1])))

# Set dose=0 for network reference and dose=1 for all other interventions
ssi.plac <- ssi %>%
    dplyr::mutate(dose = dplyr::case_when(trt == "Suture-absorbable" ~ 0, TRUE ~
        1))

network.plac <- mbnma.network(ssi.plac)
#> Values for `agent` with dose = 0 have been recoded to `Placebo`
#> agent is being recoded to enforce sequential numbering
#> Values for `class` with dose = 0 have been recoded to `Placebo`
#> class is being recoded to enforce sequential numbering
plot(network.plac)

# Note that Suture-absorbable (the comparator) has been renamed to Placebo
# Run linear MBNMA model
nma.linear <- mbnma.run(network.plac, fun = dpoly(degree = 1), n.iter = 50000)
#> `likelihood` not given by user - set to `binomial` based on data provided
#> `link` not given by user - set to `logit` based on assigned value for `likelihood`
summary(nma.linear)
#> ========================================
#> Dose-response MBNMA
#> ========================================
#> 
#> Likelihood: binomial
#> Link function: logit
#> Dose-response function: poly
#> 
#> Pooling method
#> 
#> Method: Common (fixed) effects estimated for relative effects
#> 
#> 
#> beta.1 dose-response parameter results
#> 
#> Pooling: relative effects for each agent
#> 
#> |Agent                               |Parameter  |  Median|    2.5%|   97.5%|
#> |:-----------------------------------|:----------|-------:|-------:|-------:|
#> |Clips                               |beta.1[2]  | -0.0897| -1.0106|  0.8472|
#> |Suture--monofilament                |beta.1[3]  |  0.0564| -0.7438|  0.8392|
#> |Staples                             |beta.1[4]  |  0.0526| -0.5286|  0.6030|
#> |Suture                              |beta.1[5]  | -0.0749| -0.7478|  0.6221|
#> |Tissue adhesive gel-low viscosity   |beta.1[6]  |  0.6615| -0.0958|  1.4315|
#> |Tape/film                           |beta.1[7]  | -0.3057| -1.0657|  0.3778|
#> |Preference of physician             |beta.1[8]  | -0.2003| -1.4668|  0.9640|
#> |Tissue adhesive gel-high viscosity  |beta.1[9]  | -0.1385| -1.7647|  1.3853|
#> |Suture-non-absorbable               |beta.1[10] | -0.1064| -0.3807|  0.1885|
#> |Suture-antimicrobial                |beta.1[11] | -0.2714| -0.4243| -0.1233|
#> |Suture-non-absorbable-monofilament  |beta.1[12] | -0.6434| -1.2638|  0.0032|
#> |Suture-absorbable-monofilament      |beta.1[13] | -0.5056| -1.1449|  0.1482|
#> |Tissue adhesive gel                 |beta.1[14] |  0.9037| -1.6935|  4.3848|
#> |Suture-absorbable-multifilament     |beta.1[15] | -0.7567| -1.3942| -0.0916|
#> |Suture-non-absorbable-multifilament |beta.1[16] | -1.0396| -1.9468| -0.1330|
#> 
#> 
#> Model Fit Statistics
#> Deviance = 1017.6
#> Residual deviance = 288.7
#> Deviance Information Criterion (DIC) = 1142.7

The linear dose-response coefficients can then be interpreted as the relative effect for each intervention versus the network reference ("Suture-absorbable").

Benefits of using mbnma.run() for standard NMA models

Now that we have shown how to specify a standard NMA model within the MBNMA framework in mbnma.run(), we can now use MBNMAdose to implement some more interesting models, such as class effect models and node-splits to assess consistency.

A class effects model can be implemented using the class.effect argument in mbnma.run(), introducing either a "common" or 2 class effect on the single linear dose-response parameter, beta.1:

# Random class effect model
nma.class <- mbnma.run(network.plac, fun = dpoly(degree = 1), class.effect = list(beta.1 = "random"),
    n.iter = 50000)

A "common" class effect assumes that all treatments within a class have the same effect, whilst a "random" class effect assumes that treatment-level effects are randomly distributed around a mean class effect with a standard deviation (SD) that is estimated within the model.

Common and random class effect models can be compared using model fit statistics (e.g. Deviance Information Criterion) to identify which is the most parsimonious model. Note that within MBNMAdose when a random class effect is fitted this makes the assumption that all classes share the same within-class SD. This may not necessarily be valid, but relaxing this cannot currently be done in MBNMAdose and it requires specific JAGS code to be written.