frag.nma: Assessing the Fragility of a Network Meta-Analysis With a Binary Outcome

Description

Produces results, such as fragility index, fragility quotient, and event status modifications for altering statistical significance, of treatment comparison(s) in a network meta-analysis with a binary outcome.

Usage

frag.nma(sid, tid, e, n, data, measure = "OR", random = TRUE, alpha = 0.05,
         mod.dir = "both", tid1.f, tid2.f, OR = 1, RR = 1, RD = 0,
         incr, allincr, addincr, allstudies, ...)

Value

An object of class "frag.nma". The object is a list containing the following components:

data: original data of the network meta-analysis.
measure: measure of treatment effect (i.e., effect size).
alpha: pre-specified statistical significance level.
null: value of odds ratio, relative risk, or risk difference (specified by measure) under the null hypothesis. Note that odds ratio and relative risk are presented on a natural logarithmic scale in all output values.
est.ori: a matrix containing the point estimate of the overall effect size for each pair of treatment comparisons based on the original network meta-analysis. Each element presents the treatment corresponding to the row compared with the treatment corresponding to the column; a similar interpretation applies to other outputs in the form of a matrix.
ci.lb.ori: the lower bound of the confidence interval of the overall effect size for each pair of treatment comparisons based on the original network meta-analysis.
ci.lb.ori: the upper bound of the confidence interval of the overall effect size for each pair of treatment comparisons based on the original network meta-analysis.
pval.ori: the p-value of the overall effect size for each pair of treatment comparisons based on the original network meta-analysis.
mod.dir: the direction of the confidence interval change due to event status modifications when the original confidence interval covers the null value (i.e., non-significance altered to significance).
tid.f: treatment comparisons whose fragility is assessed.
FI: fragility index.
FQ: fragility quotient, calculated as fragility index divided by the total sample size associated with the specific treatment comparison.
FQ.nma: fragility quotient, calculated as fragility index divided by the total sample size in the whole network meta-analysis (across all treatment groups).
dir: direction of the change of statistical significance.
sid.iter: a list of study index(es) with event status modifications during the iterative algorithm for specific pairs of treatment comparisons.
tid1.mod.iter: a list of event status modification(s) in the first treatment group during the iterative algorithm for specific pairs of treatment comparisons.
tid2.mod.iter: a list of event status modification(s) in the second treatment group during the iterative algorithm for specific pairs of treatment comparisons.
est.iter: a list of point estimate(s) of the overall effect size during the iterative algorithm for specific pairs of treatment comparisons.
ci.lb.iter: a list of lower bound(s) of confidence interval(s) of the overall effect size during the iterative algorithm for specific pairs of treatment comparisons.
ci.ub.iter: a list of upper bound(s) of confidence interval(s) of the overall effect size during the iterative algorithm for specific pairs of treatment comparisons.
data.mod: a list of data with event status modification(s) that alter the significance or non-significance for specific pairs of treatment comparisons.

Arguments

sid: a numeric vector or the corresponding column name in the argument data, indicating the study IDs in the network meta-analysis.
tid: a numeric vector or the corresponding column name in the argument data, indicating the treatment IDs in the network meta-analysis.
e: a numeric vector or the corresponding column name in the argument data, indicating the event count in each study's each treatment group in the network meta-analysis.
n: a numeric vector or the corresponding column name in the argument data, indicating the sample size in each study's each treatment group in the network meta-analysis.
data: an optional data frame containing the dataset of the collected studies on multiple treatment comparisons in the network meta-analysis with a binary outcome. If data is specified, the previous arguments, sid, tid, e, and n, should be specified as their corresponding column names in data.
measure: a character string indicating the measure of treatment effect (i.e., effect size) for the binary outcome. It should be one of "OR" (odds ratio, the default), "RR" (relative risk), and "RD" (risk difference).
random: a logical value indicating whether the network meta-analysis is performed under the fixed-effects setting (FALSE) or the random-effects setting (TRUE, the default).
alpha: a numeric value between 0 and 1, indicating the statistical significance level (the default is 0.05). It determines the confidence level \((1-\alpha)\times100\%\) of the confidence interval when deriving the fragility index/quotient.
mod.dir: a character string or a square matrix of character strings indicating the direction of the confidence interval change for each treatment comparison due to event status modifications when the original confidence interval covers the null value (i.e., non-significance altered to significance). It is not used when significance is altered to non-significance. It should be one of "left" (moving to the left side of the null value), "right" (moving to the right side of the null value), "one" (based on the direction of the point estimate of the original overall effect size), and "both" (both directions, the default). When it is specified as a matrix, the dimension should be the number of treatments, and the element (h, k) specifies the direction for treatment h compared with treatment k.
tid1.f: the first treatment(s) of comparison(s) of interest; if not specified, the fragility of all comparisons will be assessed.
tid2.f: the second treatment(s) of comparison(s) of interest.
OR: a numeric positive value indicating the value of odds ratio under the null hypothesis (the default is 1). It is used only if the argument measure is "OR".
RR: a numeric positive value indicating the value of relative risk under the null hypothesis (the default is 1). It is used only if the argument measure is "RR".
RD: a numeric value between \(-\)1 indicating the value of risk difference under the null hypothesis (the default is 0). It is used only if the argument measure is "RD".
incr: A numerical value that is added to each cell frequency for studies with a zero cell count. It is passed to the function pairwise in the package meta.
allincr: A logical value indicating whether incr is added to each cell frequency of all studies if at least one study has a zero cell count. If FALSE (the default), incr is added only to each cell frequency of studies with a zero cell count. It is passed to the function pairwise in the package meta.
addincr: A logical value indicating whether incr is added to each cell frequency of all studies irrespective of zero cell counts (the default is FALSE). It is passed to the function pairwise in the package meta.
allstudies: A logical value indicating whether studies with zero or all events in two treatment groups are to be included in the network meta-analysis (the default is FALSE). It is used only for measure = "OR" and "RR". It is passed to the function pairwise in the package meta.
...: other arguments that can be passed to netmeta. See details in the manual of the package netmeta.

References

Schwarzer G, Carpenter JR, Rucker G (2015). Meta-Analysis with R. Cham, Switzerland: Springer. <tools:::Rd_expr_doi("10.1007/978-3-319-21416-0")>

Lin L, Chu H (2022). "Assessing and visualizing fragility of clinical results with binary outcomes in R using the fragility package." PLOS ONE, 17(6), e0268754. <tools:::Rd_expr_doi("10.1371/journal.pone.0268754")>

Lin L, Xing A, Chu H, Murad MH, Xu C, Baer BR, Wells MT, Sanchez-Ramos L (2023). "Assessing the robustness of results from clinical trials and meta-analyses with the fragility index." American Journal of Obstetrics and Gynecology, 228(3), 276--282. <tools:::Rd_expr_doi("10.1016/j.ajog.2022.08.053")>

Xing A, Chu H, Lin L (2020). "Fragility index of network meta-analysis with application to smoking cessation data." Journal of Clinical Epidemiology, 127, 29--39. <tools:::Rd_expr_doi("10.1016/j.jclinepi.2020.07.003")>

Examples

Run this code

# \donttest{
## Load datasets of network meta-analysis of
##  chronic obstructive pulmonary disease (COPD)
data(dat.copd)

## Assess fragility of network meta-analysis of COPD
out1 <- frag.nma(sid, tid, e, n, data = dat.copd)
out1

## Retrieve the estimated log odds ratio in the original dataset
out1$est.ori
## Retrieve the fragility index of each treatment comparison
out1$FI
## Retrieve the direction of significance change for comparison 2 vs. 3
out1$dir["2", "3"]
## Retrieve the study IDs with iterative event status modifications
##  for comparison 2 vs. 3
out1$sid.iter[["2 vs. 3"]]
## Retrieve the event status modifications
##  in the first group (i.e., treatment 2)
out1$tid1.mod.iter[["2 vs. 3"]]
## Retrieve the event status modifications
##  in the second group (i.e., treatment 3)
out1$tid2.mod.iter[["2 vs. 3"]]

## Visualize the process of event status modifications
##  for altering the non-significance to significance for each comparison;
##  see more options of usage in examples of frag.ma()
plot(out1, tid1 = 2, tid2 = 1)
plot(out1, tid1 = 3, tid2 = 1)
plot(out1, tid1 = 4, tid2 = 1)
plot(out1, tid1 = 3, tid2 = 2)
plot(out1, tid1 = 4, tid2 = 2)
plot(out1, tid1 = 4, tid2 = 3)

## Assess fragility of treatment comparisons 2 vs. 1 and 3 vs. 1 only
out2 <- frag.nma(sid, tid, e, n, data = dat.copd,
  tid1.f = c(2, 3), tid2.f = c(1, 1))
out2

## The default plot presents the process of event status modification
##  for the first comparison, i.e., 2 vs. 1
plot(out2)

## Load datasets of network meta-analysis of smoking cessation
data(dat.sc)

## Assess fragility of network meta-analysis of smoking cessation
out3 <- frag.nma(sid, tid, e, n, data = dat.sc)
out3

## Visualize the process of event status modifications
plot(out3, tid1 = 2, tid2 = 1, ybreaks = c(170, 595),
  x.legend = "topright")
plot(out3, tid1 = 3, tid2 = 1, ybreaks = c(635, 1200),
  x.legend = "bottomright")
plot(out3, tid1 = 4, tid2 = 1, ybreaks = c(105, 600))
plot(out3, tid1 = 3, tid2 = 2, ybreaks = c(160, 1205))
plot(out3, tid1 = 4, tid2 = 2, ybreaks = c(110, 140),
  x.legend = "topright")
plot(out3, tid1 = 4, tid2 = 3, ybreaks = c(130, 1205),
  x.legend = "bottomright")
# }