FACTS Dose Escalation CRM

CRM / N-CRM / BLRM (Bayesian Logistic Regression Model)

1 Introduction

1.1 Purpose of this document

This document describes how use the FACTS Dose Escalation (DE) N-CRM design engine. It is intended for all end users of the system.

1.2 Scope of this document

This document covers the FACTS Dose Escalation N-CRM design engine user interface.

This document does not address the internal workings of the design engines or algorithms, which are addressed in the associated Design Engine Specification. It also does not address the use of FACTS Core Designs or Enrichment Designs, which are covered in other User Guides.

The screenshots provided are specific to a particular installation and may not reflect the exact layout of the information seen by any particular user. They were taken from FACTS 6.3 and later installed on Windows 10. Different versions of Windows or the use of different Windows themes will introduce some differences in appearance. The contents of each tab, however, will be consistent with the software.

1.3 Context of this Issue

This document has been updated for the version 7.1 release of Dose Escalation FACTS.

1.4 Citing FACTS

If writing in LaTex and using Bibtex, if you wish to cite FACTS (thank you!), can we suggest the following:

@techreport{FACTS71,
  author = {{FACTS Development Team}},
  title = {{FACTS}: Fixed and Adaptive Clinical Trial Simulator},
  year  = {2024},
  month = {11},
  number = {Version 7.1},
  type         = {Computer Software},
  institution = {Berry Consultants LLC},
  address = {Austin, TX},
  note   = {https://www.berryconsultants.com/software/facts/}
}

This will result in a reference that, for example in the APA style, will look like the following:

FACTS Development Team (2024). FACTS: Fixed and adaptive clinical trial simulator. Computer Software Version 7.1, Berry Consultants LLC, Austin, TX. https://www.berryconsultants.com/software/facts/.

1.5 Definition of Terms

Table 1 gives an overview of the acronyms and abbreviations used in this document.

Table 1: List of terms used in the CRM user guide
Name Definition
Cap A limit on the number of subjects recruited. In FACTS N-CRM users can specify a cap on the overall number of subjects to be recruited in the trial (the ‘Overall Cap’) and specify stopping rules to define when the trial should stop before it reaches cap.
Control Is the treatment arm with which the novel treatment(s) are principally being compared. Control may be placebo, or some existing standard of care, or therapy, against which the novel treatment has to be benchmarked in order to determine its likely usefulness.
Core FACTS Core: A mode of FACTS for designing trials where multiple treatments, (possibly different doses of a novel treatment) are tested against a control and optionally an active comparator.
CRM Continual Reassessment Method – a dose escalation design where the dose-toxicity is estimated using a simple Bayesian model, and the resulting estimates used to control the dose escalation and estimate the Maximum Tolerated Dose (MTD).
DE Dose Escalation: a mode of FACTS where subjects are treated in cohorts and dose escalation is determined by the number of toxicities observed.
ED Enrichment Designs: a mode of FACTS for designing trials where the same treatment is testing in different settings for example different sub-populations or different but related indications.
FACTS Fixed and Adaptive Clinical Trial Simulator.
Final Endpoint The final value, or state, of a subject’s endpoint.
GUI Graphical User Interface, the part of the FACTS application that the user interacts with.
Method In the FACTS documentation we try to reserve the term ‘method’ for the algorithms used in the simulation (as opposed to the analysis) part of the program. In the analysis part we use the term ‘Model’, see below.
Model In the FACTS documentation we try to reserve the term ‘model’ for the statistical models used in the analysis of the trial data (in the ‘design’ section of the FACTS user interface). Where mathematical algorithms are used for other purposes in FACTS (for instance in the generation of the simulated data) we try to use the term ‘method’. We have found that initially it is very easy for users to be confused between these two parts of FACTS and we feel that using distinct terminology may help to reduce this.
MTD The dose most likely to be the Maximum Tolerated Dose (MTD) – the dose with the highest Pr(MTD).
MTD+ The dose most likely to be the MTD+ – the dose with the highest Pr(MTD+).
Pr(MTD) A dose’s probability of being MTD is the probability that it is the dose with the highest probability of having a toxicity rate in the acceptable toxicity band, and (if a threshold has been specified) does not have a probability of excess or unacceptable toxicity above the threshold. This estimate of MTD is constrained to select one of the available doses.
Pr(MTD+) A dose’s probability of being the MTD+ is the probability that it is the dose with the highest probability of having a toxicity rate in the acceptable band, and (if a threshold has been specified) does not have a probability of excess or unacceptable toxicity above the threshold. Unlike Pr(MTD), Pr(MTD+) includes estimating whether a dose below or a dose above the range of those being tested is more likely to have a toxicity in the acceptable band than any of the doses in the range.
Profile A profile is a specification of one aspect of a scenario. A scenario is made up of one profile of each of the required types for the type of trial being simulated. FACTS allows the user to specify multiple profiles of each type and then presents all the possible combinations of profiles as scenarios that can be used to drive simulations.
Response The change in a subject’s endpoint compared to their baseline state.
Scenario A scenario is the complete specification of the unknown external factors that determine the data observed on the trial and its timing. The exact factors depend on the type of trial being simulated but typically include:
-) the distribution of the final change from base line, or probability of response or rate of events in the different treatment groups
-) the properties of subjects’ early responses and the correlation with their final outcome
-) the rate at which subjects are recruited into the trial
-) the rate at which subjects drop out of the trial.
SPEC The Design Engine Specification, describes the system algorithms, and meaning of parameters.
Response The change in a subject’s endpoint compared to their baseline state.
Subject Someone recruited onto a clinical trial for the purposes of learning about the properties of a treatment. Depending on the type of trial they might be patients or they might be healthy volunteers.
Treatment Arm Subjects on entering the study are randomized to different ‘treatment arms’. Subjects randomized to the same arm receive the same treatment and the responses of the subjects in the arm analyzed to determine the expected response to that treatment, allowing the expected responses to the different treatments to be compared.
UG The User Guide; describes how to use the system.

1.6 References

[N-CRM] = (Neuenschwander, Branson, and Gsponer 2008)

[Backfill] = (Dehbi, O’Quigley, and Iasonos 2021)

[Open Enrollment] = (Broglio et al. 2015)

[CRM 2 Sample] = (O’Quigley, Shen, and Gamst 1999)

[bCRM] = (Braun 2002)

[CRM Ordinal] = (deMoor et al. 1996)

1.7 Testing Quarto

See the following example

See Figure 1 for a trial run.

Figure 1: Overview of Test

References

Braun, Thomas M. 2002. “The Bivariate Continual Reassessment Method: Extending the CRM to Phase i Trials of Two Competing Outcomes.” Controlled Clinical Trials 23 (3): 240–56.
Broglio, Kristine R, Larissa Sandalic, Tina Albertson, and Scott M Berry. 2015. “Bayesian Dose Escalation in Oncology with Sharing of Information Between Patient Populations.” Contemporary Clinical Trials 44: 56–63.
Dehbi, Hakim-Moulay, John O’Quigley, and Alexia Iasonos. 2021. “Controlled Backfill in Oncology Dose-Finding Trials.” Contemporary Clinical Trials 111: 106605.
deMoor, CA, DM Higdon, SG Hilsenbeck, GM Clark, and DD von Ho. 1996. “Incorporating Toxicity Grade Information in the Continual Reassessment Method.”
Neuenschwander, Beat, Michael Branson, and Thomas Gsponer. 2008. “Critical Aspects of the Bayesian Approach to Phase i Cancer Trials.” Statistics in Medicine 27 (13): 2420–39.
O’Quigley, John, Larry Z Shen, and Anthony Gamst. 1999. “Two-Sample Continual Reassessment Method.” Journal of Biopharmaceutical Statistics 9 (1): 17–44.