Discussion: View Thread

  • 1.  carry-over effects in cross-over trials

    Posted 03-06-2024 13:19

    Hello all,

    I was asked to help with a revision of an analysis of a small cross-over trial (2 arms 2 periods). I don't have much experience with these, and I'm having a hard time explaining to them why carry-over effects are important and cannot be dismissed. Does anyone have any tips or resources that explain these concepts to a less statistical audience? Since I'm looking into learning these concepts myself, I'm not providing more information on the trial itself, but please let me know if I should.

    Thank you,

    Maria



    ------------------------------
    Maria E. Montez Rath, PhD
    Stanford University
    Chair Membership Outreach & Diversity Committee (2023-)
    Member-At-Large 2024-2026
    ASA Statistical Consulting Section
    ------------------------------


  • 2.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 14:00

    Hi Maria,

    I don't know if this is a helpful analogy, but carry over is like having a latte, not rinsing the cup and then using that same cup for a beer. Without washing out the cup, you end up with a latte flavored beer. For something more formal: Understanding controlled trials Crossover trials

    PubMed Central (PMC) remove preview
    Understanding controlled trials Crossover trials
    In a crossover trial subjects are randomly allocated to study arms where each arm consists of a sequence of two or more treatments given consecutively. The simplest model is the AB/BA study. Subjects allocated to the AB study arm receive treatment A first, followed by treatment B, and vice versa in the BA arm.
    View this on PubMed Central (PMC) >

    .



    ------------------------------
    Adam Batten
    Lead Statistician & President
    AB EVERGREEN ANALYTICS LLC
    ------------------------------



  • 3.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 14:46

    Maria,

    Although I like the latte - beer analogy, the classic bools I have: Design and Analysis of Cross-Over Trials by Jones and Kenward and Cross-over Trials in Clinical Research by Senn, have considerable good discussion.  I'm sure more recent references also have good discussion (and perhaps google).

    David



    ------------------------------
    David Bristol
    Statistical Consulting Services, Inc.
    ------------------------------



  • 4.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 15:01

    I don't know what "bools" are. but I have books.



    ------------------------------
    David Bristol
    Statistical Consulting Services, Inc.
    ------------------------------



  • 5.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 14:55

    Maria,

    I often come to problems like yours, explaining to a non-statistician. I use ChatGPT 4 (I believe the same works for the GPT 3),

    the prompt formula I use:

    Explain at the level of <8th grader, college grad, phd etc.>, to a <physician, engineer, taxi-driver etc.>, using non-statistical language : "<hard to explain topic>". Keep it under < N > words.

     

    Example:

    Prompt=

    "Explain at the level of college graduate, to a physician, using non-statistical language : "why carry-over effects are important and cannot be dismissed". Keep it under 100 words."

    Result=
    "Carry-over effects are crucial because they represent the lingering impact of a previous treatment on a subsequent one. For physicians, overlooking these effects can blur the true effectiveness of treatments. If a patient shows improvement or adverse reactions under a new medication, it's essential to discern whether these are solely due to the current treatment or partially influenced by the previous one. Acknowledging carry-over effects ensures accurate treatment assessment, leading to more informed clinical decisions and ultimately better patient care."

     


    Chary Akmyradov, Ph.D.

    Senior Biostatistician

    Arkansas Children's Research Institute
    ● 13 Children's Way ● Slot 842 ● Little Rock, AR 72202

    (501) 364-2107 direct ● (501) 364-7373 office

    AkmyradovC@archildrens.org 
    Website ● Facebook ● Twitter ● LinkedIn

    image002.png@01D2CE3C.A89A2680

     






  • 6.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 15:18

    Maria

    Consider the slide below.
    PastedGraphic-1.png
    In this slide, the primary variable is the area under the curve for the respective treatments.  (This is common in bioequivalency studies.)  Treatment A has an effect that lasts for 3 hours.  The effect of treatment B lasts for 5 hours.  However, the effect of treatment B can be considered to be the effect in hours 1-3 plus the effect in hours 4 to 6 (a carryover effect).  The magic of crossover designs is the ability to pool the results of each  treatments - assuming they are estimating the same thing.  Under the assumption of no carry-over (adequate washout), both treatment curves would return to baseline and the curves for each treatment would be poolable.
    If the administration of treatments in the second period began at hour 6 (rather than at hour 4), the effect of both treatments would have returned to baseline and the curves in periods 1 and 2 would be the same for each of the treatments - demonstrating a superiority for Treatment B.  However, if we begin the observation the second period at hour 4, the effect of Treatment B has not returned to baseline - there is carryover.  This point is the new baseline for Treatment A in the second period.  Thus the calculation of the area under Treatment A in Period 2 has 2 more units added at each point and thus the estimate of Treatment A in Period 2 will be larger than that in Period 1 - just because of the carry-over effect observed with Treatment B in the first period.
    In this example, an adequate period between the periods would have resulted in a superiority of Treatment B over Treatment A.  However, because of the carryover effect, pooling the results of each treatment across the two periods results in the elimination of this treatment effect.  We have unknowingly introduced bias and reached the wrong conclusion - just because of the carryover.
    If this had been a real study, we would have incorrectly concluded that B was similar to A, when B was actually superior to A.
    The effect of carryover can be subtle and unpredictable.
    I hope this helps
    Bruce
    SSC e-mail sig.png



    ------------------------------
    Bruce E. Rodda, Ph.D., M.B.A., PStat®
    Adjunct Professor of Biostatistics and Public Health
    The University of Texas
    Strategic Statistical Consulting LLC
    19590 Sandcastle Drive, Suite 101
    Spicewood, TX 78669
    Office: 1-512-560-9734
    Mobile: 1-512-560-9734
    StrategicStatisticalConsulting.com
    ------------------------------



  • 7.  RE: carry-over effects in cross-over trials

    Posted 03-06-2024 15:54

    An actual example from pharma clinical trial - (a project I worked on) in drug development. 

    That  concerns the appropriate length of the wash-out period in PK (pharmacokinetic) trials of a new drug. Washout is the interval of time between two consecutive periods.  The example clinical trial is  sometimes called  an ADME clinical trial "Absorption , Distribution Metabolism and Excretion" trials ( https://www.technologynetworks.com/drug-discovery/articles/what-is-adme-336683 ) .  Many drugs when administered , say by swallowing a pill,  begin dissolving in the gut,  the main molecule (for this example considering small molecule drugs) is the active drug.. As the drug is digested in the gut there may be other "metabolites" , derived from the active molecule that are also active. An important step in drug development is to characterize all metabolites of a drug in humans.  

    And A long time ago I worked on a drug with the name of "mycophenolate mofetil" (actually developed in part at a pharma company in Palo Alto with researchers at Stanford). which was the ester of mycophenolic acid "MPA" or shortened to "myco".  when the drug , in pill formulation was digested in the gut and entering the blood stream – there was the active MPA and other active metabolites one of them MPAG ( mycophenolate glucuronide ). Both The MPA the MPAG were both active on the T-cell immune response to the disease (the disease was immunological rejection of a solid organ such as a kidney, heart or liver). Since the drug above was approved a different pharmaceutical company developed the MPA (without the ester) as a drug.

    A full description of the "myco" pharmacokinetics here

    https://link.springer.com/article/10.2165/00003088-199834060-00002

    The washout period has to be long enough for the active drug and all active metabolites to become inactive, sometimes stated  such as " the washout was at least ten half-lives" of the drug and its metabolite.  I forget the length of the washout we used for myco cross over trials (its in the published articles).

     An important operations and budget ($) aspect for the clinical trials is/was 1) how long was patient required to stay in the hospital . 2) and how expensive were the hospital beds and medical care/monitoring.  These are expensive and short washouts were preferred. However, if the washout period was too short, then the active drug and (possibly) several metabolites had an effect on the disease process, and the drug effect in  the subsequent period.  A long standing issue in cross over trials is whether there is some carry over, where drug in period 1, remains in the (say) blood and is active in the subsequent (period 2) for a two period cross over.  

    For comparison , for a different  clinical trial than above, when I asked about the half-life (for a different drug /metabolites than above) the half-life was some very large number like 120 hours (about 5 days). In that setting , if a patient was required to stay in the  hospital for five days– the clinical trial and hospital stay with medical attention, MD's, RN's  , other support,  was very expensive ($). 

    A slightly more formal description of potential for carry over may be found in so -called TQT (Thorough QT cardiac studies) which are required for new drugs in the early stages of development. Those TQT designs can also be formulated as Latin Squares and there must be adequate washout between all consecutive periods.  Because TQT  are cardiac trials and patient cardiac activity is monitored 24/hours and a dedicated team of (well paid) Cardiologists (often in several time zones) to be available 24/7 . can  be very expensive if a patient has to be in the hospital for several days with round the clock cardiac monitoring There is some limited  discussion of washout in the ICH TQT guidance. I like to mention TQT  when I give talks about drug development to graduate students, that a TQT is nearly a guarantee that the statistician gets summoned to  meet the CEO who (with varyiing degrees of emphasis)  expresses concern about the expense ($) of conducting the TQT  trial and asks some variation on "Do you know how expensive $$$ this trial is for us? Is  there a  way you can figure out a smaller sample size? https://database.ich.org/sites/default/files/E14_Guideline.pdf



    ------------------------------
    Chris Barker, Ph.D.
    Past Chair
    Statistical Consulting Section
    Consultant and
    Adjunct Associate Professor of Biostatistics
    www.barkerstats.com


    ---
    "In composition you have all the time you want to decide what to say in 15 seconds, in improvisation you have 15 seconds."
    -Steve Lacy
    ------------------------------



  • 8.  RE: carry-over effects in cross-over trials

    Posted 03-07-2024 14:59

    I second the Jones and Kenward book as a great reference.

    Here's a paper I wrote on this some years back. Carryover should not be ignored in a crossover study but it should  be considered in the design phase with an appropriate washout period.  Once you've done the experiment the statistical power to detect it is small. As an example, imagine that your carryover effect is half of your original treatment effect. Your original study had 80% power based on a within-subject contrast. The carryover effect can only be detected using a between-subject contrast so it will have poor statistical power. 

    Putt ME. Power to detect clinically relevant carry-over in a series of cross-over studies. Stat Med. 2006 Aug 15;25(15):2567-86. doi: 10.1002/sim.2275. PMID: 16220475.



    ------------------------------
    Mary Putt
    University of Pennsylvania
    ------------------------------