This paper is in the following e-collection/theme issue:

Obsessive-Compulsive Disorder (OCD) (36) Web-based and Mobile Health Interventions (3297) Panic Disorder (18) Social Anxiety Disorder (SAD) (51)

Published on in Vol 7, No 4 (2020): April

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/17157, first published .
Long-Term Effectiveness and Cost-Effectiveness of Videoconference-Delivered Cognitive Behavioral Therapy for Obsessive-Compulsive Disorder, Panic Disorder, and Social Anxiety Disorder in Japan: One-Year Follow-Up of a Single-Arm Trial

Long-Term Effectiveness and Cost-Effectiveness of Videoconference-Delivered Cognitive Behavioral Therapy for Obsessive-Compulsive Disorder, Panic Disorder, and Social Anxiety Disorder in Japan: One-Year Follow-Up of a Single-Arm Trial

Long-Term Effectiveness and Cost-Effectiveness of Videoconference-Delivered Cognitive Behavioral Therapy for Obsessive-Compulsive Disorder, Panic Disorder, and Social Anxiety Disorder in Japan: One-Year Follow-Up of a Single-Arm Trial

Authors of this article:

Kazuki Matsumoto1 Author Orcid Image ;   Sayo Hamatani1, 2 Author Orcid Image ;   Kazue Nagai3 Author Orcid Image ;   Chihiro Sutoh4 Author Orcid Image ;   Akiko Nakagawa1 Author Orcid Image ;   Eiji Shimizu1, 4 Author Orcid Image
Article Authors Cited by (18) Tweetations (5) Metrics

    Original Paper

    1Research Center for Child Mental Development, Chiba University, Chiba, Japan

    2Japan Society for the Promotion of Science, Tokyo, Japan

    3Research and Education Center of Health Sciences, Graduate School of Health Sciences, Gunma University, Gunma, Japan

    4Department of Cognitive Behavioral Physiology, Graduate School of Medicine, Chiba University, Chia, Japan

    Corresponding Author:

    Kazuki Matsumoto, PhD

    Research Center for Child Mental Development

    Chiba University

    Inohana 1-8-1, Chuo-ku

    Chiba,

    Japan

    Phone: 81 08 043 226 2975

    Fax:81 08 043 226 8588

    Email: axpa0219@chiba-u.jp


    Background: Face-to-face individual cognitive behavioral therapy (CBT) and internet-based CBT (ICBT) without videoconferencing are known to have long-term effectiveness for obsessive-compulsive disorder (OCD), panic disorder (PD), and social anxiety disorder (SAD). However, videoconference-delivered CBT (VCBT) has not been investigated regarding its long-term effectiveness and cost-effectiveness.

    Objective: The purpose of this study was to investigate the long-term effectiveness and cost-effectiveness of VCBT for patients with OCD, PD, or SAD in Japan via a 1-year follow-up to our previous 16-week single-arm study.

    Methods: Written informed consent was obtained from 25 of 29 eligible patients with OCD, PD, and SAD who had completed VCBT in our clinical trial. Participants were assessed at baseline, end of treatment, and at the follow-up end points of 3, 6, and 12 months. Outcomes were the Yale-Brown Obsessive-Compulsive Scale (Y-BOCS), Panic Disorder Severity Scale (PDSS), Liebowitz Social Anxiety Scale (LSAS), Patient Health Questionnaire–9 (PHQ-9), General Anxiety Disorder–7 (GAD-7), and EuroQol-5D-5L (EQ-5D-5L). To analyze long-term effectiveness, we used mixed-model analysis of variance. To analyze cost-effectiveness, we employed relevant public data and derived data on VCBT implementation costs from Japanese national health insurance data.

    Results: Four males and 21 females with an average age of 35.1 (SD 8.6) years participated in the 1-year follow-up study. Principal diagnoses were OCD (n=10), PD (n=7), and SAD (n=8). The change at 12 months on the Y-BOCS was −4.1 (F1=4.45, P=.04), the change in PDSS was −4.4 (F1=6.83, P=.001), and the change in LSAS was −30.9 (F1=6.73, P=.01). The change in the PHQ-9 at 12 months was −2.7 (F1=7.72, P=.007), and the change in the GAD-7 was −3.0 (F1=7.09, P=.009). QALY at 12 months was 0.7469 (SE 0.0353, 95% Cl 0.6728-0.821), and the change was a significant increase of 0.0379 (P=.01). Total costs to provide the VCBT were ¥60,800 to ¥81,960 per patient. The set threshold was ¥189,500 ($1723, €1579, and £1354) calculated based on willingness to pay in Japan.

    Conclusions: VCBT was a cost-effective way to effectively treat Japanese patients with OCD, PD, or SAD.

    Trial Registration: University Hospital Medical Information Network Clinical Trials Registry UMIN000026609; https://upload.umin.ac.jp/cgi-open-bin/ctr_e/ctr_view.cgi?recptno=R000030495

    JMIR Ment Health 2020;7(4):e17157

    doi:10.2196/17157

    Keywords

    long-term effectiveness; cost-effectiveness; videoconference-delivered cognitive behavioral therapy; internet-based cognitive behavioral therapy; obsessive-compulsive disorder; panic disorder; social anxiety disorder 


    Background

    Obsessive-compulsive disorder (OCD), panic disorder (PD), and social anxiety disorder (SAD) are mental health illnesses that create severe obstacles for patients in their daily lives [1]. The long-term effectiveness of treatment is worth evaluating, because OCD, PD, and SAD often recur even after improvement following treatment [2-4]. In particular, it is important to guide effective health care policy in countries such as Japan, which have instituted universal public health care insurance systems [5], to optimize limited resources and maintain medical services in consideration of cost-effectiveness.

    Telepsychiatry can be delivered to established therapy patients in developed countries where there is wide availability of information and communication devices and internet use is high. Within telepsychiatry, videoconference-delivered cognitive behavioral therapy (VCBT) has proved promising, with the potential to improve the accessibility of specialized care to patients with OCD, PD, and SAD [6]. Even with simple Web cameras, the internet, and information and communication equipment, psychiatrists can significantly improve symptoms by properly examining patients with mental illness, delivering psychological education, and dispensing medication [7]. Multiple clinical trials have reported significant reductions in symptoms of depression, OCD, PD, and SAD as a result of VCBT [6,8,9]. However, we know little about the long-lasting (12 or more months) effectiveness and cost-effectiveness of VCBT, despite its proven short-term effectiveness [4,9,10].

    VCBT requires a videoconferencing system, thereby making it more expensive compared with face-to-face cognitive behavioral therapy (CBT). For facilities that provide health care services, VCBT is a little more expensive than traditional CBT. However, for patients, VCBT is less burdensome than face-to-face CBT, as there are no travel costs or time costs associated with hospital visits. VCBT puts the burden of cost on the facility; thus, it is particularly important to assess whether its adoption is a worthwhile approach from the perspective of efficient health care policy.

    Objectives of the Study

    This study’s main objectives were to assess the long-term effectiveness of VCBT for patients with OCD, PD, or SAD and estimate its cost-effectiveness in Japan.


    Study Design

    In this study, we included data from our previous clinical trials and follow-ups [6]. We obtained written consent from participants in two stages. First, we obtained participants’ written consent forms to research feasibility of VCBT at face-to-face screening before the intervention. Second, those who consented to participate in the follow-up study were requested to resend signed consent forms provided to the researchers. The questionnaires on symptomology were sent by mail or the data collected telephonically at 3, 6, 8, and 12 months after the end of VCBT. These data were used in this study.

    In March 2018, the Cognitive Behavioral Therapy Center at Chiba University Hospital implemented a prospective observational study involving all patients who participated in VCBT (reference number: G28038, UMIN000026609) [6]. The study was registered with University Hospital Medical Information Network Clinical Trials Registry [UMIN000026609]. In a follow-up study after the intervention, the institutional review board of Chiba University approved the study protocol (No. 3048).

    Participants and Eligibility Criteria in the Clinical Trial

    All participants had received face-to-face treatment from the attending physician (psychiatrist) during a previous clinical trial period [6]. VCBT was provided in addition to ongoing face-to-face treatment including pharmacotherapy. Inclusion criteria for our previous clinical trial included informed consent to participate in the study; having a primary diagnosis of OCD, PD, or SAD based on the Mini-International Neuropsychiatric Interview [11,12]; being aged between 19 and 65 years; and having access to the internet at home [6].

    Outcomes

    Symptomatology

    The following Japanese version of three scales were used to assess the severity of the three disorders. The Yale-Brown Obsessive-Compulsive Scale (Y-BOCS) was used to measure OCD by identifying the patient’ contents of obsessions and compulsions on the symptom checklist and assessing their severity in 4 stages using responses to 10 items on the symptom severity scale [13,14]. The Panic Disorder Severity Scale (PDSS) was used when PD was the principal diagnosis [15,16]. PDSS is a 7-item questionnaire on frequency of panic attacks, extent of subjective distress, impact on daily life, and so on, with response options ranging from 0 to 4 in severity. The Liebowitz Social Anxiety Scale (LSAS) was used for participants whose principal diagnosis was SAD [17,18]. LSAS is a 24-item questionnaire intended to evaluate the extent of anxiety and avoidance in social situations where social anxiety is noticeable (eg, public speaking, talking to strangers).

    We also assessed depression and general anxiety associated using responses to the Patient Health Questionnaire–9 (PHQ-9) and Generalized Anxiety Disorder 7 (GAD-7). PHQ-9 has 9 questions related to depression status set [19,20], and GAD-7 is a 7-question instrument about general anxiety [21]. We evaluated the quality-adjusted life year (QALY) calculation in the EuroQol 5-Dimension 5-Level (EQ-5D-5L) instrument to assess the cost-effectiveness of the VCBT as a health care technology [22]. The EQ-5D-5L questions determine quality of life [22,23]. Health status is determined in five dimensions: degree of movement, personal management, normal activity, pain/discomfort, and anxiety/hiding.

    Criteria Used to Define Therapeutic Response and Remission

    To calculate responsiveness to VCBT treatment and remission rates after the VCBT, we used criteria employed by previous studies regarding the severity rating scales of the three disorders (Y-BOCS, PDSS, and LSAS). Regarding OCD, treatment response was defined as a 35% or greater reduction in the total Y-BOCS score, and remission was defined as a 12-month Y-BOCS≤14 [24]. Regarding PD, treatment response was defined as a 40% or greater reduction in total PDSS score, and remission was defined as a 12-month PDSS≤ 7 [25]. For SAD, treatment response was defined as a 31% or greater reduction in total LSAS score, and remission was defined as a 12-month LSAS≤35 [17].

    Sources for Cost-Effectiveness

    We calculated the total VCBT cost using the sum of the costs of implementing the intervention: (1) health care costs (¥3500-¥4800 × 16 sessions) and (2) costs of videoconferencing (license fee ¥1490 per month × 4 months in Webex (Cisco), ¥300 × 16 sessions in curon (MICIN, Inc) [26,27]. Note that in Japan, the cost of CBT in health care settings differs depending on whether it is performed by a doctor or jointly performed by a doctor and a nurse [28]. The cost-effectiveness threshold of the VCBT intervention was based on the willingness-to-pay (WTP) figure determined in a previous study (¥5 million) [29].

    We did not assume that hardware would have to be newly purchased in order to access VCBT. This was because, as reported by the Ministry of Internal Affairs and Communications in 2017, ownership of information communication equipment in Japan was at 94.8% for mobile devices in general and 72.5% for PCs and because the penetration rate of information and communication equipment and the internet was at more than 80.9% for all households [30].

    Statistical Analyses

    Statistical analysis and reporting were performed in accord with the CONSORT-EHEALTH guidelines [31]. All statistical analyses were described in the statistical analysis plan, which was fixed before the database lock. All efficacy analyses were primarily based on the entire analytical dataset. Summary statistics were generated on all baseline variables with frequencies and proportions calculated on categorical data and means and standard deviations calculated on continuous variables.

    The main analysis compared the baseline assessment scores with those obtained at the 12-month posttreatment follow-up. The differences were estimated using mixed-model analysis of variance (ANOVA) on all patients displaying symptoms in each scale (Y-BOCS, PDSS, LSAS, PHQ-9, and GAD-7), taking into account missing values, individual variance, and multiple measurement points.

    Analysis of secondary outcomes was performed in an identical fashion to that of the primary analysis. To analyze cost-effectiveness using the EQ-5D-5L, QALY scores were estimated via area-under-the-curve analysis, which involved summing the areas of the distribution shapes for utility scores over the study period [22]. We calculated QALY summary statistics using the EQ-5D-5L data during the follow-up period complemented by multivariate imputation by chained equations (MICE) and last observation carried forward (LOCF). MICE was used as a guide for 100 completions [32].

    The amount of change in QALY was calculated from the difference between QALY and the actually observed utility value assuming no change from the utility value of EQ-5D-5L at baseline. We calculated a summary statistic for the change in QALY and performed a paired t test. The method for calculating the change in QALY was as follows: QALY change amount = (baseline and end of treatment, 3 months, 6 months, 8 months, or area under the curve connecting the utility values including 12 months) – (effective value at each time point is baseline utility value and area under the curve assuming no change).

    Cost-effectiveness of the VCBT was analyzed as follows. The additional consumption of health care resources was divided by the benefits (such as QALY) gained from the health care intervention to calculate an incremental cost-effectiveness ratio (ICER). When the ICER, such as cost per QALY, was less than a predetermined threshold, the intervention was considered cost-effective [33]. These thresholds were: (1) £20,000-£30,000 per QALY at the UK National Institute for Health and Care Excellence (NICE) [34], (2) $62,000 in the United States, and (3) ¥5 million in Japan [29]. The formulae used to calculate cost-effectiveness of VCBT, cost of VCBT, and WTP were as follows:

    • Cost-effectiveness of VCBT = WTP − cost of VCBT
    • Cost of VCBT = (videoconference system costs) + traditional CBT costs
    • WTP = increased QALYs × threshold in Japan (¥5 million)

    Calculated cost-effectiveness greater than one indicated that VCBT was a cost-effective intervention. WTP was calculated by multiplying the increase in QALY between baseline and 12-month follow-up after VCBT using the Japanese cost-effectiveness threshold (¥5 million). Incremental cost-effectiveness ratio per QALY was calculated by dividing the increase in QALY between baseline and 12-month follow-up after VCBT using total cost of VCBT.


    Participants

    The sample comprised 4 males and 21 females, aged 20 to 54 years (mean 35.1 [SD 8.6] years) with 12 to 18 years of education (mean 14.72 [SD 1.90] years). Except for their principal diagnoses, participants’ demographic and diagnostic data are described in Table 1, and the sampling procedure is illustrated in Figure 1.

    Table 1. Participant clinical and demographic characteristics.
    CharacteristicsOverall (n=25)OCDa (n=10)PDb (n=7)SADc (n=8)
    Age in years, mean (SD)35.1 (8.6)37.7 (6.9)36.1 (9.3)30.9 (9.4)
    Gender (female), n (%)21 (84)8 (80)7 (100)6 (75)
    Employed, n (%)14 (56)3 (12)5 (71)6 (75)
    Pharmacotherapy (yes), n (%)9 (36)5 (50)3 (43)1 (13)
    Comorbidity, n (%)




    		Depression3 (12)1 (10)0 (0)2 (24)

    		Panic/agoraphobia2 (11)2 (20)0 (0)0 (0)

    		PTSDd1 (4)1 (10)0 (0)0 (0)

    		Alcohol dependence1 (4)0 (0)0 (0)1 (13)

    aOCD: obsessive-compulsive disorder.

    bPD: panic disorder.

    cSAD: social anxiety disorder.

    dPTSD: posttraumatic stress disorder.

    ‎
    Figure 1. Participant flow.

    Long-Term Effectiveness

    Mixed-model ANOVA results regarding the long-term effectiveness of VCBT showed statistically significant improvement in participant symptoms (Table 2 and Figure 2). Changes in total mean scores between baseline and 12-month assessment were –4.1 on the Y-BOCS (F1=4.45, P=.04), –4.4 on the PDSS (F1=6.83, P=.01), and –30.9 on the LSAS (F1=6.73, P=.01). Changes in the total PHQ-9 (depression) and GAD-7 (general anxiety) scores between baseline and 12-month follow-up assessment were –2.7 on the PHQ-9 (F1=7.72, P=.007) and –3.0 on the GAD-7 (F1= 7.09, P=.009).

    Table 2. Mixed-model analysis of variance results on changes in participant symptomology.
    CharacteristicsnScore mean (SD)Min-maxaP value
    Y-BOCSb———.04

    		Baseline1023.3 (6.5)15 (36)—

    		Posttreatment1017.1 (9.9)2 (34)—

    		3-month1019.4 (7.5)9 (32)—

    		6-month1018.6 (8.1)7 (32)—

    		12-month1019.2 (8.4)8 (29)—
    PDSSc———.01

    		Baseline78.9 (3.8)5 (16)—

    		Posttreatment75.3 (6.7)0 (19)—

    		3-month75.4 (4.9)2 (13)—

    		6-month64.5(6.1)0 (16)—

    		12-month64.5 (3.6)0 (10)—
    LSASd———.01

    		Baseline896.6 (27.3)53 (132)—

    		Posttreatment857.4 (34.7)21 (128)—

    		3-month862.6 (34.4)20 (112)—

    		6-month657.3 (31.9)7 (85)—

    		12-month765.7 (43.8)10 (118)—
    PHQ-9e———.007

    		Baseline258.8 (6.2)0 (23)—

    		Posttreatment256.8 (7.0)0 (22)—

    		3-month257.2 (5.8)0 (24)—

    		6-month226.6 (6.1)0 (19)—

    		12-month236.1 (5.7)0 (20)—
    GAD-7f———.009

    		Baseline258.8 (5.3)0 (20)—

    		Posttreatment255.5 (5.1)0 (16)—

    		3-month257.2 (4.6)0 (19)—

    		6-month256.3 (5.0)0 (21)—

    		12-month235.8 (4.5)0 (14)—

    amin-max: minimum to maximum.

    bY-BOCS: Yale-Brown Obsessive-Compulsive Scale.

    cPDSS: Panic Disorder Severity Scale.

    dLSAS: Livobitz Social Anxiety Scale.

    ePHQ-9: Patient Health Questionnaire–9.

    fGAD-7: Generalized Anxiety Disorder–7.

    ‎
    Figure 2. Participants’ changes in symptomology.

    To investigate the predictive effects that symptoms of patients’ depression at pretreatment may have had on the treatment response change posttreatment, multiple regression analyses in simultaneous forced entry were performed. The treatment response percentage change was set as a dependent variable in multiple regression analyses. We set depressive symptoms due to PHQ-9 as independent variables. The treatment response percentage change was calculated by dividing the total baseline score with the score difference between baseline and 12-month. The treatment response percentage change in this study was the decline in baseline Y-BOCS, PDSS, or LSAS score.

    The degree of change (in percentages) in the treatment response was analyzed as a continuous variable. Statistical analysis was performed using SPSS Statistics version 24.00 (IBM Corp). Multiple regression analysis showed that the effects of depression on therapeutic response rates were not significant across the data (β=–1.74, adjusted R2=.13, SE 25.29, P=.053, VIF (variance inflation factor)=1.00), OCD (β=–1.60, adjusted R2=.24, SE 19.46, P=.16), PD (β=–0.41, adjusted R2=.25, SE 38.82, P=.96), and SAD (β=–0.73, adjusted R2=.18, SE 24.02, P=.77).

    Therapeutic Response and Remission Rates

    At the 12-month follow-up assessment, treatment response rate was 32% (8/25) and remission rate was 40% (10/25; Table 3).

    Table 3. Participant response and remission rates at each follow-up end point.
    CharacteristicsOverall (n=25), n (%)OCDa (n=10), n (%)PDb (n=7), n (%)SADc (n=8), n (%)
    Response




    		Posttreatment12 (48)4 (40)4 (57)4 (50)

    		3-month10 (40)2 (20)5 (71)3 (38)

    		6-month8 (32)2 (20)3 (43)3 (38)

    		12-month8 (32)2 (20)2 (29)4 (50)
    Remission




    		Posttreatment12 (48)4 (40)6 (86)2 (25)

    		3-month11 (44)4 (40)5 (71)2 (25)

    		6-month10 (40)3 (30)5 (71)2 (25)

    		12-month10 (40)3 (30)5 (71)2 (25)

    aOCD: obsessive-compulsive disorder.

    bPD: panic disorder.

    cSAD: social anxiety disorder.

    Cost-Effectiveness

    Table 4 shows the EQ-5D-5L index for each end point. The 1-year converted QALY score from baseline to 12 months posttreatment was 0.7469 (SE 0.0353, 95% CI 0.6728-0.821), and the change between baseline and 12-month follow-up assessment was 0.0379 (SE 0.01; Table 5). Figure 3 shows the QALY calculated from the EQ-5D-5L between baseline and 12-month follow-up assessment. There was a significant increase of 0.038 (95% CI 0.0085-0.0674, P=.02) in complete cases. The results on the data supplemented with missing values are shown in Table 6. The WTP threshold was ¥189,500 because the 0.0379 score in the QALYs increased after the intervention. The health care costs including the VCBT accounted for the CBT health care costs (¥56,000-¥76,000), and annual licensing fees per patient for the videoconferencing system (¥4800-¥5960) was ¥60,800 to ¥81,960 (Table 7). Thus, we concluded that the VCBT was a cost-effective intervention because VCBT costs were below the threshold set for the cost-effectiveness analysis.

    Table 4. EuroQol 5-Dimension 5-Level index each end point.
    CharacteristicsnMeanSDSE
    Complete case




    		Baseline250.72060.14—

    		Posttreatment250.76770.20—

    		3-month250.73500.17—

    		6-month220.72070.24—

    		8-month200.77600.15—

    		12-month230.75030.15—
    LOCFa




    		6-month250.73420.23—

    		8-month250.76690.15—

    		12-month250.75300.15—
    MICEb




    		6-month250.7075—0.05

    		8-month250.7651—0.03

    		12-month250.7564—0.03

    aLOCF: last observation carried forward.

    bMICE: multivariate imputation by chained equations.

    Table 5. Paired t test results on change of quality-adjusted life years at 12 months after baseline.
    CharacteristicsnMeanSE95% CIP value
    Complete cases190.03790.010.0085-0.0674.02
    LOCFa250.02140.010.0067-0.0495.13
    MICEb250.01870.010.0093-0.0466.19

    aLOCF: last observation carried forward.

    bMICE: multivariate imputation by chained equations.

    ‎
    Figure 3. The quality-adjusted life years (QALYs) observed at follow-up and QALY in complete cases. Note: Estimated QALYs was calculated in terms of effective value without videoconference-delivered cognitive behavioral therapy at each time point as a baseline, with the area under the curve assuming no change. Increased QALY was calculated as the difference between the measured utility value and the estimated QALY.
    Table 6. Quality-adjusted life years at 12 months after videoconference-delivered cognitive behavioral therapy.
    CharacteristicsnMeanSE95% CI
    Complete cases190.74690.040.6728-0.8210
    LOCFa250.74200.030.6839-0.8001
    MICEb250.83430.040.7565-0.9121

    aLOCF: last observation carried forward.

    bMICE: multivariate imputation by chained equations.

    Table 7. Results of a cost-utility analysis.
    CharacteristicsValue
    Cost for each service per patient (¥)

    		CBTa by a nurse¥56,000

    		CBT by a medical doctor¥76,000

    		Videoconferencing in Webex¥5960

    		Videoconferencing in Curon¥4800

    		Total cost¥60,800-¥81,960
    QALYb

    		Complete case0.7469

    		LOCFc0.742

    		MICEd0.8343
    Incremental benefit, QALY gain

    		Complete case0.0379

    		LOCF0.0214

    		MICE0.0187
    Incremental cost-effectiveness ratio per QALY

    		Complete case¥1,604,222 to ¥2,162,533

    		LOCF¥2,841,122 to ¥3,829,907

    		MICE¥3,251,337 to ¥4,382,888
    Willingness to pay =¥5 million per QALY

    		Complete case¥189,500

    		LOCF¥107,000

    		MICE¥93,500

    aCBT: cognitive behavioral therapy.

    bQALY: quality adjusted life year.

    cLOCF: last observation carried forward.

    dMICE: multivariate imputation by chained equations.


    Principal Findings

    We investigated the long-term effectiveness and cost-effectiveness of VCBT in 25 patients with OCD, PD, or SAD in a 12-month observational study. The principal symptomology of OCD, PD, and SAD significantly decreased and the QALY significantly improved. The therapeutic response rate was 32% (8/25) and remission rate was 40% (10/25) at the 12-month postintervention follow-up assessment. The total cost of providing VCBT was ¥60,800 to ¥81,960 per patient; in contrast, the threshold using WTP was ¥189,500. Therefore, our results suggested that VCBT was a cost-effective intervention for this sample of patients with OCD, PD, or SAD in Japan.

    Long-Term Effectiveness of Videoconference-Delivered Cognitive Behavioral Therapy

    In a previous study on VCBT provided to 10 adult OCD patients, 2 patient scores were below the Y-BOCS cutoff (<14) after treatment, but just one patient was below the cutoff 3 months later [10]. There was a trend toward increased OCD symptoms at 3 months’ postintervention [10]. A randomized controlled trial (RCT) of VCBT provided to OCD patients aged 7 to 16 years indicated that continued improvement was observed in the symptoms until 3 months after treatment [35]. In that study [35], one of the two patients who evidenced remission before and after the treatment was still in remission 6 months’ postintervention, whereas the other patient presented worse symptoms. This study provides observational results from the end point of the VCBT for 12 months, which extends the findings of previous research. In other words, as the amount of time after the intervention increased, OCD symptoms apparently increased and the proportion of remissions apparently decreased from 40% (4/10) immediately after VCBT to 30% (3/10) at 3 months later and 20% (2/10) at the 6-month and 12-month follow-up assessments. The results of this study are consistent with previous studies that the remission rate decreases with time [7,30]. When patient symptoms increase, they might access a self-help program or attend regular support sessions to help prevent symptom relapse [36]. In a survey of adolescents with OCD, satisfaction with support sessions was universal [37].

    In a study that provided VCBT to 11 adult PD patients, 82% (9/11) had improved symptoms after the intervention and 91% (10/11) had improved symptoms after 6 months and no panic attacks [38]. This study extended the examination of the long-term efficacy of VCBT in patients with PD to 12 months and found that it was effective for 85% (6/7) after treatment, and it held steady at 71% (5/7) after 3, 6, and 12 months. However, although VCBT has demonstrated its long-term efficacy, there is some indication that panic symptoms might relapse over time [25].

    In a study of VCBT in 24 adult patients with SAD, 54% (13/24) experienced remission after treatment, and symptoms that had decreased were maintained at that lower level 6 months later [39]. Our results were similar to that study in that the patients who achieved remission after VCBT seemed to continue in remission for 6 or 12 months (both 2/8, 25%). The same two patients exhibited remission at any point during the 12 months. We gradually lost contact during the observation period with 2 of the 4 patients who had exhibited remission after the VCBT. Therefore, when interpreting the long-term symptom-improving effects, it might be important to consider the course of remission rather than the overall remission rate during the study period.

    Cost-Effectiveness of Videoconference-Delivered Cognitive Behavioral Therapy

    Several studies have reported that internet-delivered cognitive behavioral therapy (ICBT) provided to patients with depression saved on direct medical costs more than providing just the usual care [40,41]. In an RCT conducted in Spain [41], providing ICBT to patients with depression was more cost-effective than 12 months of treatment restricted to usual care: €6381 for therapist-guided ICBT and €11,390 for nonguided ICBT. On the other hand, an RCT of ICBT aimed at preventing recurrent depression found that the average cost after 24 months was not significantly different between the ICBT group ($8298) and the usual care group ($7296) [42]. A study of face-to-face CBT in 469 participants with depression suggested that the incremental cost-effectiveness ratio was £5374 per QALY gain [43], below the threshold £20,000 to £30,000 at NICE [34]. That study’s result was consistent with our result: ¥1,604,222 to ¥2,162,533 per QALY gain (£11,459 to £15,447; calculated as ¥100=£140), below the threshold of ¥5 million in Japan [29]. Hence, CBT for depression and anxiety disorders was cost-effective whether it was face-to-face or internet intervention, with or without videoconferencing.

    This study provides the world’s first empirical knowledge about the cost-effectiveness of VCBT. VCBT costs totaled ¥60,800 to ¥81,960, which was far below the ¥189,500 threshold based on WTP calculated using the QALY. In other words, under the Japanese insurance system in 2018 [28], VCBT was a cost-effective treatment approach. We determined that ¥100 was approximately $110, €120, and £140. The VCBT costs were then determined to be $553 to $745, €507 to €683, and £434 to £585 and the threshold of WTP was $1723, €1579, £1354.

    Limitations and Future Research

    This study has some limitations. First, there was no statistical control over the relationship between VCBT and pharmacological therapy during our previous trial and this follow-up study. Studies have suggested that combining therapeutic approaches with drug therapy is particularly effective in panic disorder prognoses [44]. Future studies should include a controlled design that accounts for drug therapy and combination therapy. Second, we did not account for the effects of support provided to the participants during the observation period after the VCBT. Patients who continue to use antidepressants after remission were known to have a lower recurrence rate than those who discontinued prematurely [45]. Third, there was no usual care group to contrast with the VCBT group as a control in the cost-effectiveness analysis. We examined the cost-effectiveness of VCBT based on a white paper on the health care costs of patients with anxiety disorders in Japan [28], and, therefore, future research should employ actual observations and data. Fourth, during some observation periods (eg, 6 months or 12 months posttreatment), we lacked data on participants who exhibited significant symptom improvements immediately after treatment. Therefore, the results should be interpreted with caution. Fifth, a small sample size was used in this study, and there was no comparison group. Future studies should use a large sample and employ RCTs. Sixth, participants recruited in this study tended to be living in their own local areas far from our hospital without having face-to-face CBT, and they had relatively long duration of untreated illness before CBT. In future, VCBT cost-effectiveness studies for patients at the early onset stage of the disorders in primary care settings will be required.

    Conclusion

    Our results suggest that VCBT for patients with OCD, PD, and SAD was effective in improving symptoms over 12 months and was a cost-effective approach in Japan.

    Acknowledgments

    We express our gratitude and respect for the dedication and contribution of research participants. This study was supported by the Japan Society for the Promotion of Science KAKENHI Grant-in-Aid for Scientific Research C (Nos. 18K03130 and 18K17313). The funding sources had no role in the design and conduct of the study.

    Authors' Contributions

    KM contributed to design of research, data collection and analysis, and the development of the manuscript. SH contributed to data collection. KN contributed to the design and statistical analysis in this study. CS contributed to management of this study. AN contributed to data collection. ES contributed to the drafting and planning of this study and provided interpretations based on the results.

    Conflicts of Interest

    None declared.

    1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition. Washington. American Psychiatric Association; 2013.
    2. Eisen JL, Sibrava NJ, Boisseau CL, Mancebo MC, Stout RL, Pinto A, et al. Five-year course of obsessive-compulsive disorder: predictors of remission and relapse. J Clin Psychiatry. Mar 2013;74(3):233-239. [FREE Full text] [CrossRef] [Medline]
    3. Spinhoven P, Batelaan N, Rhebergen D, van Balkom A, Schoevers R, Penninx BW. Prediction of 6-yr symptom course trajectories of anxiety disorders by diagnostic, clinical and psychological variables. J Anxiety Disord. Dec 2016;44:92-101. [CrossRef] [Medline]
    4. Scholten WD, Batelaan NM, Penninx BW, van Balkom A, Smit JH, Schoevers R, et al. Diagnostic instability of recurrence and the impact on recurrence rates in depressive and anxiety disorders. J Affect Disord. May 2016;195:185-190. [CrossRef] [Medline]
    5. Ministry of Health, Labour and Welfare. URL: https://www.mhlw.go.jp/bunya/iryouhoken/iryouhoken01/dl/01_eng.pdf [accessed 2020-04-09]
    6. Matsumoto K, Sutoh C, Asano K, Seki Y, Urao Y, Yokoo M, et al. Internet-based cognitive behavioral therapy with real-time therapist support via videoconference for patients with obsessive-compulsive disorder, panic disorder, and social anxiety disorder: pilot single-arm trial. J Med Internet Res. Dec 17, 2018;20(12):e12091. [FREE Full text] [CrossRef] [Medline]
    7. Moreno FA, Chong J, Dumbauld J, Humke M, Byreddy S. Use of standard Webcam and Internet equipment for telepsychiatry treatment of depression among underserved Hispanics. Psychiatr Serv. Dec 2012;63(12):1213-1217. [CrossRef] [Medline]
    8. De Las Cuevas C, Arredondo MT, Cabrera MF, Sulzenbacher H, Meise U. Randomized clinical trial of telepsychiatry through videoconference versus face-to-face conventional psychiatric treatment. Telemed J E Health. Jun 2006;12(3):341-350. [CrossRef] [Medline]
    9. Stubbings DR, Rees CS, Roberts LD, Kane RT. Comparing in-person to videoconference-based cognitive behavioral therapy for mood and anxiety disorders: randomized controlled trial. J Med Internet Res. 2013;15(11):e258. [FREE Full text] [CrossRef] [Medline]
    10. Vogel PA, Solem S, Hagen K, Moen EM, Launes G, Håland AT, et al. A pilot randomized controlled trial of videoconference-assisted treatment for obsessive-compulsive disorder. Behav Res Ther. Oct 30, 2014;63C:162-168. [CrossRef] [Medline]
    11. Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry. 1998;59 Suppl 20:22-33. [FREE Full text] [Medline]
    12. Muramatsu K, Miyaoka H, Kamijima K, Muramatsu Y, Yoshida M, Otsubo T, et al. The patient health questionnaire, Japanese version: validity according to the mini-international neuropsychiatric interview-plus. Psychol Rep. Dec 2007;101(3 Pt 1):952-960. [CrossRef] [Medline]
    13. Goodman WK, Price LH, Rasmussen SA, Mazure C, Fleischmann RL, Hill CL, et al. The Yale-Brown Obsessive Compulsive Scale. I. development, use, and reliability. Arch Gen Psychiatry. Nov 1989;46(11):1006-1011. [CrossRef] [Medline]
    14. Hamagaki S, Takagi S, Urushihara Y, Ishisaka Y, Matsumoto M. [Development and use of the Japanese version of the self-report Yale-Brown Obsessive Compulsive Scale]. Seishin Shinkeigaku Zasshi. 1999;101(2):152-168. [Medline]
    15. Houck PR, Spiegel DA, Shear MK, Rucci P. Reliability of the self-report version of the panic disorder severity scale. Depress Anxiety. 2002;15(4):183-185. [CrossRef] [Medline]
    16. Katagami M. The self-report version of the Panic Disorder Severity Scale: reliability and validity of the Japanese version. Jpn J Psychosom Med. 2007;47:331-338. [CrossRef]
    17. Liebowitz M. Social phobia. Mod Probl Pharmacopsychiatry. 1987;22:141-173. [CrossRef] [Medline]
    18. Asakura S, Inoue S, Sasaki F, Sasaki Y, Kitagawa N, Inoue T. Consideration of validity and reliability for Liebowitz Social Anxiety Scale (LSAS) Japanese version. Clin Psychiatry. 2002;177:1084.
    19. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. Nov 10, 1999;282(18):1737-1744. [CrossRef] [Medline]
    20. Muramatsu K. Patient Health Questionnaire (PHQ-9, PHQ-15) Japanese version and Generalized Anxiety Disorder-7 Japanese version up to date. Stud Clin Psychol. 2014;7:35-39.
    21. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. May 22, 2006;166(10):1092-1097. [CrossRef] [Medline]
    22. EuroQol Group. EuroQol—a new facility for the measurement of health-related quality of life. Health Policy. Dec 1990;16(3):199-208. [CrossRef] [Medline]
    23. Tsuchiya A, Ikeda S, Ikegami N, Nishimura S, Sakai I, Fukuda T, et al. Estimating an EQ-5D population value set: the case of Japan. Health Econ. Jun 2002;11(4):341-353. [CrossRef] [Medline]
    24. Farris SG, McLean CP, Van Meter PE, Simpson HB, Foa EB. Treatment response, symptom remission, and wellness in obsessive-compulsive disorder. J Clin Psychiatry. Jul 2013;74(7):685-690. [FREE Full text] [CrossRef] [Medline]
    25. Furukawa TA, Katherine SM, Barlow DH, Gorman JM, Woods SW, Money R, et al. Evidence-based guidelines for interpretation of the Panic Disorder Severity Scale. Depress Anxiety. 2009;26(10):922-929. [FREE Full text] [CrossRef] [Medline]
    26. CISCO. URL: https://www.webex.com/ [accessed 2019-11-20]
    27. Micin Inc. URL: https://curon.co/ [accessed 2019-11-20]
    28. 61st Social Security Council Medical Committee in Ministry of Health, Labour and Welfare. URL: https:/​/www.​mhlw.go.jp/​file/​05-Shingikai-12601000-Seisakutoukatsukan-Sanjikanshitsu_Shakaihoshoutantou/​0000203227.​pdf [accessed 2019-10-11]
    29. Shiroiwa T, Sung Y, Fukuda T, Lang H, Bae S, Tsutani K. International survey on willingness-to-pay (WTP) for one additional QALY gained: what is the threshold of cost effectiveness? Health Econ. Apr 2010;19(4):422-437. [CrossRef] [Medline]
    30. Ministry of Internal Affairs and Communications. URL: https://www.soumu.go.jp/johotsusintokei/whitepaper/eng/WP2019/2019-index.html [accessed 2019-12-18]
    31. Eysenbach G. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res. 2011;13(4):e126. [FREE Full text] [CrossRef] [Medline]
    32. Wang B, Fang Y, Jin M. Combining type-III analyses from multiple imputations. 2014. URL: https://support.sas.com/resources/papers/proceedings14/1543-2014.pdf [accessed 2020-04-09]
    33. Towse A. What is NICE's threshold? An external view. In: Devlin N, Tows A, editors. Cost Effectiveness Thresholds: Economic and Ethical Issues. Office for Health Economica. King's Fund; 2002.
    34. Devlin N, Parkin D. Does NICE have a cost-effectiveness threshold and what other factors influence its decisions? A binary choice analysis. Health Econ. May 2004;13(5):437-452. [CrossRef] [Medline]
    35. Storch E, Caporino N, Morgan J, Lewin A, Rojas A, Brauer L, et al. Preliminary investigation of web-camera delivered cognitive-behavioral therapy for youth with obsessive-compulsive disorder. Psychiatry Res. Oct 30, 2011;189(3):407-412. [CrossRef] [Medline]
    36. Andersson E, Steneby S, Karlsson K, Ljótsson B, Hedman E, Enander J, et al. Long-term efficacy of Internet-based cognitive behavior therapy for obsessive-compulsive disorder with or without booster: a randomized controlled trial. Psychol Med. Oct 2014;44(13):2877-2887. [CrossRef] [Medline]
    37. Negreiros J, Selles RR, Lin S, Belschner L, Stewart SE. Cognitive-behavioral therapy booster treatment in pediatric obsessive-compulsive disorder: a utilization assessment pilot study. Ann Clin Psychiatry. Aug 2019;31(3):179-191. [Medline]
    38. Bouchard S, Paquin B, Payeur R, Allard M, Rivard V, Fournier T, et al. Delivering cognitive-behavior therapy for panic disorder with agoraphobia in videoconference. Telemed J E Health. 2004;10(1):13-25. [CrossRef] [Medline]
    39. Yuen E, Herbert J, Forman E, Goetter EM, Juarascio A, Rabin S, et al. Acceptance based behavior therapy for social anxiety disorder through videoconferencing. J Anxiety Disord. May 2013;27(4):389-397. [CrossRef] [Medline]
    40. Gräfe V, Berger T, Hautzinger M, Hohagen F, Lutz W, Meyer B, et al. Health economic evaluation of a web-based intervention for depression: the EVIDENT-trial, a randomized controlled study. Health Econ Rev. Jun 07, 2019;9(1):16. [FREE Full text] [CrossRef] [Medline]
    41. Romero-Sanchiz P, Nogueira-Arjona R, García-Ruiz A, Luciano J, García Campayo J, Gili M, et al. Economic evaluation of a guided and unguided internet-based CBT intervention for major depression: Results from a multi-center, three-armed randomized controlled trial conducted in primary care. PLoS One. 2017;12(2):e0172741. [FREE Full text] [CrossRef] [Medline]
    42. Klein NS, Bockting CL, Wijnen B, Kok GD, van Valen E, Riper H, et al. Economic evaluation of an internet-based preventive cognitive therapy with minimal therapist support for recurrent depression: randomized controlled trial. J Med Internet Res. Dec 26, 2018;20(11):e10437. [FREE Full text] [CrossRef] [Medline]
    43. Wiles NJ, Thomas L, Turner N, Garfield K, Kounali D, Campbell J, et al. Long-term effectiveness and cost-effectiveness of cognitive behavioural therapy as an adjunct to pharmacotherapy for treatment-resistant depression in primary care: follow-up of the CoBalT randomised controlled trial. Lancet Psychiatry. Feb 2016;3(2):137-144. [FREE Full text] [CrossRef] [Medline]
    44. Furukawa TA, Watanabe N, Churchill R. Psychotherapy plus antidepressant for panic disorder with or without agoraphobia: systematic review. Br J Psychiatry. Apr 2006;188:305-312. [FREE Full text] [CrossRef] [Medline]
    45. Betelann N, Bosman R. Risk of relapse after antidepressant discontinuation in anxiety disorders, obsessive-compulsive disorder, and post-traumatic stress disorder: systematic review and meta-analysis of relapse prevention trials. BMJ. Sep 25, 2017;358:j4461. [FREE Full text] [CrossRef] [Medline]

    ‎
    ANOVA: analysis of variance
    CBT: cognitive behavioral therapy
    EQ-5D-5L: EuroQol 5-Dimension 5-Level
    GAD-7: Generalized Anxiety Disorder–7
    ICBT: internet-delivered cognitive behavioral therapy
    ICER: incremental cost-effectiveness ratio
    LOCF: last observation carried forward
    LSAS: Liebowitz Social Anxiety Scale
    MICE: multivariate imputation by chained equations
    NICE: National Institute for Health and Care Excellence
    OCD: obsessive-complusive disorder
    PD: panic disorder
    PDSS: Panic Disorder Severity Scale
    PHQ-9: Patient Health Questionnaire–9
    QALY: quality-adjusted life year
    RCT: randomized controlled trial
    SAD: social anxiety disorder
    VCBT: videoconference-delivered cognitive behavioral therapy
    WTP: willingness-to-pay
    Y-BOCS: Yale-Brown Obsessive-Compulsive Scale

    Edited by G Eysenbach; submitted 22.11.19; peer-reviewed by K Mathiasen, R Nogueira-Arjona, T Muto; comments to author 16.12.19; revised version received 10.01.20; accepted 25.03.20; published 23.04.20.

    Copyright

    ©Kazuki Matsumoto, Sayo Hamatani, Kazue Nagai, Chihiro Sutoh, Akiko Nakagawa, Eiji Shimizu. Originally published in JMIR Mental Health (http://mental.jmir.org), 23.04.2020.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.