Web-based Therapy Plus Support by a Coach in Depressed Patients Referred to Secondary Mental Health Care: Randomized Controlled Trial

Background The evidence for the effectiveness of Web-based therapies comes mainly from nonclinical populations, with a few studies in primary care. There is little evidence from patients referred to secondary mental health care with depression. Adherence to Web-based therapies is often poor. One way to increase this is to create a new health service role of a coach to guide people through the therapy. Objective This study aimed to test in people referred to secondary care with depression if a Web-based therapy (The Journal) supported by a coach plus usual care would be more effective in reducing depression compared with usual care plus an information leaflet about Web-based resources after 12 weeks. Methods We conducted a randomized controlled trial with two parallel arms and a process evaluation that included structured qualitative interviews analyzed using thematic analysis. The coach had a background in occupational therapy. Participants were recruited face-to-face at community mental health centers. Results We recruited 63 people into the trial (intervention 35, control 28). There were no statistically significant differences in the change from baseline in Patient Health Questionnaire-9 (PHQ-9) scores at 12 weeks comparing The Journal with usual care (mean change in PHQ-9 score 9.4 in the intervention group and 7.1 in the control group, t41=1.05, P=.30; mean difference=2.3, 95% CI −2.1 to 6.7). People who were offered The Journal attended on average about one less outpatient appointment compared with usual care, although this difference was not statistically significant (intervention mean number of visits 2.8 (SD 5.5) compared with 4.1 (SD 6.7) in the control group, t45=−0.80, P=.43; mean difference=1.3, 95% CI −4.5 to 2.0). The process evaluation found that the mean number of lessons completed in the intervention group was 2.5 (SD=1.9; range=0-6) and the number of contacts with the coach was a mean of 8.1 (SD=4.4; range=0-17). The qualitative interviews highlighted the problem of engaging clinicians in research and their resistance to recruitment: technical difficulties with The Journal, which prevented people logging in easily; difficulty accessing The Journal as it was not available on mobile devices; participants finding some lessons difficult; and participants saying they were too busy to complete the sessions. Conclusions The study demonstrated that it is feasible to use a coach in this setting, that people found it helpful, and that it did not conflict with other care that participants were receiving. Future trials need to engage clinicians at an early stage to articulate where Web-based therapies fit into existing clinical pathways; Web-based therapies should be available on mobile devices, and logging in should be easy. The role of the coach should be explored in larger trials. Trial Registration Australian New Zealand Clinical Trials Registry (ACTRN): 12613000015741; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=363351&isReview=true (Archived by WebCite at http://www.webcitation.org/6wEyCc6Ss).


Manuscript tracking number *
If this is a JMIR submission, please provide the manuscript tracking number under "other" (The ms tracking number can be found in the submission acknowledgement email, or when you login as author in JMIR. If the paper is already published in JMIR, then the ms tracking number is the four-digit number at the end of the DOI, to be found at the bottom of each published article in JMIR) no ms number (yet) / not (yet) submitted to / published in JMIR Other: TITLE AND ABSTRACT 1a) TITLE: IdentiUcation as a randomized trial in the title 1a) Does your paper address CONSORT item 1a? * I.e does the title contain the phrase "Randomized Controlled Trial"? (if not, explain the reason under "other") yes Other:

1a-i) Identify the mode of delivery in the title
Identify the mode of delivery. Preferably use "web-based" and/or "mobile" and/or "electronic game" in the title. Avoid ambiguous terms like "online", "virtual", "interactive". Use "Internet-based" only if Intervention includes non-web-based Internet components (e.g. email), use "computer-based" or "electronic" only if ooine products are used. Use "virtual" only in the context of "virtual reality" (3-D worlds). Use "online" only in the context of "online support groups". Complement or substitute product names with broader terms for the class of products (such as "mobile" or "smart phone" instead of "iphone"), especially if the application runs on different platforms. 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1a-i? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study A randomized controlled trial and process evaluation of a web-based therapy plus telephone support by a coach, compared with information about web-based resources, in depressed patients referred to secondary mental health care

1a-ii) Non-web-based components or important co-interventions in title
Mention non-web-based components or important co-interventions in title, if any (e.g., "with telephone support").

Does your paper address subitem 1a-ii?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study A randomized controlled trial and process evaluation of a web-based therapy plus telephone support by a coach, compared with information about web-based resources, in depressed patients referred to secondary mental health care

1a-iii) Primary condition or target group in the title
Mention primary condition or target group in the title, if any (e.g., "for children with Type I Diabetes") Example: A Web-based and Mobile Intervention with Telephone Support for Children with Type I Diabetes: Randomized Controlled Trial 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1a-iii? * Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study A randomized controlled trial and process evaluation of a web-based therapy plus telephone support by a coach, compared with information about web-based resources, in depressed patients referred to secondary mental health care 1b) ABSTRACT: Structured summary of trial design, methods, results, and conclusions NPT extension: Description of experimental treatment, comparator, care providers, centers, and blinding status.

1b-i) Key features/functionalities/components of the intervention and comparator in the METHODS section of the ABSTRACT
Mention key features/functionalities/components of the intervention and comparator in the abstract. If possible, also mention theories and principles used for designing the site. Keep in mind the needs of systematic reviewers and indexers by including important synonyms. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-i? * Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "The objective was to test in people referred to secondary care with depression if a web-based therapy (The Journal www.depression.org.nz) supported by an e-coach plus usual care would be more effective in reducing depression compared with usual care plus an information leaflet about on-line resources after twelve weeks." subitem not at all important essential Does your paper address subitem 1b-ii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study The e-coach had a background in occupational therapy.

1b-iii) Open vs. closed, web-based (self-assessment) vs. face-to-face assessments in the METHODS section of the ABSTRACT
Mention how participants were recruited (online vs. ooine), e.g., from an open access website or from a clinic or a closed online user group (closed usergroup trial), and clarify if this was a purely webbased trial, or there were face-to-face components (as part of the intervention or for assessment). Clearly say if outcomes were self-assessed through questionnaires (as common in web-based trials

Does your paper address subitem 1b-iii?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "Participants were recruited face to face. " 1b-iv) RESULTS section in abstract must contain use data CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi... 7/12/17, 3:34 PM Report number of participants enrolled/assessed in each group, the use/uptake of the intervention (e.g., attrition/adherence metrics, use over time, number of logins etc.), in addition to primary/secondary outcomes. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential Does your paper address subitem 1b-iv?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "We recruited 63 people into the trial (intervention 35 control 28). " "The process evaluation found that the mean number of lessons completed in the intervention group was 2.5 SD 1.9 (with a range of 0 to 6) and the number of contacts with the e-coach was a mean of 8.1 SD 4.4 (range 0 to 17). "

1b-v) CONCLUSIONS/DISCUSSION in abstract for negative trials
Conclusions/Discussions in abstract for negative trials: Discuss the primary outcome -if the trial is negative (primary outcome not changed), and the intervention was not used, discuss whether negative results are attributable to lack of uptake and discuss reasons. (Note: Only report in the abstract what the main paper is reporting. If this information is missing from the main body of text, consider adding it) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 1b-v?
Copy and paste relevant sections from the manuscript abstract (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study subitem not at all important essential Does your paper address subitem 2a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "However, most of the randomized controlled trials of web-based therapy have been in "community samples" often recruited from the internet. These populations are self-selecting and although their scores on depression rating scales may be comparable to clinical populations they often differ in terms of co-morbidity, duration of symptoms and impact on everyday activities. "

2b) In INTRODUCTION: SpeciUc objectives or hypotheses
Does your paper address CONSORT subitem 2b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "We hypothesized that patients who were coached by the e-case manager to progress through The Journal improved quicker, required fewer face to face appointments with clinicians and were more satisfied with their care than people who receive usual care. " METHODS 3a) Description of trial design (such as parallel, factorial) including allocation ratio Does your paper address CONSORT subitem 3a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "The design of the trial was a randomized controlled trial with two parallel groups." 3b) Important changes to methods after trial CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi... commencement (such as eligibility criteria), with reasons Does your paper address CONSORT subitem 3b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study No changes

3b-i) Bug Uxes, Downtimes, Content Changes
Bug Uxes, Downtimes, Content Changes: ehealth systems are often dynamic systems. A description of changes to methods therefore also includes important changes made on the intervention or comparator during the trial (e.g., major bug Uxes or changes in the functionality or content) (5-iii) and other "unexpected events" that may have inpuenced study design such as staff changes, system failures/downtimes, etc. [2].

Does your paper address subitem 3b-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

4a) Eligibility criteria for participants
Does your paper address CONSORT subitem 4a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "Potential participants were patients attending community mental health centers in Waitemata District Health Board (DHB) who had been referred with a problem of depression or dysthymia. We aimed to involve one community mental health centre in an urban area, one in a mixed rural urban area and the Maori mental health service, Moko. The main exclusion criteria were inability to read and write English or cognitive difficulties meaning that potential participants would be unable to use a computer. The presence of other co morbid conditions such as anxiety, suicidal thoughts, alcohol or drug disorders were not

4a-i) Computer / Internet literacy
Computer / Internet literacy is often an implicit "de facto" eligibility criterion -this should be explicitly clariUed.

Does your paper address subitem 4a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "If participants did not have access to a computer at home then one was provided in the mental health center. "

4a-ii) Open vs. closed, web-based vs. face-to-face assessments:
Open vs. closed, web-based vs. face-to-face assessments: Mention how participants were recruited (online vs. ooine), e.g., from an open access website or from a clinic, and clarify if this was a purely web-based trial, or there were face-to-face components (as part of the intervention or for assessment), i.e., to what degree got the study team to know the participant. In online-only trials, clarify if participants were quasi-anonymous and whether having multiple identities was possible or whether technical or logistical measures (e.g., cookies, email conUrmation, phone calls) were used to detect/prevent these.

2 3 4 5 subitem not at all important essential
Does your paper address subitem 4a-ii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study 7/12/17, 3:34 PM "Potential participants were patients attending community mental health centers in Waitemata District Health Board (DHB) who had been referred with a problem of depression or dysthymia. " "Potential participants were approached in person face to face after initial triage to ask for their consent to take part in the trial."

4a-iii) Information giving during recruitment
Information given during recruitment. Specify how participants were briefed for recruitment and in the informed consent procedures (e.g., publish the informed consent documentation as appendix, see also item X26), as this information may have an effect on user self-selection, user expectation and may also bias results.

Does your paper address subitem 4a-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study See appendix for consent procedures 4b) Settings and locations where the data were collected Does your paper address CONSORT subitem 4b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "For measures other than the PHQ-9 participants were mailed questionnaires to return in pre-paid envelopes or they completed the questionnaires over the phone. " CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi...

4b-i) Report if outcomes were (self-)assessed through online questionnaires
Clearly report if outcomes were (self-)assessed through online questionnaires (as common in webbased trials) or otherwise.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 4b-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study "The primary outcome measure was the PHQ-9, a brief self-rating scale for depression which is built into The Journal, measured at 12 weeks. "

4b-ii) Report how institutional a.liations are displayed
Report how institutional atliations are displayed to potential participants [on ehealth media], as atliations with prestigious hospitals or universities may affect volunteer rates, use, and reactions with regards to an intervention.(Not a required item -describe only if this may bias results) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 4b-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Not on the website. University logo obligatory on the consent and information forms.

5)
The interventions for each group with sutcient details to allow replication, including how and when they were actually administered

5-i) Mention names, credential, a.liations of the developers, sponsors, and owners
Mention names, credential, atliations of the developers, sponsors, and owners [6] (if authors/evaluators are owners or developer of the software, this needs to be declared in a "Conpict of interest" section or mentioned elsewhere in the manuscript).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study " "The Journal" [16] a free internet based program for the selfmanagement of depression was developed in New Zealand by the Ministry of Health "

5-ii) Describe the history/development process
Describe the history/development process of the application and previous formative evaluations (e.g., focus groups, usability testing), as these will have an impact on adoption/use rates and help with interpreting results.

Does your paper address subitem 5-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-iii) Revisions and updating
Revisions and updating. Clearly mention the date and/or version number of the application/intervention (and comparator, if applicable) evaluated, or describe whether the intervention underwent major changes during the evaluation process, or whether the development and/or content was "frozen" during the trial. Describe dynamic components such as news feeds or changing content which may have an impact on the replicability of the intervention (for unexpected events see item 3b).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-iv) Quality assurance methods
Provide information on quality assurance methods to ensure accuracy and quality of information provided [1], if applicable.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-iv?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Not applicable

5-v) Ensure replicability by publishing the source code, and/or providing screenshots/screencapture video, and/or providing ^owcharts of the algorithms used
Ensure replicability by publishing the source code, and/or providing screenshots/screen-capture video, and/or providing powcharts of the algorithms used. Replicability (i.e., other researchers should in principle be able to replicate the study) is a hallmark of scientiUc reporting.

Does your paper address subitem 5-v?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study See webcitation

5-vi) Digital preservation
Digital preservation: Provide the URL of the application, but as the intervention is likely to change or disappear over the course of the years; also make sure the intervention is archived (Internet Archive, webcitation.org, and/or publishing the source code or screenshots/videos alongside the article). As pages behind login screens cannot be archived, consider creating demo pages which are accessible without login.

Does your paper address subitem 5-vi?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-vii) Access
Access: Describe how participants accessed the application, in what setting/context, if they had to pay (or were paid) or not, whether they had to be a member of speciUc group. If known, describe how participants obtained "access to the platform and Internet" [1]. To ensure access for editors/reviewers /readers, consider to provide a "backdoor" login account or demo mode for reviewers/readers to explore the application (also important for archiving purposes, see vi).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-vii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study subitem not at all important essential Does your paper address subitem 5-viii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-ix) Describe use parameters
Describe use parameters (e.g., intended "doses" and optimal timing for use). Clarify what instructions CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi... or recommendations were given to the user, e.g., regarding timing, frequency, heaviness of use, if any, or was the intervention used ad libitum.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-ix?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-x) Clarify the level of human involvement
Clarify the level of human involvement (care providers or health professionals, also technical assistance) in the e-intervention or as co-intervention (detail number and expertise of professionals involved, if any, as well as "type of assistance offered, the timing and frequency of the support, how it is initiated, and the medium by which the assistance is delivered". It may be necessary to distinguish between the level of human involvement required for the trial, and the level of human involvement required for a routine application outside of a RCT setting (discuss under item 21 -generalizability).

Does your paper address subitem 5-x?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes "For those participants in the intervention group the intervention consisted of: i) An invitation to use The Journal supported by an e-case manager who provided patients with weekly email or telephone contact. The e-case manager had a guideline script for each lesson of The Journal to reinforce the topic of each lesson, help identify and support patients in their goals and to coach them in goal setting and the techniques of problem solving. The e-case manager provided a brief summary for the

5-xi) Report any prompts/reminders used
Report any prompts/reminders used: Clarify if there were prompts (letters, emails, phone calls, SMS) to use the application, what triggered them, frequency etc. It may be necessary to distinguish between the level of prompts/reminders required for the trial, and the level of prompts/reminders for a routine 7/12/17, 3:34 PM application outside of a RCT setting (discuss under item 21 -generalizability).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-xi? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

5-xii) Describe any co-interventions (incl. training/support)
Describe any co-interventions (incl. training/support): Clearly state any interventions that are provided in addition to the targeted eHealth intervention, as ehealth intervention may not be designed as standalone intervention. This includes training sessions and support [1]. It may be necessary to distinguish between the level of training required for the trial, and the level of training for a routine application outside of a RCT setting (discuss under item 21 -generalizability.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 5-xii? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 6a) Completely deUned pre-speciUed primary and secondary outcome measures, including how and when they were assessed 7/12/17, 3:34 PM Does your paper address CONSORT subitem 6a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

6a-i) Online questionnaires: describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed
If outcomes were obtained through online questionnaires, describe if they were validated for online use and apply CHERRIES items to describe how the questionnaires were designed/deployed [9].

6a-ii) Describe whether and how "use" (including intensity of use/dosage) was deUned/measured/monitored
Describe whether and how "use" (including intensity of use/dosage) was deUned/measured /monitored (logins, logUle analysis, etc.). Use/adoption metrics are important process outcomes that should be reported in any ehealth trial.

6a-iii) Describe whether, how, and when qualitative feedback from participants was obtained
Describe whether, how, and when qualitative feedback from participants was obtained (e.g., through emails, feedback forms, interviews, focus groups).

Does your paper address subitem 6a-iii?
Copy and paste relevant sections from manuscript text Yes "We conducted a process evaluation to explore the implementation, receipt and context of the intervention with a view to helping understand the results in accordance with the Medical Research Council's guidelines on assessing complex interventions [17]. We documented the number of lessons completed and the number of email and phone contacts from the e-coach. We also conducted structured interviews with a purposive sample of patients and clinicians to assess barriers, facilitators and suggestions for improvement." 6b) Any changes to trial outcomes after the trial commenced, with reasons Does your paper address CONSORT subitem 6b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study No 7a) How sample size was determined NPT: When applicable, details of whether and how the clustering by care provides or centers

7a-i) Describe whether and how expected attrition was taken into account when calculating the sample size
Describe whether and how expected attrition was taken into account when calculating the sample size.

Does your paper address subitem 7a-i?
Copy and paste relevant sections from manuscript title (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes "Sample size Using the PHQ-9 in this patient group based on other studies we expected the mean pre-treatment score to be about 17 with a standard deviation of 4. To detect a difference in score between the two groups of 3 points, which would be clinically significant, would need 30 people in each group with a two sided alpha of 0.05 and a power of 80%. Allowing for a 25% drop out rate we aimed to recruit a total of 80 participants."

7b) When applicable, explanation of any interim analyses and stopping guidelines
Does your paper address CONSORT subitem 7b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 8b) Type of randomisation; details of any restriction (such as blocking and block size) Does your paper address CONSORT subitem 8b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study No restriction 9) Mechanism used to implement the random allocation sequence (such as sequentially numbered containers), describing any steps taken to conceal the sequence until interventions were assigned Does your paper address CONSORT subitem 9? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study 10) Who generated the random allocation sequence, who enrolled participants, and who assigned participants to interventions Does your paper address CONSORT subitem 10? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 11a) If done, who was blinded after assignment to interventions (for example, participants, care providers, those assessing outcomes) and how NPT: Whether or not administering co-interventions were blinded to group assignment

11a-i) Specify who was blinded, and who wasn't
Specify who was blinded, and who wasn't. Usually, in web-based trials it is not possible to blind the participants [1, 3] (this should be clearly acknowledged), but it may be possible to blind outcome assessors, those doing data analysis or those administering co-interventions (if any).

2 3 4 5
subitem not at all important essential Does your paper address subitem 11a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

Yes "Blinding
The clinicians were not blind to whether their patients are using The Journal. There was also the problem of contamination. First the clinicians could use The Journal with patients allocated to the usual care group and second The Journal is freely available on-line so any participant in the study could access it. There was little we could do to prevent clinicians and patients from using The Journal who were not in the intervention group. However, our experience is that it is not widely interest" and which one was the "comparator" Informed consent procedures (4a-ii) can create biases and certain expectations -discuss e.g., whether participants knew which intervention was the "intervention of interest" and which one was the "comparator".

Does your paper address subitem 11a-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 11b) If relevant, description of the similarity of interventions (this item is usually not relevant for ehealth trials as it refers to similarity of a placebo or sham intervention to a active medication/intervention) Does your paper address CONSORT subitem 11b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 12a) Statistical methods used to compare groups for primary and secondary outcomes NPT: When applicable, details of whether and how the clustering by care providers or centers was addressed

12a-i) Imputation techniques to deal with attrition / missing values
Imputation techniques to deal with attrition / missing values: Not all participants will use the intervention/comparator as intended and attrition is typically high in ehealth trials. Specify how participants who did not use the application or dropped out from the trial were treated in the statistical analysis (a complete case analysis is strongly discouraged, and simple imputation techniques such as LOCF may also be problematic [4]).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 12a-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 12b) Methods for additional analyses, such as subgroup analyses and adjusted analyses Does your paper address CONSORT subitem 12b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study X26) REB/IRB Approval and Ethical Considerations [recommended as subheading under "Methods"] (not a CONSORT item)

X26-i) Comment on ethics committee approval
1 2 3 4 5 subitem not at all important essential

Does your paper address subitem X26-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes "Signed informed consent was received from participants and the study received ethical approval from the New Zealand Central Health and Disability Ethics Committee ref 12/CEN/53."

x26-ii) Outline informed consent procedures
Outline informed consent procedures e.g., if consent was obtained ooine or online (how? Checkbox, etc.?), and what information was provided (see 4a-ii). See [6] for some items to be included in informed consent documents.

Does your paper address subitem X26-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study 7/12/17, 3:34 PM

X26-iii) Safety and security procedures
Safety and security procedures, incl. privacy considerations, and any steps taken to reduce the likelihood or detection of harm (e.g., education and training, availability of a hotline) 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem X26-iii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

RESULTS
13a) For each group, the numbers of participants who were randomly assigned, received intended treatment, and were analysed for the primary outcome NPT: The number of care providers or centers performing the intervention in each group and the number of patients treated by each care provider in each center Does your paper address CONSORT subitem 13a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi...
28 of 42 7/12/17, 3:34 PM Yes 13b) For each group, losses and exclusions after randomisation, together with reasons Does your paper address CONSORT subitem 13b? (NOTE: Preferably, this is shown in a CONSORT ^ow diagram) * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

13b-i) Attrition diagram
Strongly recommended: An attrition diagram (e.g., proportion of participants still logging in or using the intervention/comparator in each group plotted over time, similar to a survival curve) or other Ugures or tables demonstrating usage/dose/engagement. 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 13b-i?
Copy and paste relevant sections from the manuscript or cite the Ugure number if applicable (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study 14a) Dates deUning the periods of recruitment and follow-up Does your paper address CONSORT subitem 14a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes "Participants were recruited from February to October 2013"

14a-i) Indicate if critical "secular events" fell into the study period
Indicate if critical "secular events" fell into the study period, e.g., signiUcant changes in Internet resources available or "changes in computer hardware or Internet delivery resources" 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 14a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study No 14b) Why the trial ended or was stopped (early) Does your paper address CONSORT subitem 14b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study 7/12/17, 3:34 PM

15-i) Report demographics associated with digital divide issues
In ehealth trials it is particularly important to report demographics associated with digital divide issues, such as age, education, gender, social-economic status, computer/Internet/ehealth literacy of the participants, if known.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 15-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study No 16) For each group, number of participants (denominator) included in each analysis and whether the analysis was by original assigned groups

16-i) Report multiple "denominators" and provide deUnitions
Report multiple "denominators" and provide deUnitions: Report N's (and effect sizes) "across a range of study participation [and use] thresholds" [1], e.g., N exposed, N consented, N used more than x times, N used more than y weeks, N participants "used" the intervention/comparator at speciUc pre-deUned time points of interest (in absolute and relative numbers per group). Always clearly deUne "use" of the intervention.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 16-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

16-ii) Primary analysis should be intent-to-treat
Primary analysis should be intent-to-treat, secondary analyses could include comparing only "users", with the appropriate caveats that this is no longer a randomized sample (see 18-i).

Does your paper address subitem 16-ii?
CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi... 7/12/17, 3:34 PM Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 17a) For each primary and secondary outcome, results for each group, and the estimated effect size and its precision (such as 95% conUdence interval) Does your paper address CONSORT subitem 17a? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

17a-i) Presentation of process outcomes such as metrics of use and intensity of use
In addition to primary/secondary (clinical) outcomes, the presentation of process outcomes such as metrics of use and intensity of use (dose, exposure) and their operational deUnitions is critical. This does not only refer to metrics of attrition (13-b) (often a binary variable), but also to more continuous exposure metrics such as "average session length". These must be accompanied by a technical description how a metric like a "session" is deUned (e.g., timeout after idle time) [1] (report under item 6a).

Does your paper address subitem 17a-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 17b) For binary outcomes, presentation of both absolute and relative effect sizes is recommended Does your paper address CONSORT subitem 17b? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 18) Results of any other analyses performed, including subgroup analyses and adjusted analyses, distinguishing pre-speciUed from exploratory Does your paper address CONSORT subitem 18? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

18-i) Subgroup analysis of comparing only users
A subgroup analysis of comparing only users is not uncommon in ehealth trials, but if done, it must be stressed that this is a self-selected sample and no longer an unbiased sample from a randomized trial (see 16-iii).

Does your paper address subitem 18-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

19) All important harms or unintended effects in each group
(for speciUc guidance see CONSORT for harms)

Does your paper address CONSORT subitem 19? *
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

19-i) Include privacy breaches, technical problems
Include privacy breaches, technical problems. This does not only include physical "harm" to participants, but also incidents such as perceived or real privacy breaches [1], technical problems, and other unexpected/unintended incidents. "Unintended effects" also includes unintended positive effects [2].

Does your paper address subitem 19-i?
CONSORT-EHEALTH (V 1.6.1) -Submission/Publication Form https://docs.google.com/forms/d/e/1FAIpQLSfZBSUp1bwOc_Oi... 7/12/17, 3:34 PM Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

19-ii) Include qualitative feedback from participants or observations from staff/researchers
Include qualitative feedback from participants or observations from staff/researchers, if available, on strengths and shortcomings of the application, especially if they point to unintended/unexpected effects or uses. This includes (if available) reasons for why people did or did not use the application as intended by the developers.

Does your paper address subitem 19-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

DISCUSSION
22) Interpretation consistent with results, balancing beneUts and harms, and considering other relevant evidence NPT: In addition, take into account the choice of the comparator, lack of or partial blinding, and unequal expertise of care providers or centers in each group

22-i) Restate study questions and summarize the answers suggested by the data, starting with primary outcomes and process outcomes (use)
Restate study questions and summarize the answers suggested by the data, starting with primary 7/12/17, 3:34 PM outcomes and process outcomes (use).
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 22-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

22-ii) Highlight unanswered new questions, suggest future research
Highlight unanswered new questions, suggest future research.

Does your paper address subitem 22-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 20) Trial limitations, addressing sources of potential bias, imprecision, and, if relevant, multiplicity of analyses

20-i) Typical limitations in ehealth trials
Typical limitations in ehealth trials: Participants in ehealth trials are rarely blinded. Ehealth trials often look at a multiplicity of outcomes, increasing risk for a Type I error. Discuss biases due to non-use of the intervention/usability issues, biases through informed consent procedures, unexpected events.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 20-i? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 21) Generalisability (external validity, applicability) of the trial Undings NPT: External validity of the trial Undings according to the intervention, comparators, patients, and care providers or centers involved in the trial

21-i) Generalizability to other populations
Generalizability to other populations: In particular, discuss generalizability to a general Internet population, outside of a RCT setting, and general patient population, including applicability of the study results for other organizations 1 2 3 4 5 subitem not at all important essential

Does your paper address subitem 21-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Discuss if there were elements in the RCT that would be different in a routine application setting (e.g., prompts/reminders, more human involvement, training sessions or other co-interventions) and what impact the omission of these elements could have on use, adoption, or outcomes if the intervention is applied outside of a RCT setting.
1 2 3 4 5 subitem not at all important essential Does your paper address subitem 21-ii?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

23) Registration number and name of trial registry
Does your paper address CONSORT subitem 23? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 24) Where the full trial protocol can be accessed, if available Does your paper address CONSORT subitem 24? * Cite a Multimedia Appendix, other reference, or copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study Yes 25) Sources of funding and other support (such as supply of drugs), role of funders Does your paper address CONSORT subitem 25? * Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study

X27-i) State the relation of the study team towards the system being evaluated
In addition to the usual declaration of interests (Unancial or otherwise), also state the relation of the study team towards the system being evaluated, i.e., state if the authors/evaluators are distinct from or identical with the developers/sponsors of the intervention.

Does your paper address subitem X27-i?
Copy and paste relevant sections from the manuscript (include quotes in quotation marks "like this" to indicate direct quotes from your manuscript), or elaborate on this item by providing additional information not in the ms, or briepy explain why the item is not applicable/relevant for your study