This paper is in the following e-collection/theme issue:

Innovations in Mental Health Systems (390) Web-based and Mobile Health Interventions (3297) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1514) eHealth Infrastructures (345)

Published on in Vol 1, No 1 (2014): Jul-Dec

Implementation and Outcomes of a Collaborative Multi-Center Network Aimed at Web-Based Cognitive Training – COGWEB Network

Implementation and Outcomes of a Collaborative Multi-Center Network Aimed at Web-Based Cognitive Training – COGWEB Network

Implementation and Outcomes of a Collaborative Multi-Center Network Aimed at Web-Based Cognitive Training – COGWEB Network

Authors of this article:

Vítor Tedim Cruz1, 2 Author Orcid Image ;   Joana Pais3 Author Orcid Image ;   Luis Ruano1, 4 Author Orcid Image ;   Cátia Mateus3 Author Orcid Image ;   Márcio Colunas1 Author Orcid Image ;   Ivânia Alves1 Author Orcid Image ;   Rui Barreto1 Author Orcid Image ;   Eduardo Conde1 Author Orcid Image ;   Andreia Sousa3 Author Orcid Image ;   Isabel Araújo1 Author Orcid Image ;   Virgílio Bento1, 5 Author Orcid Image ;   Paula Coutinho6 Author Orcid Image ;   Nelson Rocha2 Author Orcid Image ;   COGWEB Network Collaborators7
Article Authors Cited by (7) Tweetations (3) Metrics

    Original Paper

    1Hospital São Sebastião, Centro Hospitalar Entre Douro e Vouga, Neurology Department, Santa Maria da Feira, Portugal

    2Clinical Research Office, Health Sciences Department, University of Aveiro, Aveiro, Portugal

    3Hospital São Sebastião, Centro Hospitalar Entre Douro e Vouga, Neuropsychology Laboratory, Neurology Department, Santa Maria da Feira, Portugal

    4Public Health Institute - ISPUP, University of Porto, Porto, Portugal

    5University Institute of Maia - ISMAI, Maia, Portugal

    6UnIGENe, Instituto de Biologia Molecular e Celular, University of Porto, Porto, Portugal

    7COGWEB network, Lisbon, Portugal

    Corresponding Author:

    Vítor Tedim Cruz, MD

    Hospital São Sebastião, Centro Hospitalar Entre Douro e Vouga

    Neurology Department

    Rua Dr. Cândido de Pinho

    Santa Maria da Feira, 4520-211

    Portugal

    Phone: 351 936173516

    Fax:351 256373867

    Email: vitor.cruz@chedv.min-saude.pt


    Background: Cognitive care for the most prevalent neurologic and psychiatric conditions will only improve through the implementation of new sustainable approaches. Innovative cognitive training methodologies and collaborative professional networks are necessary evolutions in the mental health sector.

    Objective: The objective of the study was to describe the implementation process and early outcomes of a nationwide multi-organizational network supported on a Web-based cognitive training system (COGWEB).

    Methods: The setting for network implementation was the Portuguese mental health system and the hospital-, academic-, community-based institutions and professionals providing cognitive training. The network started in August 2012, with 16 centers, and was monitored until September 2013 (inclusions were open). After onsite training, all were allowed to use COGWEB in their clinical or research activities. For supervision and maintenance were implemented newsletters, questionnaires, visits and webinars. The following outcomes were prospectively measured: (1) number, (2) type, (3) time to start, and (4) activity state of centers; age, gender, level of education, and medical diagnosis of patients enrolled.

    Results: The network included 68 professionals from 41 centers, (33/41) 80% clinical, (8/41) 19% nonclinical. A total of 298 patients received cognitive training; 45.3% (n=135) female, mean age 54.4 years (SD 18.7), mean educational level 9.8 years (SD 4.8). The number enrolled each month increased significantly (r=0.6; P=.031). At 12 months, 205 remained on treatment. The major causes of cognitive impairment were: (1) neurodegenerative (115/298, 38.6%), (2) structural brain lesions (63/298, 21.1%), (3) autoimmune (40/298, 13.4%), (4) schizophrenia (30/298, 10.1%), and (5) others (50/298, 16.8%). The comparison of the patient profiles, promoter versus all other clinical centers, showed significant increases in the diversity of causes and spectrums of ages and education.

    Conclusions: Over its first year, there was a major increase in the number of new centers and professionals, as well as of the clinical diversity of patients treated. The consolidation of such a national collaborative network represents an innovative step in mental health care evolution. Furthermore, it may contribute to translational processes in the field of cognitive training and reduce disease burden.

    JMIR Mental Health 2014;1(1):e2

    doi:10.2196/mental.3840

    Keywords

    cognitive training; neurorehabilitation; eHealth systems; memory clinic; collaborative network; stroke; dementia; schizophrenia; mental health services 


    Professional Collaborative Networks and Cognition Care

    The evolution of health systems is increasingly dependent on professional collaborative networks [1,2]. This type of solution has been thoroughly explored in social, governmental, commercial, and enterprise competitive settings [3,4]. Nonetheless, in the health care setting, there is a limited understanding of the network dynamics, internal processes, key structural features, or how to evaluate their outcomes [5-7].

    In general, professionals see collaboration as necessary, and their main expectations are to establish interprofessional relations that would lead to greater efficiency, better knowledge of other institutions, and professional support [8]. However, most health care settings are prone to generate isolated clusters, like professional groups, medical specialties, organization departments, and units [9]. They usually are kept apart due to physical, cultural, cognitive, or trust barriers [10].

    The mental health sector, mainly due to demographic and economic constraints on health resources, is under increasing pressure to self-reshape and implement new sustainable approaches [11-13]. This situation has been enlightening groups and key players, at several hierarchic levels of decision, to the advantages of working together in search of synergies and more effective ways to deliver mental care [2,11,14].

    Cognitive deficits associated with the most prevalent neurologic and psychiatric diseases represent 11.2% of the global burden of disease worldwide, accounting each year for 30 new cases per 1000 inhabitants [15]. Nowadays, treatment of cognitive deficits largely relies on specialized human mediated interventions (eg, cognitive rehabilitation, training, stimulation, or remediation), with pharmacological options far from playing an important role [16]. The combination of these factors renders most mental health systems worldwide largely unable to meet cognitive rehabilitation needs, either in due time after injury or adequate intensities [2]. To adequately meet these new demand patterns without increasing health care costs, sustainable organizational changes are necessary [2,17]. In addition, the clinical use of information technology based systems is known to improve cognitive interventions, namely their intensity, patient adherence, and quality of professional monitoring [18-21].

    An Innovative Web-Based Cognitive Training System

    With this global scenery in mind, starting in 2005 in a memory clinic setting, we developed an innovative Web-based cognitive training system, named COGWEB and described elsewhere [22-24]. Over time, the system evolved to address the needs of patients, professionals, and organizations in the field of cognitive rehabilitation [22,25]. It was designed to: (1) improve the efficiency of home-based cognitive training procedures; (2) increase patient access to care; (3) shift the therapeutic footprint from hospital to patient comfort zones; and most importantly, (4) to foster collaborative work between professionals from geographically distributed centers [24,25]. This set of characteristics made the COGWEB system especially suited to be the promoter of a new collaborative network, sharing specialized knowledge, improved procedures, innovative tools, and connecting professionals and institutions dedicated to cognitive rehabilitation.

    The aim of this paper is to describe the implementation, early outcomes, and sustainability, over its first year of functioning, of a nationwide multi-organizational cognitive interventional network, taking advantage of the characteristics of an innovative Web-based cognitive training system.


    National Setting

    Cognitive Interventions

    The Portuguese mental health sector has some specificities [26], nevertheless most of its organization is comparable to Western European models of care [15,27]. Neuropsychological rehabilitation is performed in different and almost unrelated settings in Portugal [28]. If we consider all forms of cognitive intervention provided (rehabilitation, training, stimulation, or remediation) along mental health services, as defined by the World Health Organization [15,27] and the National mental health plan [26,29], we may group them in the following ways.

    Referral Institutions With Medical Supervision or Integrated in Multi-disciplinary Clinical Departments

    The adult outpatient memory clinics in neurology and psychiatry departments are mainly dedicated to neuropsychological assessment, but some of them are also interested in providing rehabilitation care.

    The day centers within psychiatric clinics and departments are dedicated to patients with schizophrenia, major depression, or bipolar disorder. Some of them provide social and cognitive remediation programs.

    The referral rehabilitation hospitals are chiefly dedicated to traumatic brain injury patients and young patients with anoxic damage, stroke, multiple sclerosis, encephalitis, and postneurosurgery.

    The outpatient rehabilitation clinics are largely run by rehabilitation medicine specialists and dedicated to motor rehabilitation of neurologic diseases, but they are developing a growing interest for cognitive rehabilitation.

    The developmental clinics in pediatric departments are primarily concerned with early detection of motor and mental delays, and psychosocial interventions, a few of them having specialized human resources dedicated to cognitive rehabilitation.

    Community Services, Supervised by Allied Health Professionals Including Psychologists, Occupational Therapists, Social Workers, or Rehabilitation Nurses

    The community day centers and residential facilities dedicated to neurodegenerative diseases and providing cognitive care are mainly focused in cognitive stimulation and training of activities of daily living.

    The community day centers and residential services are dedicated to children and adults with cerebral palsy and other inborn causes of intellectual disability.

    Community Services Related With the Educational System, Not Included in the Health System

    There are psychology and special education services at schools of the National Ministry of Education. There are also study centers dedicated to the compensation of learning difficulties. Additionally, there are adult and senior learning services.

    Academic Centers Dedicated to Basic and Clinical Neurosciences

    These centers are generally in partnership with institutions from the above categories.

    Patient Care Limitations

    In spite of the variety of services, patient access to care is limited by several important factors: (1) the location of patients’ home (urban vs suburban or rural), (2) socioeconomic status, (3) mobility, and (4) the level of education of patients and families [26,27]. Furthermore, National Health Service standards of care do not include global access to cognitive interventions [29]. This leads to great heterogeneity on the level of service available, and the type of providers (private vs governmental) between regions [28]. The standards of professional care and practices, certification and training, and how those standards are maintained over time are also not perfectly established [27,28]. Outside of hospitals or other medical institutions, the clinical responsibility for cognitive interventions or local multi-disciplinary teams’ coordination is difficult to understand solely based on professional certification and specialized training [26,28,29].

    Promoter Center Setting

    The clinical center where the initial research and development of COGWEB took place was an outpatient memory clinic. This was based in a neurology department in a tertiary hospital that provided care to 400,000 inhabitants. The resident clinical staff included neurologists and neuropsychologists. Patients with suspected cognitive deficits, irrespective of their cause, were referred to this clinic for diagnosis and rehabilitation by other neurologists, neurosurgeons, psychiatrists, rehabilitation medicine physicians, pediatricians, internists, or general practitioners [23].

    Development and Main Functionalities of COGWEB

    The COGWEB system is a Web-based working tool that allows for the implementation of personalized cognitive training programs remotely, in the hospital, or patient’s living environment, under continuous supervision by experienced neuropsychologists [24]. Its development started in 2005, and the first clinical center initiated its use in 2007 (promoter center). Then, the system underwent a five-year period of further technological development, refinement, and thorough clinical testing [24]. Over the last three years, this Web-based cognitive training system was integrated into regular clinical practice at the promoter center. This option led to a threefold increase in patient access to supervised cognitive training and, on average, a sevenfold increase in rehabilitation training time, while maintaining human resources expenditures [23]. More recently, a cohort study provided data on patient adherence and intensity of training obtained using this instrument over long periods of time in a common outpatient memory clinic setting [25]. The version used for this study was composed of 30 independent exercises in a computerized game format. They were developed to train various degrees of impairments in specific cognitive domains, such as attention, executive functions, memory, language, praxis, gnosis, and calculus [23,24]. The training sessions were individually prescribed on the Internet by a therapist, just after thorough cognitive assessment and according to personalized plans discussed face-to-face with each patient, as previously described [25]. Internet activities performed by the patients were summarized in several progress graphs (eg, right answers vs wrong answers, levels completed, global training time, or accesses) that were revised weekly by the professional in charge. This information was used to monitor patient’s evolution, as well as to elaborate progress reports or to aid motivation [23,24].

    Network Implementation Procedures

    In March 2012, the most important clinical actors and institutions in the field of cognitive impairment assessment, diagnosis, and treatment in Portugal were invited to join the COGWEB network. The institutions included psychiatry, neurology, and rehabilitation medicine departments, as well as more specialized units within these structures like memory and dementia clinics, schizophrenia clinics, day hospitals, and residential facilities. At the time two national workshop meetings were organized to present the COGWEB system and the results of the first clinical studies. Additionally, actors were invited to talk about their clinical settings and difficulties to implement cognitive intervention programs in everyday practice. During the meetings all were allowed to experiment with the COGWEB system, and were formally invited to participate in a collaborative network, due to start in the near future, and with the main purposes of: (1) democratize patient access to specialized Web-based cognitive stimulation, training, or rehabilitation services; (2) putting Web-based cognitive intervention knowledge into routine practice; (3) further develop and tailor the COGWEB system to the needs and requirements of all professionals that use it in their clinical settings, and patients in their communities; (4) foster multi-center research studies in the field of cognitive rehabilitation; and (5) create the environment necessary to foster translational pathways in the field of cognitive neuroscience. The centers that initially accepted to participate in the network were considered as the baseline group. As the network operated as an open system, all centers that joined thereafter were considered new centers for the analysis.

    Network Maintenance Procedures

    All centers that decided to adopt the COGWEB system were visited in person by the network founders (VTC and JP), and received the COGWEB training manuals and in-house formation on how to use the system [23,30]. The first visit had an average duration of 2 hours, and included a session with all the clinical staff enrolled in activities with patients having cognitive deficits (eg, physicians, psychologists, therapists, and nurses). This was followed by a practical workshop with the local responsible neuropsychologist and other team staff such as therapists. During this visit, a second encounter was scheduled to discuss the treatment plans of the first patients to enroll in Web-based cognitive training activities.

    The final decision to include patients was the responsibility of the local professionals that selected who could benefit the most from the Web-based cognitive training. There were no restrictions related with medical diagnosis or severity of deficits.

    Between visits, all centers were regularly updated on new functionalities of the system (eg, an automatic report tool, performance and assiduity alerts, tutorial videos, and Internet manual), availability of new cognitive training exercises (number went from 17 to 34 during the first year of functioning), the results of quality assessment questionnaires to patients and caregivers, and the results of research study protocols and scientific presentations at national and international meetings. This information was passed in newsletter format by email to the local responsible, and also in part diffused in the blog at the project Web page [22], and at the Facebook page. To incorporate professionals’ points-of-view toward the COGWEB system, these actors were challenged to fill opinion Web-questionnaires using Google Docs. The founders’ efforts to improve quality of use of the system by the professionals in active centers included regular in person visits or webinars using Skype and Google Hangouts to discuss patients and methods, with the centers that were comfortable with this type of communication. Web presentations were also used (eg, good practice advice on how to program daily sessions, information on how to use COGWEB materials in exercise book format, and clinical vignettes).

    Ethical Issues

    All professionals signed a specific written informed consent. All patients and caregivers also provided written informed consent. This study was approved by the hospital review board and local ethics commission at Hospital São Sebastião, Centro Hospitalar de Entre o Douro e Vouga, Santa Maria da Feira, Portugal (chair, Rui Carrapato, MD, PhD) and Portuguese National Data Protection Commission.

    Financial Issues

    Each center that was enrolled in the COGWEB network paid an annual fee to cover training costs, materials, and development of the system. These fees were supported by the centers themselves, research funding, or by third party sponsors listed in the Conflicts of Interest section. The average cost of using the system amounted to US $8.05 per patient and per month (taxes included). Human resources to manage the system locally were the responsibility of the centers.

    Study Flow

    There were 68 professionals from 41 centers that received formal training on the COGWEB system during the first year of functioning of the COGWEB network (Figure 1 shows this). The network behavior of these centers was analyzed between August 2012 and September 2013, according to the variables defined for the study.

    ‎
    Figure 1. Study flowchart.
    View this figure

    Outcomes Definition and Analysis

    To evaluate the network as a whole, the centers included were classified as clinical centers, if they were primarily dedicated to clinical activities, or nonclinical centers, if they were focused in research, professional training, and other activities. Additionally, all centers were classified according to the overall services they provided and positioning on the national mental health system setting (Table 1). The number and type of new centers and professionals that joined during the first year of implementation were the elements used to assess the network growth and degree of diversity.

    For the subset of the network primarily concerned with clinical activities, the following outcomes were used: (1) number of patients enrolled in Web-based cognitive training activities; (2) number of new patients enrolled per month; (3) characteristics of the patients enrolled (age, gender, level of education, profession, and medical diagnosis); (4) time to start enrolling patients after initial training visit (months); and (5) number of active clinical centers after 1 year, defined as those centers that have patients under treatment at 1 year.

    The outcomes (1) and (2) evaluated clinical network growth and the impact on patient access to cognitive treatments. Linear regression was used to identify any time trend in the number of new patients recruited per month. The outcome (3) was concerned with characterization of patient profiles at the centers, and used to compare the profile of the patients enrolled in the first clinical center (promoter) with that in other centers of the network primarily focused in clinical activities. This comparison was used to assess the global impact of the COGWEB network on the diversity of patients (spectra of age and level of education) and diseases offered supervised Web-based cognitive training. This analysis was performed using Student’s t test, chi-square, or Fisher’s exact tests.

    Finally, the outcomes (4) and (5), combined with outcome (2) were used to obtain knowledge on operative network functioning and long-term sustainability. The median time to start enrolling patients was compared among type of center using the Wilcoxon rank test. All the statistical analysis was performed using the SPSS 20.0 statistical package, considering an alpha = 0.05.


    Characteristics of the Baseline Centers

    The network was initiated in August 2012 with a membership of 16 institutions and 29 health professionals willing to integrate the COGWEB system in their routine (Table 1). These professionals were mainly neuropsychologists and psychologists; two were occupational therapists. The initial centers were all hospital-based clinics, 14 inserted in neurology or psychiatry departments, one in a rehabilitation medicine department, and another in research academic facilities next to a large tertiary center.

    Table 1. Major types of centers in the network at baseline and 1 year of follow-up (number of centers, trained professionals, and patients enrolled per major category of center).

    		Baseline1 year
    CentersCentersProfessionalsCentersProfessionalsPatients enrolled
    Clinical





    		1. Outpatient clinics in neurology or psychiatry hospital departmentsb14251938209

    		2. Outpatient clinics in rehabilitation hospital departmentsb12122

    		3. Outpatient clinics in pediatric hospital departmentsb--11a

    		4. Community day carec--2310

    		5. Community private practices run by neuropsychologistsc--8842

    		6. Occupational psychology practice in a major companyc--1115

    		7. Psychology office at a second grade schoolc--1120
    Subtotal15273354298
    Nonclinical





    		8. Academic clinical researchd1238163

    		9. Academic basic researchd--1220

    		10. Postgraduate professional trainingd--11NAe

    		11. Adult learning institutesc--3360
    Subtotal12814243
    Combined total16294168541

    aThe single center in this category was waiting for the initial training visit at the end of study.

    bHospital-based

    cCommunity-based

    dAcademic/education-based

    eNA = Not applicable

    Characteristics of the Professionals and Centers at 1 Year of Network Functioning

    The number of professionals that received specialized training within the network went from 29 to 68 (60 psychologists or neuropsychologists, 4 occupational therapists, 2 neurology residents, 1 psychiatrist, and 1 neurosciences researcher). The mean age of the professionals was 38.1 years (SD 8.8), 83% (57/68) female.

    During the first 12 months of functioning, 25 additional centers joined the COGWEB network, from 16 at baseline. There are two of the new centers that have recently joined and were waiting to receive formal training. A total of 41 centers were part of the final analysis. Furthermore, 33 of these centers were classified as clinical (33/41, 80%), while 8 were considered nonclinical and focused in academic research, postgraduate training, or stimulation of normal adults (8/41, 19%) (Table 1).

    Considering the services provided by the 25 new centers, 7 belonged to 2 of the initial existing categories (outpatient clinics in neurology or psychiatry departments and academic clinical research centers), and 18 represented 8 new categories of centers (Table 1). At one year, there were 11 different types of centers that could be additionally grouped by major sector of activity as; hospital-based (21/41, 51%), community-based (15/41, 36%), or academic/education-based (5/41, 12%).

    From the 39 centers that received training by the end of the study period, 33 (84%) started to use COGWEB, either developing clinical or research activities. Taking into account all the active centers, the median time from the first on-site training visit to the enrollment of the first patient was 1.5 months (interquartile range, 0.5-3.0; SD 1.08 months; 95% CI 1.33-2.15) without differences between types of center (P=.57). Among all clinical centers that received formal training (n=31), by the end of the study period, 80% (25/31; n=25) remained actively enrolling patients and using COGWEB. The 6 clinical centers that were not active at the end of the study (6/31, 19%), never started to enroll patients after their first visit; 1 center was in the first 3 month training period (1/6, 16%), 4 reported organizational and local human resources problems (4/6, 66%), and 1 alleged major technical problems (1/6, 16%). All of the centers that started to use COGWEB with their patients (n=25) were active at the end of the 12 months follow-up period, with no dropouts.

    Characteristics of Patients that Received Treatment in Clinical Centers

    Among all the 25 clinical centers that started to use the COGWEB system in their activities, a total of 298 patients were enrolled for cognitive training during the first year. The average age was 54.4 years (SD 18.7), 45.3% (135/298; n=135) were female. The patients had diverse formal educational levels, 22.5% (67/298; n=67) from 1-4 years, 28.5% (85/298; n=85) from 5-9 years, 24.8% (74/298; n=74) from 10-12 years, and 24.1% (72/298; n=72) with more than 12 years of school (Table 2). The major causes for cognitive impairment of all the patients treated were; neurodegenerative diseases (115/298, 38.5%; n=115), static structural brain lesions (63/298, 21.1%; n=63), multiple sclerosis and other immune diseases (40/298, 13.4%; n=40), schizophrenia (30/298, 10.0%; n=30), cognitive dysfunction of functional nature (28/298, 9.3%; n=28), attention deficit hyperactivity disorder (12/298, 4.0%; n=12), and others (10/298, 3.3%; n=10) (Table 2).

    During the follow-up period there was a significant increase of the number of patients enrolled every month at the clinical network (r=0.6; P= .031) (Figure 2 shows this). At 12 months, 205 patients remained on active treatment (Figure 3 show this).

    Table 2. Description of the patients enrolled at promoter center, other clinical centers, and global clinical network.

    		Promoter centerOther clinical centersGlobal clinical network
    Number of patients117181298
    Age, years, average (SD)45.8 (14.7)60.1 (19.7)54.4 (18.7)
    Gender



    		Female frequency, n (%)39/117 (33.3)96/181 (53.0)135/298 (45.3)
    Education, years, average (SD)8.9 (4.2)10.6 (5.1)9.8 (4.8)
    Cause of cognitive impairment, n (%)


    		Neurodegenerative diseases with dementia20/117 (17.1)95/181 (52.4)115/298 (38.6)

    		Stroke, TBIa, and other static structural lesions23/117 (19.7)40/181 (22.1)63/298 (21.1)

    		Multiple sclerosis and other autoimmune diseases35/117 (29.9)5/181 (2.8)40/298 (13.4)

    		Cognitive dysfunction of functional nature10/117 (8.5)18/181 (9.9)28/298 (9.4)

    		Schizophrenia27/117 (23.0)3/181 (1.7)30/298 (10.1)

    		ADHDb1/117 (0.9)11/181 (6.1)12/298 (4.0)

    		Others1/117 (0.9)9/181 (5.0)10/298 (3.4)

    aTBI = traumatic brain injury

    bADHD = attention deficit hyperactivity disorder

    ‎
    Figure 2. Number of patients enrolled each month in Web-based cognitive training through the COGWEB network.
    View this figure
    ‎
    Figure 3. Cumulative number of patients treated during the first year (blue) against the number of patients receiving active treatment trough the COGWEB network each month (red).
    View this figure

    Comparison of the First Clinical Center Activity With the Other Network Centers

    In Table 2, the patients at the promoter center are compared with the patients at the remaining network, namely: (1) mean age, (2) gender, (3) level of education, and (4) cause of cognitive impairment. The patients recruited at the new network centers were older (P<.001). Nonetheless, the new centers also doubled the proportion of patients with less than 20 years of age 5.6% (10/181) versus 2.6% (3/117) at the promoter center. There was a significant difference in the gender distribution (P=.01), with more males in the promoter center. The patients’ educational attainment was higher in the new centers than in the promoter (P=.005). Considering the distribution of the causes of cognitive impairment, the promoter center enrolled relatively more patients with schizophrenia 23.0% (27/117) versus 1.7% (3/181), P<.001, and autoimmune diseases 29.9% (35/117) versus 2.8% (5/181), P<.001. Patients with neurodegenerative diseases were the majority of patients enrolled at the new centers (95/181, 52.4%), while their percentage at the promoter center was 17.0% (20/117; P<.001). The new centers also enrolled relatively more patients with ADHD, 6.1% (11/181) versus 0.9% (1/117; P=.04).

    General Description of Activities at Research Centers

    Besides the research and development activities occurring at the promoter center, four academic research centers (three clinical and one basic science) participated in the network, using COGWEB in their studies. These centers were dedicated to the study of the effects of cognitive training across several disease models and settings, and looking for molecular, brain imaging, or neuropsychological biomarkers and characterization of neuroplastic processes. Some of the disease models included Alzheimer’s dementia, schizophrenia, multiple sclerosis, stroke, and school age learning disabilities. A center was dedicated to epidemiological and public health cohort studies. The total number of patients enrolled in all these research activities during the follow-up period amounted to 417, with 183 (43.9%) coming from studies originating outside the promoter center (Table 1).


    Principal Findings

    Starting from an initial clinical promoter center, integrated in a wider national mental health system setting in Western Europe, it was possible to implement over a 12 month period a collaborative network composed of 41 centers and 68 professionals. This network was dedicated to cognitive intervention and, for its establishment, took advantage of an innovative Web-based cognitive training system, COGWEB [23,24,30]. This tool was developed for clinical and research purposes at the promoter center, and had proved to be proficient in increasing patient access to care and intensity of cognitive training [23-25]. The process of training and sharing a new working tool, and methods, in the field of cognitive training was the cornerstone for the construction of the COGWEB network, and fostered synergies and cooperation between so diverse centers and settings. Health care is a collaborative endeavor, but the degree of collaboration and exchange depends largely on the ability to share and the reciprocity perceived by all the players and stakeholders of a network [10].

    The 16 baseline centers that started the network were all based on hospital institutions. Nonetheless, during the first year of functioning, the network was able to attract 25 new centers, and at the end of the study period 11 different categories of centers were identified (Table 1), with 36% (15/41) of them being primarily based on the community. The diversity of centers and institutions enrolled went from referral hospitals and academic centers to day care institutions, schools, adult learning institutes, and companies. All this variety provided us with a wider view on global patient needs, settings, and professional groups interested in improving their standards of care in the field of cognitive intervention. Considering the main characteristics of the national mental health service where the study occurred, namely the range of environments and existing barriers to patient access to cognitive interventions [28,29], this was an important achievement. Only through an inclusive approach is it possible to enhance solutions within a network environment and bridge the gaps between so diverse settings and professionals like those from referral hospital centers, basic and clinical academic centers, or community based institutions [1,8-10]. The needs for cognitive training in the population are very widespread and growing, mostly due to the multiplicity of diseases associated with cognitive deficits, the wide spectrum of ages of onset, and ageing trends in the population [15,27,29]. Altogether, if the aim is a public health impact in the near future, the multiplicity of solutions and settings connected through a cognitive care collaborative network are an important solution to match current and future needs of the population, at the same time improving the sustainability of health services [2,13].

    Although the implementation of the clinical network was only a short period of time, the number of patients provided Web-based cognitive training through the network increased steadily, amounting to more than 30 new patients per month in the last two months. Furthermore, the percentage of patients remaining under clinical supervision at the end of the study period was also high (205/298, 68.8%). These multi-center adherence estimates, during a 12 months follow up, may be comparable with adherence data obtained in a previous cohort study at the promoter center (82.8% at 6 months) [25]. Although an indirect quality measure, the reproduction of the adherence data in this study supports the strategy used for the professionals’ training at the new centers.

    The comparison of the characteristics of patients treated at the promoter center with those enrolled at other centers in the clinical network showed a marked increase, with significant differences, in the diversity of diagnosis, spectra of ages, and education. These findings are in accordance with the different categories of centers and types of services provided within the wider mental health system context [26,29]. The achievement of such a variety of settings and diseases is an important characteristic of the clinical network, namely for the implementation of future research studies and tailoring of the COGWEB system to professional and patient needs. A striking finding was the increase in the number and percentage of patients with neurodegenerative diseases (Table 2), possibly in association with the characteristics of the new centers that adhered to the network, with a great proportion being dedicated to neurodegenerative diseases and elder patients (Table 1). This fact probably reflects the distribution of cognitive impairment in an aging population [31], and the willingness of those centers and professionals to adhere to a network dedicated to Internet cognitive training activities [25].

    The strategy defined for professional training, network implementation, and maintenance allowed for a median time to start using the COGWEB system in clinical activities of 1.5 months, with 80% (33/41) of the clinical centers active at 12 months and no dropouts. Nonetheless, 4 institutions reported local organizational and human resources restrictions as reasons for not starting to use the system. These estimates are important for programing further network expansion, anticipating points of tension between individual and organizational goals, guaranteeing its alignment with financial incentives, and sustainability [9].

    Besides clinical activities, it was verified a remarkable growth in research activities over the network. This finding is of utmost importance because studies originating outside the leading promoter center already represented 43.9% (183/417) of patients enrolled in these activities. Research activity is one of the main purposes of this network, and tightly linked to the capacity to generate innovation, processes, and finally patient outcomes [11,32]. This happens in close resemblance with the development of translational research and translational networks in the fields of oncology [6], pediatrics [33], genetics [34], neurodegenerative diseases [35], virology [36], pharmacology [37], big data bioinformatics [38], epidemiology [39], and public health [32], all good examples of the growing efforts being made to fill the gap and speed processes between basic research and clinical outcomes for communities [11].

    Limitations

    The main limitations of this study are related with the youth nature of the COGWEB network (first year of functioning), being difficult to validate the long term sustainability, outcomes, and impact of the network structure. The differences between center characteristics (41 centers distributed by 11 categories), and the small relative number of patients enrolled at each center prevented us from analyzing patient profiles per type of center and establish comparisons. The aggregation of clinical centers into promoter and others was thus necessary. Data on the severity of patient deficits as well as type, intensity, and quality of cognitive training provided were not analyzed. Additional studies are necessary to evaluate the long term impact of the network on global access of patients to supervised cognitive training at the level of the national health system, quality of care provided, and patient outcomes according to major cause of cognitive impairment. Furthermore, the professional members of the network were not addressed directly through a network survey, nor are data available on key players, ties (indegrees and outdegrees), brokers, or sociograms [6]. These points are very important for translational network analysis, and will be addressed in forthcoming studies on the COGWEB network functioning.

    Conclusions

    This paper provides insight on the implementation and early outcomes of a large scale multi-organizational cognitive rehabilitation network in a Western European health system environment. Over its first year, there was a major increase in the number, as well as in the clinical diversity, of patients treated and centers, crucial factors for its long term viability. At the beginning of the big data analysis era for neurosciences [40], the consolidation of such a national collaborative network represents an innovative step in mental health care evolution. Furthermore, it may contribute to translational processes in the field of cognitive training and cognitive care, this way providing the foundations for continued innovation, clinical care improvement, and reducing the burden of disease.

    Acknowledgments

    During the study, several psychology students and administrative personnel at the hospitals and centers collaborated in the study. We thank them. We also thank our patients, their families, and their attending physicians for all the collaboration. The study was supported in part by unrestricted research grants from the Portuguese Society of Neurology in 2009, Grunenthal Foundation in 2010, and Novartis Pharma-Produtos farmacêuticos SA in 2013. This funding was used for part of the technological development of COGWEB and administrative tasks. All other design and conduct of the study; collection, management, analysis and interpretation of the data and preparation, review, or approval of the manuscript received no funding.

    We thank the COGWEB Network collaborators for their work at the centers (in alphabetical order): Adélia Magalhães, Alexandra Pais, Ana Barros, Ana Lídia, Ana Paula Silva, Ana Queiroz, Anabela Monteiro, Ãngela Valença, António Henriques, Carla Marques, Carla Pinho, Carolina Garret, Cláudia Sousa, Cristiana Rocca, Daniel Falcão, Diana Martino, Duarte Falcão, Élia Baeta, Ema Margarido, Emanuela Lopes, Filipa Batista, Filipa Ferreira, Filipa Machado Vaz, Filomena Gomes, Filomena Santos, Góis Horácio, Henrique Barreto, Humbertina Maia, Lúcia Carvalheiro, Luciana Monteiro, Luís Gonzaga, Manuela Guerreiro, Marco Moniz, Margarida Sobral, Maria Ribeiro, Marta Rosado, Paulo Pimentel, Salomé Abrantes, Sandra Ginó, Teresa Ferreira, Tiago Mendes.

    Authors' Contributions

    VTC, JP, and PC created the study concept and design. VTC, JP, IA, CM, AS, LR, RB, EC, IAraújo, VB, MC, and COGWEB network collaborators acquired the data. VTC, JP, LR, NR, and PC analyzed and interpreted the data. All authors critically revised the manuscript for important intellectual content. VTC, JP, and PC obtained funding. IA, LR, CM, AS, RB, EC, IAraújo, VB, MC, and COGWEB network collaborators provided administrative, technical, and material support. VTC, JP, VB, MC, NR, and PC provided study supervision.

    Conflicts of Interest

    VTC and JP have a shareholder position at Neuroinova, Lda, a company that develops and commercializes COGWEB related products. VB and MC received fees for the technological development of COGWEB.

    1. Cunningham FC, Ranmuthugala G, Plumb J, Georgiou A, Westbrook JI, Braithwaite J. Health professional networks as a vector for improving healthcare quality and safety: A systematic review. BMJ Qual Saf 2012 Mar;21(3):239-249 [FREE Full text] [CrossRef] [Medline]
    2. Eaton J, McCay L, Semrau M, Chatterjee S, Baingana F, Araya R, et al. Scale up of services for mental health in low-income and middle-income countries. Lancet 2011 Oct 29;378(9802):1592-1603. [CrossRef] [Medline]
    3. Chauvet V, Chollet B, Soda G, Huault I. The contribution of network research to managerial culture and practice. European Management Journal 2011 Oct;29(5):321-334 [FREE Full text] [CrossRef]
    4. Borgatti SP, Halgin DS. On network theory. Organization Science 2011 Oct;22(5):1168-1181 [FREE Full text] [CrossRef]
    5. Lang PB, Gouveia FC, Leta J. Cooperation in health: Mapping collaborative networks on the web. PLoS One 2013;8(8):e71415 [FREE Full text] [CrossRef] [Medline]
    6. Long JC, Cunningham FC, Carswell P, Braithwaite J. Who are the key players in a new translational research network? BMC Health Serv Res 2013;13:338 [FREE Full text] [CrossRef] [Medline]
    7. D'Amour D, Ferrada-Videla M, San Martin Rodriguez L, Beaulieu MD. The conceptual basis for interprofessional collaboration: Core concepts and theoretical frameworks. J Interprof Care 2005 May;19 Suppl 1:116-131. [CrossRef] [Medline]
    8. Mossberg L. Strategic collaboration as means and end: Views from members of Swedish mental health strategic collaboration councils. J Interprof Care 2014 Jan;28(1):58-63. [CrossRef] [Medline]
    9. Braithwaite J. Between-group behaviour in health care: Gaps, edges, boundaries, disconnections, weak ties, spaces and holes. A systematic review. BMC Health Serv Res 2010;10:330 [FREE Full text] [CrossRef] [Medline]
    10. Long JC, Cunningham FC, Braithwaite J. Bridges, brokers and boundary spanners in collaborative networks: A systematic review. BMC Health Serv Res 2013;13:158 [FREE Full text] [CrossRef] [Medline]
    11. Spoth R, Rohrbach LA, Greenberg M, Leaf P, Brown CH, Fagan A, Society for Prevention Research Type 2 Translational Task Force MembersContributing Authors. Addressing core challenges for the next generation of type 2 translation research and systems: The translation science to population impact (TSci Impact) framework. Prev Sci 2013 Aug;14(4):319-351 [FREE Full text] [CrossRef] [Medline]
    12. Gruen RL, Elliott JH, Nolan ML, Lawton PD, Parkhill A, McLaren CJ, et al. Sustainability science: An integrated approach for health-programme planning. Lancet 2008 Nov 1;372(9649):1579-1589. [CrossRef] [Medline]
    13. Kakuma R, Minas H, van Ginneken N, Dal Poz MR, Desiraju K, Morris JE, et al. Human resources for mental health care: Current situation and strategies for action. Lancet 2011 Nov 5;378(9803):1654-1663. [CrossRef] [Medline]
    14. King K, Christo J, Fletcher J, Machlin A, Nicholas A, Pirkis J. The sustainability of an Australian initiative designed to improve interdisciplinary collaboration in mental health care. Int J Ment Health Syst 2013;7(1):10 [FREE Full text] [CrossRef] [Medline]
    15. World Health Organization. Neurological disorders. Public health challenges. Switzerland: World Health Organization; 2006.
    16. Cramer SC, Sur M, Dobkin BH, O'Brien C, Sanger TD, Trojanowski JQ, et al. Harnessing neuroplasticity for clinical applications. Brain 2011 Jun;134(Pt 6):1591-1609 [FREE Full text] [CrossRef] [Medline]
    17. Gates NJ, Sachdev PS, Fiatarone Singh MA, Valenzuela M. Cognitive and memory training in adults at risk of dementia: A systematic review. BMC Geriatr 2011;11:55 [FREE Full text] [CrossRef] [Medline]
    18. Cha YJ, Kim H. Effect of computer-based cognitive rehabilitation (CBCR) for people with stroke: A systematic review and meta-analysis. NeuroRehabilitation 2013;32(2):359-368. [CrossRef] [Medline]
    19. Kueider AM, Parisi JM, Gross AL, Rebok GW. Computerized cognitive training with older adults: A systematic review. PLoS One 2012;7(7):e40588 [FREE Full text] [CrossRef] [Medline]
    20. Minzenberg MJ, Carter CS. Developing treatments for impaired cognition in schizophrenia. Trends Cogn Sci 2012 Jan;16(1):35-42. [CrossRef] [Medline]
    21. Simon SS, Yokomizo JE, Bottino CM. Cognitive intervention in amnestic mild cognitive impairment: A systematic review. Neurosci Biobehav Rev 2012 Apr;36(4):1163-1178. [CrossRef] [Medline]
    22. Cruz VT, Pais J, Bento VF, Mateus C, Colunas M, Alves I. Neuroinova, Lda. 2013. Cogweb - web-based cognitive training platform   URL: http://www.cogweb.eu/ [accessed 2013-08-22] [WebCite Cache]
    23. Cruz VT, Pais J. Cogweb - sistema integrado de estimulação cognitiva: Manual de formação para profissionais. Gaia: Neuroinova; 2012.
    24. Cruz VT, Pais J, Bento V, Mateus C, Colunas M, Alves I, et al. A rehabilitation tool designed for intensive web-based cognitive training: Description and usability study. JMIR Res Protoc 2013;2(2):e59 [FREE Full text] [CrossRef] [Medline]
    25. Tedim Cruz V, Pais J, Alves I, Ruano L, Mateus C, Barreto R, et al. Web-based cognitive training: Patient adherence and intensity of treatment in an outpatient memory clinic. J Med Internet Res 2014;16(5):e122 [FREE Full text] [CrossRef] [Medline]
    26. Coordenação Nacional para a Saúde Mental. Plano nacional de saúde mental 2007 a 2016. Lisboa: Alto Comissariado da Saúde; 2008.   URL: http://adeb.pt/ficheiros/uploads/02a75f2c0346f49717d171c23b7f56a2.pdf [accessed 2014-11-16] [WebCite Cache]
    27. World Health Organization. Atlas: Global resources for persons with intellectual disabilities 2007. Switzerland: World Health Organization; 2007.
    28. Cavaco S. Neuropsychological rehabilitation in Portugal. 2011. Neuropsychological rehabilitation in Portugal: State of the art   URL: http://www.crpg.pt/simposiorn/Paginas/Comunica%C3%A7%C3%B5es.aspx [accessed 2014-11-19] [WebCite Cache]
    29. Programa Nacional para a Saúde Mental. Reatualização do plano nacional de saúde mental. Lisboa: Ministério da Saúde; 2012.   URL: http://www.saudemental.pt/wp-content/uploads/2012/06/Recalendarização_PNSM.pdf [accessed 2014-11-19] [WebCite Cache]
    30. Cruz VT, Pais J. Cogweb - sistema integrado de estimulação cognitiva: Manual de bolso. Gaia: Neuroinova; 2013.
    31. Nunes B, Silva RD, Cruz VT, Roriz JM, Pais J, Silva MC. Prevalence and pattern of cognitive impairment in rural and urban populations from Northern Portugal. BMC Neurol 2010;10:42 [FREE Full text] [CrossRef] [Medline]
    32. Young D, Borland R. Conceptual challenges in the translation of research into practice: It's not just a matter of "communication". Transl Behav Med 2011 Jun;1(2):256-269 [FREE Full text] [CrossRef] [Medline]
    33. Rose AC, Van't Hoff W, Beresford MW, Tansey SP. NIHR medicines for children research network: Improving children's health through clinical research. Expert Rev Clin Pharmacol 2013 Sep;6(5):581-587. [CrossRef] [Medline]
    34. Filocamo M, Baldo C, Goldwurm S, Renieri A, Angelini C, Moggio M, Telethon Network of Genetic Biobanks Staff. Telethon network of genetic biobanks: A key service for diagnosis and research on rare diseases. Orphanet J Rare Dis 2013;8:129 [FREE Full text] [CrossRef] [Medline]
    35. Orth M, European Huntington's Disease Network, Handley OJ, Schwenke C, Dunnett S, Wild EJ, et al. Observing Huntington's disease: The European Huntington's disease network's registry. J Neurol Neurosurg Psychiatry 2011 Dec;82(12):1409-1412. [CrossRef] [Medline]
    36. Blank MB, Metzger DS, Wingood GM, DiClemente RJ. The social and behavioral sciences research network: Translational research to reduce disparities in HIV. J Acquir Immune Defic Syndr 2013 Jun 1;63 Suppl 1:S1-S3. [CrossRef] [Medline]
    37. Issa NT, Byers SW, Dakshanamurthy S. Drug repurposing: Translational pharmacology, chemistry, computers and the clinic. Curr Top Med Chem 2013;13(18):2328-2336. [Medline]
    38. Marx V. Biology: The big challenges of big data. Nature 2013 Jun 13;498(7453):255-260. [CrossRef] [Medline]
    39. Burgio MR, Ioannidis JP, Kaminski BM, Derycke E, Rogers S, Khoury MJ, et al. Collaborative cancer epidemiology in the 21st century: The model of cancer consortia. Cancer Epidemiol Biomarkers Prev 2013 Dec;22(12):2148-2160. [CrossRef] [Medline]
    40. Kandel ER, Markram H, Matthews PM, Yuste R, Koch C. Neuroscience thinks big (and collaboratively). Nat Rev Neurosci 2013 Sep;14(9):659-664. [CrossRef] [Medline]

    ‎
    COGWEB: Web-based cognitive training system

    Edited by G Eysenbach; submitted 03.09.14; peer-reviewed by R Kennison, K Cicerone; comments to author 01.10.14; revised version received 16.10.14; accepted 02.11.14; published 27.11.14

    Copyright

    ©Vítor Tedim Cruz, Joana Pais, Luis Ruano, Cátia Mateus, Márcio Colunas, Ivânia Alves, Rui Barreto, Eduardo Conde, Andreia Sousa, Isabel Araújo, Virgílio Bento, Paula Coutinho, Nelson Rocha, COGWEB Network Collaborators. Originally published in JMIR Mental Health (http://mental.jmir.org), 27.11.2014.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.