This paper is in the following e-collection/theme issue:

Psychotic Disorders (156) Infodemiology and Infoveillance (1270) Depression and Mood Disorders; Suicide Prevention (1272) Infoveillance, Infodemiology, Digital Disease Surveillance, Infodemic Management (1010)

Published on in Vol 5, No 4 (2018): Oct-Dec

Monitoring Online Discussions About Suicide Among Twitter Users With Schizophrenia: Exploratory Study

Monitoring Online Discussions About Suicide Among Twitter Users With Schizophrenia: Exploratory Study

Monitoring Online Discussions About Suicide Among Twitter Users With Schizophrenia: Exploratory Study

Authors of this article:

Yulin Hswen1, 2 Author Orcid Image ;   John A Naslund3 Author Orcid Image ;   John S Brownstein2, 4, 5 Author Orcid Image ;   Jared B Hawkins2, 4, 5 Author Orcid Image
Article Authors Cited by (31) Tweetations (6) Metrics

    Original Paper

    1Department of Social and Behavioral Sciences, Harvard TH Chan School of Public Health, Harvard University, Boston, MA, United States

    2Informatics Program, Boston Children's Hospital, Boston, MA, United States

    3Department of Global Health and Social Medicine, Harvard Medical School, Boston, MA, United States

    4Department of Pediatrics, Harvard Medical School, Boston, MA, United States

    5Department of Biomedical Informatics, Harvard Medical School, Boston, MA, United States

    Corresponding Author:

    Yulin Hswen, MPH

    Department of Social and Behavioral Sciences

    Harvard TH Chan School of Public Health

    Harvard University

    677 Huntington Avenue

    Boston, MA, 02115

    United States

    Phone: 1 6177751889

    Email: yhswen@gmail.com


    Background: People with schizophrenia experience elevated risk of suicide. Mental health symptoms, including depression and anxiety, contribute to increased risk of suicide. Digital technology could support efforts to detect suicide risk and inform suicide prevention efforts.

    Objective: This exploratory study examined the feasibility of monitoring online discussions about suicide among Twitter users who self-identify as having schizophrenia.

    Methods: Posts containing the terms suicide or suicidal were collected from a sample of Twitter users who self-identify as having schizophrenia (N=203) and a random sample of control users (N=173) over a 200-day period. Frequency and timing of posts about suicide were compared between groups. The associations between posting about suicide and common mental health symptoms were examined.

    Results: Twitter users who self-identify as having schizophrenia posted more tweets about suicide (mean 7.10, SD 15.98) compared to control users (mean 1.89, SD 4.79; t374=-4.13, P<.001). Twitter users who self-identify as having schizophrenia showed greater odds of tweeting about suicide compared to control users (odds ratio 2.15, 95% CI 1.42-3.28). Among all users, tweets about suicide were associated with tweets about depression (r=0.62, P<.001) and anxiety (r=0.45, P<.001).

    Conclusions: Twitter users who self-identify as having schizophrenia appear to commonly discuss suicide on social media, which is associated with greater discussion about other mental health symptoms. These findings should be interpreted cautiously, as it is not possible to determine whether online discussions about suicide correlate with suicide risk. However, these patterns of online discussion may be indicative of elevated risk of suicide observed in this patient group. There may be opportunities to leverage social media for supporting suicide prevention among individuals with schizophrenia.

    JMIR Ment Health 2018;5(4):e11483

    doi:10.2196/11483

    Keywords

    schizophrenia; social media; suicide; Twitter; digital technology; mental health 


    Individuals living with schizophrenia experience elevated risk of suicide compared to the general population [1]. Adults with schizophrenia are nearly four times as likely to die from suicide when compared to adults in the general population (all-causes standardized mortality ratio 3.9, 95% CI 3.8-4.1) [2]. Lifetime risk of suicide among individuals with schizophrenia ranges from 5% to 13%, representing a leading cause of mortality in this group [1,3]. There is urgent need for novel approaches to detect suicide risk among individuals with schizophrenia.

    Social media platforms have emerged as important digital monitoring tools capable of facilitating the detection and tracking of numerous diseases and public health concerns [4]. A growing number of studies have highlighted the feasibility and promise of using popular social media for monitoring online conversations about suicide and for potentially detecting those at risk of suicide [5]. Several studies have used Twitter data to characterize suicide-related conversations [6] and to monitor suicide risk [7,8]. An exploration of Tumblr posts found that conversations about suicide were frequently shared together with content about self-harm and depression [9]. Another study investigated the psychological characteristics of social media users in China who posted conversations about suicide on the Weibo microblogging platform [10].

    Research has shown that studying social media activity can yield valuable public health insights about serious mental disorders such as schizophrenia. For example, data captured from Facebook was used to characterize awareness of schizophrenia across the United States [11], while another study found that conversations about schizophrenia on Twitter were often negative, suggesting the presence of social stigma [12]. Numerous studies have also demonstrated that individuals living with schizophrenia use popular social media at comparable rates as the general population [13,14]. Further, individuals with mental illness appear to use social media to share their illness experiences or seek advice from others with similar conditions [15,16]. A series of recent studies have identified unique patterns of communication on Twitter among users who self-identify as having schizophrenia, as reflected by linguistic differences, compared to control users [17,18]; changes toward more positive sentiment following self-disclosure of mental illness on social media [19]; and greater use of conversation terms about mental health symptoms compared to control users [20].

    In addition, social media such as Twitter may be especially valuable for monitoring suicide risk among individuals with schizophrenia as these platforms offer unique opportunities to engage young adults. For instance, on average, Twitter users tend to be younger compared to the overall population [21]. This is highly relevant because suicide mortality among people with schizophrenia is greatest among younger adults, where individuals 20-34 years of age are over five times as likely compared to young adults from the same age group from the general population to die due to suicide (all-causes standardized mortality ratio 5.3, 95% CI 4.9-5.7) [2]. A literature review found that risk of suicide and self-harm is also highly prominent among young individuals considered at ultra-high risk of developing psychosis [22]. As well, there is increasing recognition that individuals with schizophrenia are heavy users of social media and show unique communication patterns on these digital platforms. This combination highlights the potential to leverage social media for detecting suicide risk and informing suicide prevention efforts in this at-risk patient group. However, less is known about whether people with schizophrenia talk about suicide on social media.

    An important first step toward developing strategies to use social media for supporting the detection of suicide risk among individuals with schizophrenia is to better understand how this target population talks about suicide on popular social media. Therefore, in this exploratory study, our aims were to (1) investigate the frequency of online communications about suicide among Twitter users who self-identify as having schizophrenia compared with a control group of typical Twitter users; (2) characterize the timing of tweets about suicide among Twitter users who self-identify as having schizophrenia compared with a control group of typical Twitter users; and (3) determine whether discussion about other common mental health symptoms, including depression or anxiety, is predictive of online discussions about suicide. We hypothesized that Twitter users who self-identify as having schizophrenia would be significantly more likely to post tweets containing suicide terms when compared to Twitter users from the general population, thereby reflecting the elevated risk of suicide observed among individuals with schizophrenia in real-world settings.


    Data Collection

    All data analyzed in this study was publicly available and was collected from the Twitter social media platform. Twitter is a popular microblogging platform where users post short statuses called “tweets” that contain a maximum of 140 characters—since 2018, this has increased to a maximum of 280 characters for each tweet. It is estimated that the more than 330 million active Twitter users post over 500 million tweets per day [23,24]. This highlights an immense source of unsolicited data with exciting potential to study various aspects of human behavior and monitor health conditions including mental illness [25]. Specifically, we selected this social media platform for this study because it has previously been used for conducting research on several different mental health conditions, including depression, bipolar disorder, and posttraumatic stress disorder [26]. Importantly, data captured from Twitter has been used in research characterizing online discussions and attitudes about schizophrenia [12,27], exploring linguistic markers of schizophrenia [17,18], and supporting efforts to detect individuals with schizophrenia [18,19]. Lastly, Twitter users tend to be younger compared to the overall population [21], which is especially important given the elevated suicide risk among young persons with schizophrenia [2]. Therefore, given that Twitter can achieve widespread reach, and that we can expand on existing related work, we determined that Twitter would be an ideal platform to potentially serve as an effective digital tool for monitoring risk of suicide among people with schizophrenia.

    As popular social media platforms have emerged as an important source of user-generated content that can yield valuable insights for public health research, the ethical considerations with analyzing and disseminating this data have received greater attention [28,29]. While there remains a lack of consensus over best practices for using Twitter data in academic research [30], there is ongoing discussion surrounding concerns related to privacy, confidentiality, and informed consent [31]. To minimize potential risks, we ensured that all data collected in our study was available in the public domain. However, additional ethical considerations are warranted, especially in the context of socially stigmatizing health conditions such as mental illness [32]. For example, disseminating user-generated content collected on Twitter could potentially place an individual at risk of harm [30] because sensitive health information, such as mental illness diagnosis or symptoms, could be made identifiable in ways that were not intended by the original user who posted the content online [33]. Therefore, to further protect the identity of the Twitter users whose data we examined in this study, we removed all usernames and identifiable details from the content that they posted online. Lastly, we do not report any specific tweets that could be used to identify the original Twitter user who posted the content online, as this is an important concern that has been discussed extensively in recent literature on the ethics of using Twitter data for research [30]. In this study, we retrieved data from Twitter’s public application programming interface over a 200-day period from January 5, 2016, to July 23, 2016. Given that we only used publicly available online data in this study, ethical review was not required.

    Twitter Users and Characteristics

    We identified a convenience sample of 250 Twitter users who explicitly self-identified as having a schizophrenia spectrum disorder in their profile or in a tweet. For example, the users’ profiles could indicate “person living with schizophrenia” or “I have schizophrenia diagnosis,” while a tweet could mention “this is how I manage my schizophrenia” or “I was just diagnosed with schizophrenia.” We modeled our data collection methods on prior studies that have used the Twitter platform for generating a convenience sample of users with publicly available accounts who self-identify as having a schizophrenia spectrum disorder in their profile or in a post or tweet [18,34]. To identify the sample of Twitter users with schizophrenia, we searched Twitter using the following terms: schizophrenia, schizoaffective, schizotypal, and psychosis. We then confirmed the self-reported schizophrenia diagnosis by having one researcher generate this initial list of Twitter users and then a second researcher check the details for each Twitter user on the list to ensure correct identification of users with a self-reported schizophrenia spectrum disorder.

    To create a general population comparison group, we used the GET statuses/sample feature from the Twitter Developer Platform to collect a random sample of all publicly available tweets [35]. Then, two research assistants manually screened these tweets to confirm that the tweet belonged to a real person (ie, not a bot or spam account), was from a normal user (ie, not a company or corporation), and was in English. This process was intended to ensure that Twitter users included in the control group were real Twitter users. To minimize the risk of selecting any bot or spam users, both research assistants had to be in agreement of a Twitter user on each of these three criteria. We excluded any Twitter users where there was disagreement. Our goal was to create a group of users that was representative of typical Twitter users. We identified a sample of 250 control users.

    We determined gender for the sample of Twitter users because numerous studies have identified a relationship between gender and suicide risk [36]; as well, mental health symptoms such as depression and anxiety have a known association with gender [37,38]. Additionally, among individuals with schizophrenia, mortality due to suicide is higher in men than in women [2]. We employed a stepwise process for coding each Twitter user’s gender as male, female, or unknown/insufficient data. Two researchers independently used these codes beginning with each Twitter user’s username, followed by profile name, profile description, profile photo, and then tweets. Both researchers then reviewed their final gender codes for each Twitter user to ensure consistency and to resolve any disagreements.

    We also extracted several characteristics for the Twitter users included in this study. This involved collecting metadata from the Twitter users’ accounts, including total number of tweets, tweets per day (ie, total tweets divided by days active), tweets in last 200 days, number of friends, number of followers, favorites per day, and number of days the account has been active. We also measured each Twitter user’s impact, which is calculated as a followers-to-friends ratio where the user’s number of followers is divided by their number of friends [39]. This serves as a measure of impact and influence on Twitter because a higher ratio means that a user has many people who follow their account, but that they follow few other users’ tweets [39].

    In our final sample, included in the analyses reported here, we had a total of 203 Twitter users who self-identified has having schizophrenia and 173 control users. The final number of users changed because some accounts became inaccessible (ie, private, deleted, banned, or deactivated) or were inactive (ie, no posts during the 200-day study period) at the time of data collection.

    Tweets With Suicide Terms

    We retrieved all tweets posted during the 200-day period from the Twitter users included in this study. Within this collection of users’ tweets, we identified only tweets that contained the keywords suicide or suicidal. Prior studies have shown that there are a variety of terms used on social media that may be indicative of suicide risk [8,40]. The term suicide is frequently contained in suicide-related conversations [8,41]. Therefore, we intentionally limited our search to these two terms to improve the certainty that the discussion content captured in this study was explicitly referring to suicide. We also considered this important because online discussions about suicide have been correlated with actual suicide risk. For example, a study from Japan showed that statements specifically mentioning the term suicide on Twitter were significantly associated with suicidal ideation and behavior [42]. In addition to searching for suicide-related terms, we also selected keywords for other mental health symptoms that are known risk factors for suicide [43]. These include the following terms: depression, depressed, anxiety, and anxious.

    Timing of Tweets With Suicide Terms

    To examine whether there were potential differences in the timing of tweets containing the terms suicide or suicidal between groups, we performed an analysis of tweet timing. This involved converting the time-of-day data for tweets containing the terms suicide or suicidal to the Twitter users’ local time zones, and then classifying these tweets into the following time intervals based on a 24-hour clock: 00:00-05:59, 06:00-11:59, 12:00-17:59, and 18:00-23:59. It was possible to perform this analysis of tweet timing for only the subset of Twitter users’ tweets with available universal time code (UTC) offset data. The UTC offset is only available for a tweet when users choose to include their local time zone in their account settings.

    Statistical Analyses

    We used t tests to compare continuous variables and chi-square tests to compare categorical variables between the group of Twitter users with schizophrenia and the control users. We used logistic regression models controlling for gender to compare both groups on the binary outcomes of whether or not users posted a tweet containing suicide terms (ie, suicide or suicidal). We then used Pearson correlations to assess whether tweeting about other mental health terms (eg, depression or anxiety) would be associated with posting a tweet with a suicide term. All analyses were performed with the Python programming language and Stata version 14.0 (StataCorp LLC).


    Sample Characteristics

    During the 200-day study period from January 2016 to July 2016, we collected a total of 1,544,122 tweets, with 819,491 tweets (53.07%) posted by the Twitter users with schizophrenia (N=203) and 724,631 tweets (46.93%) posted by the control users (N=173). Characteristics between the two groups were generally similar. Twitter users with schizophrenia posted a comparable number of tweets per day (mean 21.10, SD 58.50) as the control users (mean 20.80, SD 34.30). The followers-to-friends ratio among Twitter users with schizophrenia (mean 7.17, SD 52.40) was also similar to that of control users (mean 2.56, SD 6.33). Only gender differed significantly between groups, where a larger proportion of Twitter users with schizophrenia (93/203, 45.8%) were identified as male compared to control users (57/173, 32.9%; χ22=8.1, P=.02).

    Tweets About Suicide

    Differences in tweets about suicide between groups are listed in Table 1. Twitter users with schizophrenia tweeted significantly more about suicide (mean 7.10, SD 15.98) compared with control users (mean 1.89, SD 4.79; t374=-4.13, P<.001). Among the 203 Twitter users with schizophrenia, 113 (55.7%) posted a total of 1441 tweets about suicide (mean 12.75, SD 19.69) compared to 65 out of 173 (37.6%) users in the control group who tweeted about suicide 327 times (mean 5.03, SD 6.75). In a logistic regression model adjusting for gender, Twitter users with schizophrenia showed significantly greater odds of tweeting about suicide compared with control users (odds ratio 2.15, 95% CI 1.42-3.28).

    Timing of Tweets About Suicide

    In our total sample of Twitter users, 71.0% (267/376) had available time zone data. There was no significant difference in availability of time zone information between Twitter users with schizophrenia (137/203, 67.5%) and control users (130/173, 75.1%). There were no differences in the proportions of tweets about suicide during each time interval between the Twitter users with schizophrenia and control users. In general, and as presented in Table 2, both groups appeared to post a comparable proportion of their tweets about suicide at each time point.

    Table 1. Tweets containing terms about suicide among Twitter users with schizophrenia and control users
    Suicide termsControl Twitter users (N=173)Twitter users with schizophrenia (N=203)t374P valuea

    		Tweets, nTweets per user, mean (SD)Users who tweeted, n (%)Tweets, nTweets per user, mean (SD)Users who tweeted, n (%)

    Suicide2661.54 (3.81)60 (34.7)10955.39 (12.88)106 (52.2)-4.09<.001
    Suicidal620.36 (1.93)23 (13.3)3671.81 (4.60)66 (32.5)-3.82.006
    Tweets with any suicide termsb3271.89 (4.77)65 (37.6)14417.10 (15.94)113 (55.7)-4.60<.001

    aP values calculated using t tests for the difference in mean (SD) tweets containing suicide or suicidal terms between Twitter users with schizophrenia and control users.

    bThis category also includes tweets that contain both the terms suicide and suicidal.

    Table 2. Timing of tweets containing the terms suicide and suicidal among Twitter users who self-identify as having schizophrenia compared to control Twitter users
    Time intervalProportion of tweets among control Twitter users containing the terms suicide and suicidal (N=286), n (%)Proportion of tweets among Twitter users with schizophrenia containing the terms suicide and suicidal (N=1101), n (%)χ21P valuea
    00:00-05:5928 (9.8)145 (13.17)2.4.12
    06:00-11:5971 (24.8)260 (23.61)0.2.67
    12:00-17:5994 (32.9)376 (34.15)0.2.68
    18:00-23:5993 (32.5)320 (29.06)1.3.26

    aP values calculated using chi-square tests.

    Predictors of Tweets About Suicide

    Across both groups, frequency of tweets containing suicide terms was significantly associated with tweets about depression (r=0.62, P<.001) and with tweets about anxiety (r=0.45, P<.001). Correlations between suicide tweets and depression tweets, and between suicide tweets and anxiety tweets, are illustrated for each group in Figure 1 and Figure 2, respectively. Regarding Figure 1, Pearson correlations were calculated for the association between tweets containing suicide terms and tweets containing depression terms for the Twitter users with schizophrenia group (r=0.60, P<.001) and the control users group (r=0.70, P<.001). Regarding Figure 2, Pearson correlations were calculated for the association between tweets containing suicide terms and tweets containing anxiety terms for the Twitter users with schizophrenia group (r=0.40, P<.001) and the control users group (r=0.62, P<.001).

    ‎
    Figure 1. Association between tweets containing terms about suicide and tweets containing terms about depression among Twitter users with schizophrenia and control users.
    ‎
    Figure 2. Association between tweets containing terms about suicide and tweets containing terms about anxiety among Twitter users with schizophrenia and control users.

    Principal Findings

    The impact of suicide among individuals with schizophrenia is devastating. There is a well-established association between diagnosis of schizophrenia and increased risk of death from suicide, suicide attempts, and suicidal ideation [22]. Among all causes of death observed in persons with schizophrenia, suicide accounts for the highest mean years of potential life lost per death [2] and represents a major contributor to the dramatically shortened life expectancy observed in this patient group [44]. With increasing emphasis on the potential use of social media for suicide prevention [5], our findings offer an important contribution to the literature by (1) demonstrating the feasibility of identifying conversations about suicide among Twitter users who self-identify as having schizophrenia; (2) highlighting that Twitter users who self-identify as having schizophrenia are significantly more likely to talk about suicide compared to a control sample of Twitter users, which parallels trends observed in offline settings; and (3) demonstrating that the frequency of conversations about suicide on Twitter correlated significantly with discussions about depression and anxiety, another trend that is consistent with established data. Therefore, our findings represent an early indication that popular social media may be a valuable platform for monitoring discussion about suicide among persons who self-identify as having schizophrenia. Furthermore, our study offers a unique contribution to an emerging area of research aimed at using social media to support the detection of schizophrenia and for identifying individuals at risk of psychosis [17-20]. As this research using social media continues to evolve, there may be opportunities to explore online conversations on social media for simultaneously monitoring risk of psychosis and risk of suicide.

    It is important to draw the connection between our findings reported here and suicide trends observed among persons with schizophrenia in the “offline” world. While it was not possible in this study to determine whether conversations about suicide among Twitter users who self-identify as having schizophrenia correlate with actual suicidal ideation or intent, our findings add to an increasing number of studies demonstrating that data captured from popular social media correlates strongly with data collected offline. For example, a recent study from Japan found that increases in conversations about suicide on Twitter were associated with increases in the number of actual suicide deaths over time [7]. Similarly, another study found that variation in Twitter conversations about suicide paralleled geographic distribution of real-world suicide rates in the United States [8]. Together, these studies suggest that discussion about suicide on Twitter may be an indicator of true suicide risk.

    Our study offers an additional important contribution by demonstrating strong correlations between conversations about suicide and conversations about depression or anxiety in both Twitter users who self-identify as having schizophrenia and control users. This is consistent with prior studies that have demonstrated that depression is a significant risk factor for suicide [45], as well as research showing that symptoms of anxiety also correlate with suicide risk [46,47]. For instance, a recent study following Reddit users over time found that those who proceed to discuss suicidal ideation were more likely to have previously posted content online reflecting various psychological and behavioral states, including increased anxiety, when compared to users who do not proceed to discuss suicidal ideation [48]. Therefore, our findings add to this recent work by further emphasizing the association between online discussion about mental health and suicidal ideation among social media users [48].

    Ethical Considerations

    Key considerations with using social media as a tool for monitoring conversations about suicide pertain to broader ethical challenges with using publicly available online data, as well as the need to carefully weigh threats to safety and privacy against benefits gained by using novel approaches to study suicide in this way. For example, we only examined publicly available data in this study, yet many individuals who openly share sensitive personal information on social media do so without fully realizing how this information will be used, who will use it, and in what ways it could potentially result in harm [33]. While the Twitter users whose data we examined in this study self-identified as having schizophrenia, it is important to recognize these individuals as belonging to a vulnerable group because disclosure of mental illnesses like schizophrenia is associated with societal stigma and risk of discrimination. Therefore, we removed usernames and all identifying information from users’ content analyzed in this study; in addition, we did not report any quoted text, as this is a recommended approach for balancing the privacy of Twitter users with the aims of research [33]. Interestingly, monitoring conversations about suicide on Twitter may uncover unanticipated crises or urgent health risks, highlighting the need to consider how best to respond to individuals potentially at risk of suicide and ensuring that these individuals receive access to necessary professional support [5]. Importantly, researchers have emphasized that the public nature of social media platforms like Twitter may yield valuable opportunities for intervention and supporting suicide prevention [5]. Future research is needed to expand on our current exploratory work for considering how social media platforms could be leveraged to support suicide prevention and early intervention among individuals with schizophrenia.

    Connecting and interacting with others is a key attribute of social media platforms, which may expose individuals to unforeseen influences from others and possible risks [5]. Alternatively, social media platforms may allow individuals to seek peer-to-peer support, as has been previously observed among individuals with mental illness [15,49]; these platforms may also enable access to a valuable social support network, which is known to be associated with reduced suicide risk among persons with schizophrenia [50]. It is also necessary to carefully develop procedures and protocols that account for these ethical challenges and include strategies for risk management, as well as comprehensive approaches for protecting social media users’ safety while balancing the potential risk of suicide [51]. Ongoing efforts are needed to determine how to be mindful of potential ethical concerns while identifying novel approaches for supporting individuals with schizophrenia who may be at risk of suicide. This is especially important because there remains much uncertainty regarding ideal strategies for preventing suicide among vulnerable patient groups, such as individuals with schizophrenia [50].

    Limitations

    This was an exploratory study; therefore, caution is warranted when interpreting these findings. Several limitations should be considered. First, without access to psychiatric histories, it was not possible to confirm clinical diagnoses for the Twitter users who self-identified as having schizophrenia in this study. Additionally, these Twitter users likely differ from individuals with schizophrenia who do not disclose their illness online or who do not use social media. It is critical for future research to link content of discussions captured from social media with established clinical criteria to further support the generalizability of digital mental health detection methods [32]. Second, we were not able to collect demographic data from the Twitter users included in this analysis. National surveys indicate that Twitter users are typically younger than the general population [21], which is important when considering the implications of using social media for monitoring suicide risk in young persons; however, we were unable to determine the age of the users included in this study. This is a common challenge in public health research using social media [52]. In general, Twitter users tend to be young, have college degrees, and come from higher socioeconomic status groups [21]. A recent study showed that Twitter users with schizophrenia appeared to have high levels of education and, thus, may have fewer cognitive or functional limitations when compared to individuals with schizophrenia who do not use social media [16]. As a result, our findings likely do not generalize to individuals who do not use social media.

    Third, we employed a convenience sampling approach to generate the group of Twitter users who self-identify as having schizophrenia as well as the control group. This sampling method further limits generalizability of these findings. Additionally, because the control group consisted of a randomly generated sample of Twitter users, we cannot rule out the possibility that individuals in this group could also have had a schizophrenia spectrum disorder, though the chance of this is low as schizophrenia prevalence is roughly 1% [53]. However, Twitter users in the control group could have had other types of mental illness associated with increased risk of suicide. Fourth, only a limited number of search terms for suicide were used in this study and it was not possible to confirm whether use of these terms referred to actual suicide risk or behaviors. Our selection of the terms suicide and suicidal was aimed at improving certainty that the online conversations captured in this study were in fact related to suicide; however, it is possible that use of these may have been in the context of suicide prevention or other unrelated topics. Future research will need to explore the context of social media conversations about suicide to determine whether it relates to help-seeking, sharing experiences, or offering support, and how this contributes to reduced or heightened suicide risk. Additionally, there are several other terms that appear to reflect suicide risk on social media [8], suggesting that the current analysis may underestimate the frequency of online discussion related to suicide among this sample of Twitter users.

    Conclusions

    Our study takes preliminary steps toward demonstrating that Twitter users with schizophrenia appear to openly discuss suicide-related topics on Twitter and that these discussions are strongly correlated with conversations about common mental health symptoms known to be associated with actual suicide risk. This is an initial step toward informing the use of social media for monitoring suicide risk among people with serious mental illnesses such as schizophrenia. The need for effective approaches for detecting suicide risk remains a significant public health challenge [54]. The important opportunities to use social media for detecting and responding to suicide risk should not be missed. Going forward, it will be essential to weigh these benefits with potential ethical considerations related to individual privacy and ensuring adequate and timely responses to distressing content posted online. Therefore, future efforts are necessary to expand on our work presented here to develop and evaluate the use of social media for detecting suicide risk among individuals with schizophrenia, while seeking to leverage these popular online platforms for supporting suicide prevention efforts.

    Acknowledgments

    This study was funded by a grant from the Robert Wood Johnson Foundation (grant No. 73495), which was awarded to YH and JBH. JSB and JBH received funding from the National Institutes of Health/National Human Genome Research Institute (grant No. 5U54HG007963-04). YH received funding from the Canadian Institutes of Health Research. JAN received funding from the National Institute of Mental Health (grant No. 5U19MH113211). The funders played no role in the study design; collection, analysis, or interpretation of data; writing of the manuscript; or decision to submit the manuscript for publication.

    Conflicts of Interest

    None declared.

    1. Pompili M, Amador XF, Girardi P, Harkavy-Friedman J, Harrow M, Kaplan K, et al. Suicide risk in schizophrenia: Learning from the past to change the future. Ann Gen Psychiatry. Mar 16, 2007;6:10. [FREE Full text] [CrossRef] [Medline]
    2. Olfson M, Gerhard T, Huang C, Crystal S, Stroup TS. Premature mortality among adults with schizophrenia in the United States. JAMA Psychiatry. Dec 2015;72(12):1172-1181. [CrossRef] [Medline]
    3. Hor K, Taylor M. Suicide and schizophrenia: A systematic review of rates and risk factors. J Psychopharmacol. Nov 2010;24(4 Suppl):81-90. [FREE Full text] [CrossRef] [Medline]
    4. Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection: Harnessing the Web for public health surveillance. N Engl J Med. May 21, 2009;360(21):2153-2155, 2157. [FREE Full text] [CrossRef] [Medline]
    5. Robinson J, Cox G, Bailey E, Hetrick S, Rodrigues M, Fisher S, et al. Social media and suicide prevention: A systematic review. Early Interv Psychiatry. Feb 19, 2015. [CrossRef] [Medline]
    6. Burnap P, Colombo G, Amery R, Hodorog A, Scourfield J. Multi-class machine classification of suicide-related communication on Twitter. Online Soc Netw Media. Aug 2017;2:32-44. [FREE Full text] [CrossRef] [Medline]
    7. Ueda M, Mori K, Matsubayashi T, Sawada Y. Tweeting celebrity suicides: Users' reaction to prominent suicide deaths on Twitter and subsequent increases in actual suicides. Soc Sci Med. Dec 2017;189:158-166. [FREE Full text] [CrossRef] [Medline]
    8. Jashinsky J, Burton SH, Hanson CL, West J, Giraud-Carrier C, Barnes MD, et al. Tracking suicide risk factors through Twitter in the US. Crisis. 2014;35(1):51-59. [CrossRef] [Medline]
    9. Cavazos-Rehg PA, Krauss MJ, Sowles SJ, Connolly S, Rosas C, Bharadwaj M, et al. An Analysis of Depression, Self-Harm, and Suicidal Ideation Content on Tumblr. Crisis. Jul 22, 2016:1-9. [CrossRef] [Medline]
    10. Cheng Q, Kwok CL, Zhu T, Guan L, Yip PS. Suicide communication on social media and its psychological mechanisms: An examination of Chinese microblog users. Int J Environ Res Public Health. Sep 11, 2015;12(9):11506-11527. [FREE Full text] [CrossRef] [Medline]
    11. Saha K, Weber I, Birnbaum ML, De Choudhury M. Characterizing awareness of schizophrenia among Facebook users by leveraging Facebook advertisement estimates. J Med Internet Res. May 08, 2017;19(5):e156. [FREE Full text] [CrossRef] [Medline]
    12. Joseph AJ, Tandon N, Yang LH, Duckworth K, Torous J, Seidman LJ, et al. #Schizophrenia: Use and misuse on Twitter. Schizophr Res. Jul 2015;165(2-3):111-115. [CrossRef] [Medline]
    13. Birnbaum ML, Rizvi AF, Correll CU, Kane JM. Role of social media and the Internet in pathways to care for adolescents and young adults with psychotic disorders and non-psychotic mood disorders. Early Interv Psychiatry. Mar 23, 2015. [CrossRef] [Medline]
    14. Naslund JA, Aschbrenner KA, Bartels SJ. How people with serious mental illness use smartphones, mobile apps, and social media. Psychiatr Rehabil J. Dec 2016;39(4):364-367. [FREE Full text] [CrossRef] [Medline]
    15. Naslund JA, Grande SW, Aschbrenner KA, Elwyn G. Naturally occurring peer support through social media: The experiences of individuals with severe mental illness using YouTube. PLoS One. 2014;9(10):e110171. [FREE Full text] [CrossRef] [Medline]
    16. Naslund JA, Aschbrenner KA, McHugo GJ, Unützer J, Marsch LA, Bartels SJ. Exploring opportunities to support mental health care using social media: A survey of social media users with mental illness. Early Interv Psychiatry. Oct 20, 2017. [CrossRef] [Medline]
    17. Birnbaum ML, Ernala SK, Rizvi AF, De Choudhury M, Kane JM. A collaborative approach to identifying social media markers of schizophrenia by employing machine learning and clinical appraisals. J Med Internet Res. Aug 14, 2017;19(8):e289. [FREE Full text] [CrossRef] [Medline]
    18. McManus K, Mallory EK, Goldfeder RL, Haynes WA, Tatum JD. Mining Twitter data to improve detection of schizophrenia. AMIA Jt Summits Transl Sci Proc. 2015;2015:122-126. [FREE Full text] [Medline]
    19. Ernala SK, Rizvi AF, Birnbaum ML, Kane JM, De Choudhury M. Linguistic markers indicating therapeutic outcomes of social media disclosures of schizophrenia. In: Proceedings of the ACM on Human-Computer Interaction. New York, NY. ACM; 2017. Presented at: ACM on Human-Computer Interaction; May 6-11, 2017; Denver, CO. [CrossRef]
    20. Hswen Y, Naslund JA, Brownstein JS, Hawkins JB. Online communication about depression and anxiety among Twitter uers with schizophrenia: Preliminary findings to inform a digital phenotype using social media. Psychiatr Q. Jan 12, 2018. [CrossRef] [Medline]
    21. Greenwood S, Perrin A, Duggan M. Social Media Update 2016. Washington, DC. Pew Research Center; Nov 11, 2016. URL: http:/​/www.​pewinternet.org/​wp-content/​uploads/​sites/​9/​2016/​11/​PI_2016.​11.​11_Social-Media-Update_FINAL.​pdf [accessed 2018-11-09] [WebCite Cache]
    22. Taylor PJ, Hutton P, Wood L. Are people at risk of psychosis also at risk of suicide and self-harm? A systematic review and meta-analysis. Psychol Med. Apr 2015;45(5):911-926. [CrossRef] [Medline]
    23. Statista. 2018. URL: https://www.statista.com/statistics/282087/number-of-monthly-active-twitter-users/ [accessed 2018-11-08] [WebCite Cache]
    24. Aslam S. Omnicore. 2018. URL: https://www.omnicoreagency.com/twitter-statistics/ [accessed 2018-11-08] [WebCite Cache]
    25. McCormick TH, Lee H, Cesare N, Shojaie A, Spiro ES. Using Twitter for demographic and social science research: Tools for data collection and processing. Sociol Methods Res. Aug 2017;46(3):390-421. [FREE Full text] [CrossRef] [Medline]
    26. Coppersmith G, Dredze M, Harman C. Quantifying mental health signals in Twitter. In: Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality. 2014. Presented at: Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; June 27, 2014; Baltimore, MD. URL: http://www.aclweb.org/anthology/W14-3207
    27. Reavley NJ, Pilkington PD. Use of Twitter to monitor attitudes toward depression and schizophrenia: An exploratory study. PeerJ. 2014;2:e647. [FREE Full text] [CrossRef] [Medline]
    28. McKee R. Ethical issues in using social media for health and health care research. Health Policy. May 2013;110(2-3):298-301. [CrossRef] [Medline]
    29. Conway M, O'Connor D. Social media, big data, and mental health: Current advances and ethical implications. Curr Opin Psychol. Jun 2016;9:77-82. [FREE Full text] [CrossRef] [Medline]
    30. Webb H, Jirotka M, Stahl B, Housley W, Edwards A, Williams M, et al. The ethical challenges of publishing Twitter data for research dissemination. In: Proceedings of the 2017 ACM on Web Science Conference. 2017. Presented at: 2017 ACM on Web Science Conference; June 25-28, 2017:339-348; Troy, NY. [CrossRef]
    31. Conway M. Ethical issues in using Twitter for public health surveillance and research: Developing a taxonomy of ethical concepts from the research literature. J Med Internet Res. 2014;16(12):e290. [FREE Full text] [CrossRef] [Medline]
    32. Guntuku S, Yaden D, Kern M, Ungar L, Eichstaedt J. Detecting depression and mental illness on social media: An integrative review. Curr Opin Behav Sci. Dec 2017;18:43-49. [CrossRef]
    33. Williams ML, Burnap P, Sloan L. Towards an ethical framework for publishing Twitter data in social research: Taking into account users' views, online context and algorithmic estimation. Sociology. Dec 2017;51(6):1149-1168. [FREE Full text] [CrossRef] [Medline]
    34. Mitchell M, Hollingshead K, Coppersmith G. Quantifying the language of schizophrenia in social media. In: Proceedings of the 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality. Association for Computational Linguistics; 2015. Presented at: 2nd Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality; June 5, 2015:11-20; Denver, CO. URL: http://www.aclweb.org/anthology/W15-1202
    35. Twitter. 2017. URL: https://developer.twitter.com/en/docs/tutorials/consuming-streaming-data [accessed 2018-11-08] [WebCite Cache]
    36. Hawton K. Sex and suicide: Gender differences in suicidal behaviour. Br J Psychiatry. Dec 2000;177:484-485. [Medline]
    37. Piccinelli M, Wilkinson G. Gender differences in depression: Critical review. Br J Psychiatry. Dec 2000;177:486-492. [FREE Full text] [Medline]
    38. McLean CP, Asnaani A, Litz BT, Hofmann SG. Gender differences in anxiety disorders: Prevalence, course of illness, comorbidity and burden of illness. J Psychiatr Res. Aug 2011;45(8):1027-1035. [FREE Full text] [CrossRef] [Medline]
    39. McIver DJ, Hawkins JB, Chunara R, Chatterjee AK, Bhandari A, Fitzgerald TP, et al. Characterizing sleep issues using Twitter. J Med Internet Res. Jun 08, 2015;17(6):e140. [FREE Full text] [CrossRef] [Medline]
    40. O'Dea B, Larsen ME, Batterham PJ, Calear AL, Christensen H. A linguistic analysis of suicide-related Twitter posts. Crisis. Sep 2017;38(5):319-329. [CrossRef] [Medline]
    41. Fodeh S, Goulet J, Brandt C, Hamada AT. Leveraging Twitter to better identify suicide risk. In: Proceedings of The First Workshop Medical Informatics and Healthcare held with the 23rd SIGKDD Conference on Knowledge Discovery and Data Mining, PMLR. 2017. Presented at: The First Workshop Medical Informatics and Healthcare held with the 23rd SIGKDD Conference on Knowledge Discovery and Data Mining, PMLR; August 13-17, 2017:1-7; Halifax, NS. URL: http://proceedings.mlr.press/v69/fodeh17a/fodeh17a.pdf
    42. Sueki H. The association of suicide-related Twitter use with suicidal behaviour: A cross-sectional study of young Internet users in Japan. J Affect Disord. Jan 1, 2015;170:155-160. [CrossRef] [Medline]
    43. Lewinsohn PM, Rohde P, Seeley JR. Psychosocial risk factors for future adolescent suicide attempts. J Consult Clin Psychol. Apr 1994;62(2):297-305. [Medline]
    44. Walker ER, McGee RE, Druss BG. Mortality in mental disorders and global disease burden implications: A systematic review and meta-analysis. JAMA Psychiatry. Apr 2015;72(4):334-341. [FREE Full text] [CrossRef] [Medline]
    45. Hawton K, Sutton L, Haw C, Sinclair J, Deeks JJ. Schizophrenia and suicide: Systematic review of risk factors. Br J Psychiatry. Jul 2005;187:9-20. [FREE Full text] [CrossRef] [Medline]
    46. Sareen J, Cox BJ, Afifi TO, de Graaf R, Asmundson GJG, ten Have M, et al. Anxiety disorders and risk for suicidal ideation and suicide attempts: A population-based longitudinal study of adults. Arch Gen Psychiatry. Nov 2005;62(11):1249-1257. [CrossRef] [Medline]
    47. Pallanti S, Quercioli L, Hollander E. Social anxiety in outpatients with schizophrenia: A relevant cause of disability. Am J Psychiatry. Jan 2004;161(1):53-58. [CrossRef] [Medline]
    48. De Choudhury M, Kiciman E, Dredze M, Coppersmith G, Kumar M. Discovering shifts to suicidal ideation from mental health content in social media. Proc SIGCHI Conf Hum Factor Comput Syst. May 2016;2016:2098-2110. [FREE Full text] [CrossRef] [Medline]
    49. Naslund JA, Aschbrenner KA, Marsch LA, Bartels SJ. The future of mental health care: Peer-to-peer support and social media. Epidemiol Psychiatr Sci. Apr 2016;25(2):113-122. [FREE Full text] [CrossRef] [Medline]
    50. Kasckow J, Felmet K, Zisook S. Managing suicide risk in patients with schizophrenia. CNS Drugs. Feb 2011;25(2):129-143. [FREE Full text] [CrossRef] [Medline]
    51. Rice S, Robinson J, Bendall S, Hetrick S, Cox G, Bailey E, et al. Online and social media suicide prevention interventions for young people: A focus on implementation and moderation. J Can Acad Child Adolesc Psychiatry. 2016;25(2):80-86. [FREE Full text] [Medline]
    52. Cesare N, Grant C, Hawkins J, Brownstein J, Nsoesie E. Demographics in social media data for public health research: Does it matter? In: Proceedings of Data for Good Exchange 2017. New York, NY. Bloomberg; 2017. Presented at: Data for Good Exchange 2017; New York, NY; September 24, 2017. URL: https://arxiv.org/ftp/arxiv/papers/1710/1710.11048.pdf
    53. Global Burden of Disease Study 2013 Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990-2013: A systematic analysis for the Global Burden of Disease Study 2013. Lancet. Aug 22, 2015;386(9995):743-800. [FREE Full text] [CrossRef] [Medline]
    54. Bolton JM, Gunnell D, Turecki G. Suicide risk assessment and intervention in people with mental illness. BMJ. Nov 09, 2015;351:h4978. [Medline]

    ‎
    UTC: universal time code

    Edited by G Eysenbach; submitted 04.07.18; peer-reviewed by M Birk, J Robinson; comments to author 05.09.18; revised version received 13.09.18; accepted 14.09.18; published 13.12.18.

    Copyright

    ©Yulin Hswen, John A Naslund, John S Brownstein, Jared B Hawkins. Originally published in JMIR Mental Health (http://mental.jmir.org), 13.12.2018.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on http://mental.jmir.org/, as well as this copyright and license information must be included.