Published on in Vol 11 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/53730, first published .
Emerging Trends of Self-Harm Using Sodium Nitrite in an Online Suicide Community: Observational Study Using Natural Language Processing Analysis

Emerging Trends of Self-Harm Using Sodium Nitrite in an Online Suicide Community: Observational Study Using Natural Language Processing Analysis

Emerging Trends of Self-Harm Using Sodium Nitrite in an Online Suicide Community: Observational Study Using Natural Language Processing Analysis

1Department of Biomedical Informatics, School of Medicine, Emory University, , Atlanta, GA, , United States

2Department of Behavioral, Social, and Health Education Sciences, Rollins School of Public Health, Emory University, , Atlanta, GA, , United States

3Department of Computer Science and Informatics, Emory University, , Atlanta, GA, , United States

4National Center for Injury Prevention and Control, Centers for Disease Control and Prevention, , Atlanta, GA, , United States

5Department of Biomedical Engineering, Georgia Institute of Technology and Emory University, , Atlanta, GA, , United States

Corresponding Author:

Sudeshna Das, PhD


Background: There is growing concern around the use of sodium nitrite (SN) as an emerging means of suicide, particularly among younger people. Given the limited information on the topic from traditional public health surveillance sources, we studied posts made to an online suicide discussion forum, “Sanctioned Suicide,” which is a primary source of information on the use and procurement of SN.

Objective: This study aims to determine the trends in SN purchase and use, as obtained via data mining from subscriber posts on the forum. We also aim to determine the substances and topics commonly co-occurring with SN, as well as the geographical distribution of users and sources of SN.

Methods: We collected all publicly available from the site’s inception in March 2018 to October 2022. Using data-driven methods, including natural language processing and machine learning, we analyzed the trends in SN mentions over time, including the locations of SN consumers and the sources from which SN is procured. We developed a transformer-based source and location classifier to determine the geographical distribution of the sources of SN.

Results: Posts pertaining to SN show a rise in popularity, and there were statistically significant correlations between real-life use of SN and suicidal intent when compared to data from the Centers for Disease Control and Prevention (CDC) Wide-Ranging Online Data for Epidemiologic Research (⍴=0.727; P<.001) and the National Poison Data System (⍴=0.866; P=.001). We observed frequent co-mentions of antiemetics, benzodiazepines, and acid regulators with SN. Our proposed machine learning–based source and location classifier can detect potential sources of SN with an accuracy of 72.92% and showed consumption in the United States and elsewhere.

Conclusions: Vital information about SN and other emerging mechanisms of suicide can be obtained from online forums.

JMIR Ment Health 2024;11:e53730

doi:10.2196/53730

Keywords



Background

Suicide rates in the United States continue to rise and remain near their highest levels in more than 2 decades [1,2]. There were 48,183 suicides in the United States in 2021, which is 5% higher than the reported number in 2020 [3]. Poisoning is the most common mechanism of suicide attempts in the United States [4] and the third-leading mechanism involved in suicides [5]. One factor complicating suicide prevention efforts is the continual emergence and promotion of new means by which one can attempt suicide, such as novel substances.

Since 2019, a growing trend of using sodium nitrite (SN), a common food additive, for self-harm has been reported [6,7]. SN has traditionally been used as a food preservative and coloring agent, in addition to use as a corrosion inhibitor. As such, it is widely available for purchase. An alarming development has been the sale of “suicide kits” in online marketplaces, which comprise SN in addition to instructional material on attempting suicide [8]. Instances of the use of such suicide kits have been reported in the literature [9]. Furthermore, media reports of celebrity suicides from SN ingestion have raised public awareness of this means of self-harm. As a widely available, water-soluble salt with reported lethal dosages of as low as 0.7 g [10], the potentially growing popularity of SN as a suicide mechanism is concerning. Between 2018 and 2020, the annual suicide rate involving SN increased from 0.01 to 0.09 per 100,000 person-years in the United States [11]. Although there are concerns about increased youth suicides due to media contagion [12], studies show that adhering to suicide reporting guidelines [13] can raise awareness and have a protective effect through the coverage of positive coping mechanisms [14].

The consumption of SN induces methemoglobinemia, a condition resulting in hypoxia, and if not treated promptly, it can result in death. Although the unintentional consumption of SN due to misleading or dubious storage practices is of concern [15], the consumption of SN with the intent of self-harm has also been reported in countries such as Australia, Portugal, and South Korea [6]. It is believed that global popularization of SN, instruction on its use in suicide, and sharing of information about procuring SN has been facilitated by online forums such as “Sanctioned Suicide” [15], about which little is known.

Online Suicide Forums

Online forums provide a platform for users with similar interests to share their views on common topics of interest. Internet support forums exist for a wide variety of health-related issues, including mental health and suicide-related behaviors. Sanctioned Suicide is the successor of the eponymous subreddit (a topic-specific forum), which was banned in March 2018 for violating Reddit’s policies on content promoting self-harm and specific suicide methods [15]. The purpose of the website, as mentioned in their frequently asked questions [16], is to allow individuals to discuss suicide—including suicide methods—without the content screening that occurs on more prominent social media platforms. Thus, this forum encapsulates a large amount of suicide-related information that can be of high utility for planning and enacting public health measures to prevent suicides. The large volume of data, however, also makes it impractical to manually review the content continuously to generate timely and evolving insights. Automated methods are thus required to optimally leverage this resource of publicly available information.

Objective

Although the use of SN for suicide has elevated to the level of congressional interest in the United States [17], little is known about epidemiologic trends from Sanctioned Suicide that could inform prevention efforts. The key strategies highlighted in the Suicide Prevention Resource for Action [18] by the US Centers for Disease Control and Prevention (CDC) call for “data-driven strategic planning with engagement from multi-sectoral partners” for making decisions associated with the prevention of suicides in the United States [17]. In line with the objectives and guidance set out in this resource, in this paper, we adopt a data-driven approach using natural language processing (NLP) and other techniques to study large-scale public posts from Sanctioned Suicide to answer critical questions relevant to suicide prevention efforts:

  1. Does interest in SN appear to be increasing over time on the forum, and how does this interest compare to other mechanisms of suicide?
  2. Are there other co-occurring substances or topics of interest relevant to SN?
  3. What are the leading countries and vendors of SN that are being promoted?

Data Collection and Preprocessing

We collected data from the website “Sanctioned Suicide,” an online community dedicated to discussing “the topic of suicide without the censorship of other places” [16], which has received substantial attention because of its rising popularity in the recent past [15]. Figure 1 presents the structure of the Sanctioned Suicide network. As the figure illustrates, the social network is broadly divided into 3 types of discussion based on topic (suicide, recovery, and off-topic). We collected all posts available on the website from March 22, 2018 (the date on which the website went live), to October 7, 2022 (the date of data collection). We removed duplicate posts and applied preprocessing steps that are standard in NLP, namely tokenization, lowercasing, punctuation removal, stop-word removal, and lemmatization.

Figure 1. Overall structure of the Sanctioned Suicide website. Threads are organized under 3 broad categories: suicide discussion, recovery, and off-topic.

Data-Driven Analysis of Suicide Mechanisms

Suicide Mechanism Detection and Trend Analysis

Our first objective was to detect mentions of SN as well as other specific substances and suicide methods. As is common over social media, many lexical variants are used to discuss SN and other substances or methods. Not including commonly used lexical variants leads to low-sensitivity data collection [19]. We took a data-driven approach to identify all the relevant lexical variants for SN. We trained a Word2Vec model using n-grams (n=1, 2, and 3) from the entire data set, which enabled us to automatically identify lexical expressions that are the most semantically similar to SN. We manually reviewed these terms and identified, in addition to alternative names for SN, keywords associated with other suicide mechanisms. In consultation with our subject matter experts, we manually grouped these keywords into 14 categories: “sodium nitrite,” “cyanides,” “firearms,” “hanging,” “acid regulators,” “ricin,” “plant-based poisons,” “antiemetics,” “other preservatives,” “nitric oxide,” “household chemicals,” “barbiturates,” “benzodiazepines,” and “opioids.” The complete list of suicide mechanism–related terms identified is given in Table S1 in Multimedia Appendix 1.

We performed automatic searches over the whole data set to compute the frequencies of posts mentioning each method of suicide over time. A post that mentioned any number of lexical variants associated with a suicide method counted toward that method. For example, a post mentioning only “NaNO2” is assigned the group “sodium nitrite,” whereas a post mentioning “gun” and “full suspension” is assigned the group labels “firearms” and “hanging.” We computed the monthly and normalized frequencies of posts mentioning each of these categories to analyze their temporal trends.

Comparison of Trends With Traditional Data

We compared the temporal trends of SN mentions we discovered from the above analysis with relevant metrics reported in two more traditional sources: (1) intentional exposures to SN in the US National Poison Data System (NPDS) and (2) death counts in the CDC Wide-Ranging Online Data for Epidemiologic Research (WONDER) database. For the first comparison, we compared our data against the quarterly intentional exposures to SN from the NPDS reported by McCann et al [10]. For the second comparison, we compared against the reported deaths under the underlying cause of death codes U03, X60–X84, and Y87.0 and multiple causes of death code T50.6 from the CDC WONDER database. For the latter, to make the comparison better aligned with the traditional data source, we combined our keyword mention counts pertaining to “sodium nitrite” and “other preservatives.” We performed a Spearman rank correlation test to assess possible associations between the pairs of statistics.

Co-Occurrence Analysis and Topic Modeling

We performed a co-occurrence analysis to compute the number of times different suicide methods we already identified were mentioned together. The intuition behind this analysis was that suicide methods that are considered together or substances that are taken together (eg, substances taken alongside SN) are likely to be mentioned more frequently in the same posts.

To obtain further insights about the topics associated with SN chatter, we conducted a topic modeling experiment. Topic modeling is a class of unsupervised algorithms that attempt to identify clusters of lexical elements that belong to latent topics from large sets of texts. Since the process is purely unsupervised, the topic clusters are not known a priori. We applied the BERTopic model, an unsupervised topic modeling approach that automatically clusters content from posts into a mathematically optimized number of topics [20].

Identification of SN Sources and Consumer Locations

Named Entity Recognition

Purchasing, sourcing, and procurement of SN were identified as common topics of discussion during the analyses mentioned above (see the Results section), so we used a 2-fold approach to identify information about both the retail venues and the geographic locations where SN was being sought for purchase. Specifically, we leveraged named entity recognition (NER) models trained on large web-based data sets to identify potential sources of SN: locations, organizations, and keywords used to look for SN on online marketplaces. NER is an information extraction technique used to discover named entities (such as organizations, locations, etc) in a textual corpus (Figure 2).

Figure 2. Examples of named entity recognition from Sanctioned Suicide posts from March 2018 to September 2022. Detected entities, their spans, and their inferred types are shown. GPE: geopolitical entity; ORG: organization; SN: sodium nitrite.

We used an NER algorithm available in the Python programming language (spaCy NER [21]) to detect possible locations or sources from which people seek or obtain SN. Apart from using spaCy’s location entity label, we created a custom entity called “Suicide_Method” that would identify the substance in the text and highlight it. We used the rule-based pattern recognizer in spaCy to detect mentions of SN. In particular, we used the pattern “sn” to detect mentions of SN (the code snippet is shown in Multimedia Appendix 1). Posts where SN was mentioned in conjunction with location names were used for further analysis. The location entity recognizer of spaCy has a reported F1-score of 0.916 [22].

Location Mention–Intent Classifier

The locations identified by the NER methods represented both sources of SN and consumer locations, and thus, the process required further disambiguation. We modeled this disambiguation as a supervised classification task and trained a transformer-based location classifier to classify the locations obtained from NER as “consumer location” and “purchase location.” Transformer models leverage large amounts of “pre-trained” language data, which can then be fine-tuned on a specific task—such as location type identification, in the case of this study [23]. Sentence-level annotation of location mentions was carried out by 2 of the authors to create a gold-standard training data set for fine-tuning the model. The annotation process was carried out iteratively, with the annotation guidelines being refined after each round of annotation. Disagreements were resolved after a detailed discussion between 3 of the authors to reach a consensus after each round. Two rounds of annotation were performed, and interannotator agreement was computed based on Cohen κ, revealing good agreement for both source location (κ=0.80) and consumer location (κ=0.84) [24]. A total of 722 samples were annotated, of which 577 (80%) were used for training and the remaining 145 (20%) were used for testing.

From the many transformer-based models that are publicly available, we chose the RoBERTa model [25], which is based on Bidirectional Encoder Representations From Transformers [26] and has been shown to achieve state-of-the-art results on several language processing tasks similar to those by the base model, including for health-related, social media–based text classification tasks [27]. Our use of “state-of-the-art” refers to the best-performing machine or deep learning models currently available for each task, in the rest of the paper. We used the embeddings obtained from RoBERTa to fine-tune our model using the training data. We computed the distributions of the sources and locations identified automatically for analysis. Classification results and all outputs are provided in the Results section.

Ethical Considerations

This study was deemed to be exempt from review (publicly available data) by the Emory University Institutional Review Board. Our analyses use publicly available, user-generated content from an online forum where users remain anonymous by default. We do not use any personally identifiable information and only report aggregated data.


Data Collection and Frequency Analysis

Overview

A total of 1,337,982 posts were collected. Of these, 1,302,620 were posted under the “Discussion” threads; 28,666 under the “Poll” thread; and 6696 under the “Question” threads. Preprocessing and removal of duplicate posts resulted in 1,329,042 total posts. There was a steady increase in the total number of posts from 2018 to 2020, followed by a slight decrease in 2021. The highest number of posts on the website was made in 2020. In the months leading up to September 2022, the final full month of data collection, the total number of monthly posts was generally higher than in the corresponding months in 2021 (Figure S1 in Multimedia Appendix 1).

Temporal SN Trends

Figure 3 shows the relative monthly frequencies for posts mentioning SN, as well as other substances and methods associated with suicides. From the figure, it can be observed that SN was the most popular means of suicide discussed in this online community, and the frequency of mentions of SN increased over time. A sharp rise in SN mentions can be seen towards the end of 2019, with the frequency of mentions remaining elevated thereafter.

Figure 3. Normalized frequencies of posts on Sanctioned Suicide mentioning potential suicide means and related substances per month from March 2018 to September 2022.
Comparison of Trends With Traditional Data

SN-related deaths due to intentional consumption have increased since 2019 [28]. Our analyses align with this uptick of SN ingestions and suicides: a sharp increase in the mentions of purchases of SN was seen toward the end of 2019 (Figure 3). In our comparison against the NPDS data, we obtained a Spearman ⍴ of 0.866 (P=.001), revealing a statistically significant association between the 2 data sources. On visualizing the normalized frequencies of intentional exposures in the NPDS and purchases made as obtained from our data set (see the Sources and Consumer Locations section), we found that both the noncumulative and cumulative frequencies showed similar trends (Figure 4) for the 10 quarters spanning from 2018 to 2020 for which data from both sources were available (quarters 1 to 4 for 2018 and 2019, and quarters 1 and 2 for 2020). Although the mentions of purchases on Sanctioned Suicide are not exclusive to the United States, the similar trends are a strong indicator of online suicide community content reflecting real-life suicide incidences.

Figure 4. Comparison of normalized frequencies of purchase mentions on Sanctioned Suicide (SS) versus National Poison Data System (NPDS) exposures as reported in McCann et al [10], from 2018 to 2020. (A) Noncumulative frequencies; (B) cumulative frequencies. Q: quarter.

In the comparison against metrics from the CDC WONDER database, we obtained a Spearman ⍴ of 0.727 (P<.001) for month-by-month frequencies during the time period from March 2018 to December 2021 for SN purchases versus actual deaths and a Spearman ⍴ of 0.775 (P<.001) for keyword mentions versus actual deaths, revealing statistically significant correlation in both cases (Figure 5).

Figure 5. Comparison of normalized frequencies. (A) Purchase mentions of “sodium nitrite“ on Sanctioned Suicide versus actual deaths reported in the CDC WONDER database from 2018 to 2021; (B) keyword mentions of “sodium nitrite” and “other preservatives” on Sanctioned Suicide versus actual deaths reported in the CDC WONDER database. Suicide deaths involving chelating agents were identified by using the International Classification of Diseases, Tenth Revision underlying cause of death codes U03, X60–X84, and Y87.0 and multiple causes of death code T50.6. CDC: Centers for Disease Control and Prevention; WONDER: Wide-Ranging Online Data for Epidemiologic Research.
Co-mentioned Suicide Mechanisms

The heatmap in Figure 6 presents the co-occurrence frequencies between different substances and methods. As illustrated in the figure, co-occurring mentions of SN and antiemetics are common. Manual qualitative inspection of these posts revealed that antiemetics are often mentioned when discussing SN, as forum users recommended these substances to ensure that individuals do not feel nauseous after consuming SN.

Figure 6. Heatmap illustrating the most commonly co-occurring suicide mechanism mentions in Sanctioned Suicide posts from March 2018 to September 2022.
Topic Modeling

Topic modeling revealed further insights and some key differences in the content of posts. First, the topics discovered reinforced some of the insights revealed in Figure 3. For the SN group, unigram and bigram topic clusters represented the following:

  • Substances that are potentially coingested (benzodiazepines, antiemetics, and metoclopramide);
  • Dosage amounts (“tablespoon” and “grams”);
  • Sourcing-related questions and information (“I’m looking,” “source,” “ordered,” and “package”);
  • Comparison with other mechanisms of suicide (“hanging” and “shotgun”);
  • Mechanism of action and symptoms (“hypoxia” and “peaceful way”); and
  • Descriptions of experiences, thoughts, and suicide notes (“failed attempt,” “feel like,” and “I’m sorry”).

Figures S2 and S3 in Multimedia Appendix 1 present all the topics.

Sources and Consumer Locations

Overview

Based on the aforementioned topic modeling experiment results and supplemented with manual qualitative inspection of SN-related posts, we curated a list of phrases related to sourcing (eg, “seller,” “bought,” and “purchase”). The complete list is given in Table S2 in Multimedia Appendix 1. Since we collected data from Sanctioned Suicide on October 7, 2022, we extrapolated the frequency of posts from 279 days before (January 1, 2022, to October 7, 2022) by multiplying the per-day frequency with the total number of days in the year. Frequency analysis of sourcing-related posts pertaining to SN shows a sharp rise in “purchase” toward the end of 2019, with the highest raw annual “purchase” frequency observed in 2020 (Figure 7). Figure 8 shows the sourcing frequency (purchase frequency) of SN normalized by the posting frequency of SN-related topics. We found that discussions about the sourcing of SN gradually increased over the years.

Figure 7. Raw yearly purchase frequency of sodium nitrite from Sanctioned Suicide posts from March 2018 to December 2022 (extrapolated to the period from October to December 2022).
Figure 8. Normalized yearly purchase frequency of sodium nitrate from Sanctioned Suicide posts from March 2018 to December 2022 (extrapolated to the period from October to December 2022).
SN Sources and Consumer Locations

The NER approach detected locations that included countries, states, cities, counties, etc. We manually analyzed the detected locations to create a location-mapping dictionary, which was used to map cities to countries. The United States, the United Kingdom, Canada, China, and Germany were found to be the most popular potential locations for obtaining or using SN (Table 1). Since the locations detected were primarily from the United States, we also mapped locations detected from within the United States to the state level. The states of California, New York, Florida, Texas, and Oregon were found to be mentioned the most often in association with SN.

Table 1. Identified geographical locations from Sanctioned Suicide posts, from March 2018 to September 2022, associated with the sourcing or use of sodium nitrite.
RankCountry-level locationsUS state–level locations
CountryFrequency, nUS stateFrequency, n
1United States1043California149
2United Kingdom774New York104
3Canada358Florida67
4China202Texas63
5Germany185Oregon50
6Mexico170Washington41
7Australia164Pennsylvania30
8India163North Carolina and Virginiaa23
9Netherlands146Illinois20
10Switzerland144Arizona18
11Russia140Massachusetts17
12France128Utah16
13Japan and Spaina96Michigan and Nevadaa15
14Poland90Colorado13

aLocations with equal frequencies, presented in alphabetical order.

Location Mention–Intent Classification

Although NER-based geographical sources are informative, we found that consumers often tend to circumvent naming the geographical and online sources from where they obtained SN. Consider the following post: “I ordered it off of the big river in Brazil website.” NER identifies “Brazil” as a potential geographical source of SN in this example. However, the user is referring to the online source “Amazon” rather than the geographical source “Brazil.” Furthermore, locations mentioned in posts may also refer to the consumer’s location rather than the location where SN was sourced. This necessitated building a classifier to identify the intent of mentioning the location. Our proposed location mention–intent classifier achieved an accuracy of 72.92% on the unseen test data set, outperforming traditional machine learning–based baselines (Table 2).

Table 2. Performance of the transformer-based, location mention–intent classifier on Sanctioned Suicide posts from March 2018 to September 2022.
ModelRandom classifierSupport vector machine classifierOur model
Accuracy0.250.340.72
Precision0.250.370.73
Recall0.250.320.76
F1-score0.250.350.74
Sources and Consumer Locations

Based on the NER and subsequent classification process, the United States, the United Kingdom, Canada, Australia, and China were found to be the most popular source locations for obtaining SN (Table 3). The states of California, New Mexico, Florida, Rhode Island, and Oklahoma were reported to be the most popular sourcing locations for SN within the United States.

Table 3. Locations where sodium nitrite was potentially sourced from, as obtained from Sanctioned Suicide posts from March 2018 to September 2022.
RankCountry-level locationsUS state–level locations
CountryFrequency, nStateFrequency, n
1United States586California55
2United Kingdom303New Mexico44
3Canada129Florida24
4Australia122Rhode Island21
5China83Oklahoma13
6Germany and Mexicoa80Virginia12
7India67Minnesota, New York, North Dakota, and Vermonta8
8Netherlands53Arizona, Georgia, Maryland, and Oregona7
9Russia45Alabama, Illinois, Massachusetts, and Texasa6

aLocations with equal frequencies, presented in alphabetical order.

The consumers who were interested in or attempted to obtain SN primarily were from the United States, the United Kingdom, Canada, Mexico, and Australia (Table 4). Within the United States, the states of California, New York, Texas, Florida, and Pennsylvania were found to be the most common locations of consumers attempting to obtain SN. For user-level post frequency, the mean was 72.63 (median 13, IQR 4-46; range 1-14,795).

Table 4. Locations where consumers attempting to procure sodium nitrite were from, as obtained from the Sanctioned Suicide posts from March 2018 to September 2022.
RankCountry-levelUS State-level
CountryFrequency, nStateFrequency, n
1United States150California22
2United Kingdom107New York and Texasa10
3Canada41Florida6
4Mexico23Pennsylvania5
5Australia22Oregon4
6China21Colorado, Maryland, Massachusetts, Oklahoma, and Washingtona3
7India15Alaska, Illinois, New Jersey, Ohio, and Utaha2
8Russia and Switzerlanda12Arizona, Connecticut, Georgia, Indiana, Kentucky, Louisiana, Michigan, Mississippi, South Carolina, and Wisconsina1
9Brazil10N/AbN/A

aLocations with equal frequencies, presented in alphabetical order.

bN/A: not applicable.

Potential Online Sources

Our NER-based approach also revealed potential online sources of obtaining SN or information about obtaining SN. Online marketplaces were the most commonly mentioned potential sources of SN (Table 5).

Table 5. Possible internet-based sources of sodium nitrite mentioned from Sanctioned Suicide posts from March 2018 to September 2022.
RankOnline sourceFrequency, n
1Online15,601
2Google6314
3YouTube5173
4Amazon2909
5Facebook2837
6eBay2373
7Pharmacy800
8Walmart621
9Online pharmacy593
10Craigslist148
11Alibaba84
12Etsy81
13CVS69
14Tesco51
15Walgreens45
16AliExpress26
17Taobao4

Principal Findings

Our study is the first to conduct a comprehensive, NLP-based assessment of a large, popular, and public suicide forum. Our findings show that SN is the most popular method of suicide discussed on the forum, perhaps indicating the rising popularity of SN in real life. The trends we discovered suggest that the popularity of SN might still be increasing. Our study also revealed topics associated with SN discussions, among which sourcing was a common one. The application of automated NLP methods such as NER and classification enabled us to rapidly aggregate the locations and sources and compute their frequencies. Our findings and the data mining resources we are releasing with this paper will aid much-needed future research on this topic.

Online Sources of SN

Our analyses show the distinct role of online marketplaces as a source of SN (Table 5). As a common food additive approved for use [29] in several countries, such as the United States [30], the United Kingdom [31], New Zealand, and Australia [32], SN is widely available for procurement. However, SN is now listed as a poison in the United Kingdom and, thus, is considered to be a reportable substance whose sale is regulated and requires an Explosive Precursors and Poisons license [31]. Some online marketplaces, such as Etsy and eBay [33], have now implemented restrictions prohibiting the sale of SN through their website [28]. Overall, however, there remains a wide availability of products containing SN on internet marketplaces.

Trends in SN Use for Self-Harm

SN as a suicide mechanism has been reported in the medical literature as early as 1979 [34]. Since then, there have been a limited number of case reports in the literature through 2019, including one paper presenting 10 cases of SN consumption with the intent for self-harm [6]. Since 2019, case reports of SN-related deaths due to intentional consumption have increased [28], which is reflected in both the online community data as well as reported exposures (Figure 4) and deaths from official databases (Figure 5). This trend of rising instances of SN use for self-harm is concerning and may benefit from broader scientific interest. The literature on the topic is still sparse though, particularly at the intersection of SN and social media or internet-based data.

Utility of Internet-Based Data

Internet-based data hold substantial potential for the surveillance of suicide methods, particularly emerging topics such as the one we studied in this paper. Recent advances in data-centric artificial intelligence methods, particularly NLP, have opened up opportunities for rapidly analyzing such data, as we did in this study. While our paper is the first to take such a data-driven approach to fully describe the contents of this forum from an epidemiologic perspective, other recent papers have attempted to analyze data from it. Sartori et al [35], for example, investigated the impact of COVID-19 by studying posts from this forum, and they found that COVID-19 appeared to be indirectly connected to causes of distress for the users, such as anxiety for the economy, but not directly to the growth of users on the forum. Dilkes [36] took a more linguistic investigation approach and analyzed changes in language to evaluate the social and psychological effect of participation in the forum. In a more recent commentary, Dinis-Oliveira and Durão [37] further highlighted the importance of studying the forum, how it plays a role in providing guidance on how to use SN as a means of suicide, and the rapid increase in its popularity. Although our study takes a necessary next step in the use of this data source for public health work, this information can also be leveraged to address this emerging public health problem in the United States and globally in the form of locally targeted interventions, such as notices for emergency personnel about signs, symptoms, and treatment in locations prone to the issue [38,39].

Conclusion

In this study, we adopted a data-driven approach to analyze the trends in SN mentions on an online suicide forum using NLP and machine learning–based techniques. Our findings show that online forums can be an important source of information about emerging trends in suicide mechanisms. We also show that it is possible to obtain geographical trends of use and sourcing with our proposed location mention–intent classifier, with high accuracy. Since suicide is a rising concern in the United States and worldwide, we believe our study can be key to understanding temporal trends in suicide mechanisms and provide insights to the public health community by leveraging large amounts of online data sources.

Limitations and Future Work

Since we used Sanctioned Suicide as our primary data source, a limitation of our study is that the distribution of users appears to be largely from the United States. This is reflected in both the location-based analyses and the close association of Sanctioned Suicide trends with the CDC WONDER and the NPDS data. Differences in access to the internet and cyber literacy across the world further contribute to this distribution. The posts used in this study were in English, which may also have caused users from non–English-speaking countries to be underrepresented. Our NLP and machine learning methods also impose some limitations—the classification abilities of our models are not perfect, and errors can affect downstream tasks. In our study, however, the presence of a large volume of data helps to offset the influence of individual errors; furthermore, the use of machine learning is necessary in analyzing data that are too large to qualitatively assess by manual processes.

In the future, we aim to attempt to improve our NER and classification approaches so that more accurate information about sources and locations can be obtained in close to real time. We will also attempt to develop NLP tools that can automatically discover novel substances and mechanisms gaining popularity in that community. The resources we are sharing with this publication (lexicons, lists of phrases and keywords, and language models) are intended to support researchers to conduct their own data-driven studies on the topic.

Intentional SN ingestion remains an ongoing concern for suicide prevention work. The ease of accessibility and lethality of the substance present a unique challenge for public health efforts. As nations consider both policy and programmatic options for enhanced prevention opportunities, the use of online data will remain critical to understand emerging trends in a timely fashion.

Acknowledgments

The findings and conclusions in this publication are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention.

Authors' Contributions

SD, DW, and SR conducted the data analyses and investigations. SD, DW, SAS, and AS contributed to the methodology. SL performed data collection and curation. All authors contributed to the original draft. KAM, WK, SAS, and AS contributed to validation and editing. AS supervised the project.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Full list of suicide mechanism keywords, posting frequency on Sanctioned Suicide, full list of sourcing-related keywords, sodium nitrate–related topics: unigrams and bigrams, and code snippet.

DOCX File, 323 KB

  1. Curtin SC, Hedegaard H, Ahmad FB. Provisional numbers and rates of suicide by month and demographic characteristics: United States, 2020. National Center for Health Statistics; Nov 2021. NVSS-Vital Statistics Rapid Release no. 16. URL: https://archive.hshsl.umaryland.edu/handle/10713/17347 [Accessed 2023-05-30]
  2. Curtin SC, Garnett MF, Ahmad FB. Provisional numbers and rates of suicide by month and demographic characteristics: United States, 2021. National Center for Health Statistics; Sep 2022. NVDD Vital Stat Rapid Release no. 24. URL: https://stacks.cdc.gov/view/cdc/120830 [Accessed 2024-04-09]
  3. CDC WONDER. Centers for Disease Control and Prevention. URL: https://wonder.cdc.gov/ [Accessed 2023-07-07]
  4. Wang J, Sumner SA, Simon TR, et al. Trends in the incidence and lethality of suicidal acts in the United States, 2006 to 2015. JAMA Psychiatry. Jul 1, 2020;77(7):684-693. [CrossRef] [Medline]
  5. WISQARS fatal and nonfatal injury reports. Centers for Disease Control and Prevention. URL: https://wisqars.cdc.gov/reports/ [Accessed 2023-05-30]
  6. Stephenson L, Wills S, van den Heuvel C, Humphries M, Byard RW. Increasing use of sodium nitrite in suicides-an emerging trend. Forensic Sci Med Pathol. Sep 2022;18(3):311-318. [CrossRef] [Medline]
  7. Duong D. Troubling rise in suicides linked with common food preservative. CMAJ. Aug 8, 2022;194(30):E1070-E1071. [CrossRef] [Medline]
  8. Durão C, Pedrosa F, Dinis-Oliveira RJ. A fatal case by a suicide kit containing sodium nitrite ordered on the internet. J Forensic Leg Med. Jul 2020;73:101989. [CrossRef] [Medline]
  9. Sedhai YR, Atreya A, Basnyat S, Phuyal P, Pokhrel S. The use of sodium nitrite for deliberate self-harm, and the online suicide market: should we care? Med Leg J. Jun 2022;90(2):79-80. [CrossRef] [Medline]
  10. McCann SD, Tweet MS, Wahl MS. Rising incidence and high mortality in intentional sodium nitrite exposures reported to US poison centers. Clin Toxicol (Phila). Dec 2021;59(12):1264-1269. [CrossRef] [Medline]
  11. Khan H, Barber C, Azrael D. Suicide by sodium nitrite poisoning: findings from the National Violent Death Reporting System, 2018-2020. Suicide Life Threat Behav. Apr 2024;54(2):310-316. [CrossRef] [Medline]
  12. Niederkrotenthaler T, Stack S, Till B, et al. Association of increased youth suicides in the United States with the release of 13 Reasons Why. JAMA Psychiatry. Sep 1, 2019;76(9):933-940. [CrossRef] [Medline]
  13. Sumner SA, Burke M, Kooti F. Adherence to suicide reporting guidelines by news shared on a social networking platform. Proc Natl Acad Sci U S A. Jul 14, 2020;117(28):16267-16272. [CrossRef] [Medline]
  14. Niederkrotenthaler T, Voracek M, Herberth A, et al. Role of media reports in completed and prevented suicide: Werther v. Papageno effects. Br J Psychiatry. Sep 2010;197(3):234-243. [CrossRef] [Medline]
  15. Twohey M, Dance GJX. Where the despairing log on, and learn ways to die. The New York Times. Dec 9, 2021. URL: https://www.nytimes.com/interactive/2021/12/09/us/where-the-despairing-log-on.html [Accessed 2023-05-30]
  16. Rules and FAQ. Sanctioned Suicide. URL: https://sanctioned-suicide.net/threads/rules-and-faq.4/ [Accessed 2023-05-30]
  17. H. Rept. 117-403 - Departments of Labor, Health and Human Services, and Education, and Related Agencies Appropriations Bill, 2023. Congress.gov. URL: https://www.congress.gov/congressional-report/117th-congress/house-report/403/1?s=1&r=54 [Accessed 2024-04-18]
  18. Suicide prevention resource for action: a compilation of the best available evidence. Centers for Disease Control and Prevention. 2022. URL: https://www.cdc.gov/suicide/resources/prevention.html [Accessed 2024-04-18]
  19. Sarker A, Gonzalez-Hernandez G. An unsupervised and customizable misspelling generator for mining noisy health-related text sources. J Biomed Inform. Dec 2018;88:98-107. [CrossRef] [Medline]
  20. Grootendorst M. BERTopic: neural topic modeling with a class-based TF-IDF procedure. arXiv. Preprint posted online on Mar 11, 2022. [CrossRef]
  21. Industrial-strength natural language processing in Python. spaCy. URL: https://spacy.io/ [Accessed 2023-05-30]
  22. Qi P, Zhang Y, Zhang Y, Bolton J, Manning CD. Stanza: a Python natural language processing toolkit for many human languages. In: Celikyilmaz A, Wen TH, editors. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. Association for Computational Linguistics; 2020:101-108. [CrossRef]
  23. Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. In: Guyon I, von Luxburg U, Bengio S, et al, editors. Advances in Neural Information Processing Systems 30 (NIPS 2017). Curran Associates, Inc; 2017. URL: https:/​/proceedings.​neurips.cc/​paper_files/​paper/​2017/​hash/​3f5ee243547dee91fbd053c1c4a845aa-Abstract.​html [Accessed 2023-05-30]
  24. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. Apr 1960;20(1):37-46. [CrossRef]
  25. Liu Y, Ott M, Goyal N, et al. RoBERTa: a robustly optimized BERT pretraining approach. arXiv. Preprint posted online on Jul 26, 2019. [CrossRef]
  26. Devlin J, Chang MW, Lee K, Toutanova K. BERT: pre-training of deep bidirectional transformers for language understanding. arXiv. Preprint posted online on May 24, 2019. [CrossRef]
  27. Guo Y, Ge Y, Yang YC, Al-Garadi MA, Sarker A. Comparison of pretraining models and strategies for health-related social media text classification. Healthcare (Basel). Aug 5, 2022;10(8):1478. [CrossRef] [Medline]
  28. Mudan A, Repplinger D, Lebin J, Lewis J, Vohra R, Smollin C. Severe methemoglobinemia and death from intentional sodium nitrite ingestions. J Emerg Med. Sep 2020;59(3):e85-e88. [CrossRef] [Medline]
  29. GSFA online food additive group details for nitrites. Food and Agriculture Organization of the United Nations. URL: https://www.fao.org/gsfaonline/groups/details.html?id=151 [Accessed 2023-05-30]
  30. Food additive status list. US Food & Drug Administration. Aug 2022. URL: https://www.fda.gov/food/food-additives-petitions/food-additive-status-list [Accessed 2023-05-30]
  31. Supplying explosives precursors and poisons. GOV.UK. URL: https:/​/www.​gov.uk/​government/​publications/​supplying-explosives-precursors/​supplying-explosives-precursors-and-poison [Accessed 2023-05-30]
  32. Australia New Zealand Food Standards Code - Standard 1.2.4 - labelling of ingredients. Australian Government, Federal Register of Legislation. URL: https://www.legislation.gov.au/F2008B00604/2013-02-21/text [Accessed 2023-05-30]
  33. Twohey M, Dance GJX. Lawmakers press Amazon on sales of chemical used in suicides. The New York Times. Feb 4, 2022. URL: https://www.nytimes.com/2022/02/04/technology/amazon-suicide-poison-preservative.html [Accessed 2023-05-30]
  34. Standefer JC, Jones AM, Street E, Inserra R. Death associated with nitrite ingestion: report of a case. J Forensic Sci. Oct 1979;24(4):768-771. [Medline]
  35. Sartori E, Pajola L, Da San Martino G, Conti M. The impact of COVID-19 on online discussions: the case study of the Sanctioned Suicide forum. In: Ding Y, Tang J, Sequeda J, et al, editors. WWW ’23: Proceedings of the ACM Web Conference 2023. Association for Computing Machinery; 2023:4060-4064. [CrossRef]
  36. Dilkes J. Quantifying changes in language to evaluate the social and psychological effect of participation in a pro-choice suicide forum. In: Workshop Proceedings of the 16th International AAAI Conference on Web and Social Media. Association for the Advancement of Artificial Intelligence; 2022. [CrossRef]
  37. Dinis-Oliveira RJ, Durão C. When the antidote for cyanide poisonings becomes a nightmare: an alarming outbreak of suicides using kits containing sodium nitrite. Forensic Sci Res. Jun 4, 2023;8(2):170-171. [CrossRef] [Medline]
  38. University of Maryland School of Pharmacy. Sodium nitrite poisoning. ToxTidbits. Dec 2022. URL: https://www.mdpoison.com/media/SOP/mdpoisoncom/ToxTidbits/2022/SodiumNitrite-Dec-2022.pdf [Accessed 2024-04-09]
  39. Pritzker JB, Ezike N. Health alert. Illinois Department of Public Health. 2019. URL: https:/​/www.​dhs.state.il.us/​OneNetLibrary/​27896/​documents/​By_Division/​MentalHealth/​2020/​CommunityAlerts/​12132019-CommAlert-HealthAlert_sodiumNitrite.​pdf [Accessed 2024-04-09]


CDC: Centers for Disease Control and Prevention
NER: named entity recognition
NLP: natural language processing
NPDS: National Poison Data System
SN: sodium nitrite
WONDER: Wide-Ranging Online Data for Epidemiologic Research


Edited by John Torous; submitted 17.10.23; peer-reviewed by Myeong Gyu Kim, Ning Wang, Philip Batterham; final revised version received 11.03.24; accepted 12.03.24; published 02.05.24.

Copyright

© Sudeshna Das, Drew Walker, Swati Rajwal, Sahithi Lakamana, Steven A Sumner, Karin A Mack, Wojciech Kaczkowski, Abeed Sarker. Originally published in JMIR Mental Health (https://mental.jmir.org), 2.5.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Mental Health, is properly cited. The complete bibliographic information, a link to the original publication on https://mental.jmir.org/, as well as this copyright and license information must be included.