Importance
Peer victimization is related to an increased chance of suicidal ideation and suicide attempts among children and adolescents.
Objective
To examine the relationship between peer victimization and suicidal ideation or suicide attempts using meta-analysis.
Data Sources
Ovid MEDLINE, PsycINFO, and Web of Science were searched for articles from 1910 to 2013. The search terms were bully*, teas*, victim*, mobbing, ragging, and harassment in combination with the term suic*. Of the 491 studies identified, 34 reported on the relationship between peer victimization and suicidal ideation, with a total of 284 375 participants. Nine studies reported on the relationship between peer victimization and suicide attempts, with a total of 70 102 participants.
Study Selection
Studies were eligible for inclusion if they reported an effect size on the relationship between peer victimization and suicidal ideation or suicide attempt in children or adolescents.
Data Extraction and Synthesis
Two observers independently coded the effect sizes from the articles. Data were pooled using a random effects model.
Main Outcomes and Measures
This study focused on suicidal ideation and suicide attempts. Peer victimization was hypothesized to be related to suicidal ideation and suicide attempts.
Results
Peer victimization was found to be related to both suicidal ideation (odds ratio, 2.23 [95% CI, 2.10-2.37]) and suicide attempts (2.55 [1.95 -3.34]) among children and adolescents. Analyses indicated that these results were not attributable to publication bias. Results were not moderated by sex, age, or study quality. Cyberbullying was more strongly related to suicidal ideation compared with traditional bullying.
Conclusions and Relevance
Peer victimization is a risk factor for child and adolescent suicidal ideation and attempts. Schools should use evidence-based practices to reduce bullying.
Meta-analyses1,2 have clearly demonstrated the negative relationship between peer victimization and mental health as well as physical health. Common elements in definitions of peer victimization include the repeated nature of harassment, an imbalance in power between bully and victim, and the intention to cause harm on the part of the perpetrator. Bullying can be physical or verbal, but also can be exercised through exclusion.3,4 Estimates5 suggest that, depending on the country of residence, between 5% and 20% of children are victims of bullying. During the past decade, an interest in the relationship between peer victimization and adolescent suicide6 has surged. A large body of research6,7 now suggests that peer victimization is an important risk factor for adolescent suicide. Approximately 20% of adolescents seriously consider suicide, and between 5% and 8% of adolescents in the United States attempt suicide within a year; overall, suicide is one of the most frequent causes of adolescent mortality worldwide.8,9 In this article, meta-analysis is used to further clarify the relationship between peer victimization and suicide.
Studies on bullying and suicide typically use either suicidal ideation or suicide attempts as an outcome measure. Suicidal ideation may be defined as thoughts or wishes to end one’s life and is seen as a precursor to suicide,10 whereas suicide attempt refers to nonfatal events in most studies.6 Studies11,12 including both suicidal ideation and suicide attempts suggest that the relationship between each of these outcome measures and peer victimization may differ; thus, in the present meta-analysis, the relationships between peer victimization and suicidal ideation, and peer victimization and suicide attempts are separately analyzed. Some current studies12-14 focus on cyberbullying; although there are few studies focusing on the relationship between cyberbullying and suicidal ideation, results suggest that cyberbullying is as strongly related to suicidal ideation as traditional bullying is. Most studies on peer victimization and suicide have used self-reports.6 The use of a single informer, as opposed to the use of multiple informers, may lead to inflated effect sizes.15,16 In the present study, we tested whether the strength of the effect sizes between bullying and suicide is stronger for studies using only self-reports than for studies using multiple informants.
In brief, this meta-analysis aimed to examine the relationship between peer victimization and suicidal ideation or suicide attempts in children and adolescents. Because some articles17 suggest that the effects of bullying on suicidal ideation are more severe for girls than for boys and that young children may suffer more from bullying,18 we assessed these factors as moderators. We also compared the effects of cyberbullying and traditional bullying on suicidal ideation. Furthermore, the effects of same-method variance, confounding variables, study design, response rate, and the use of single-item measures were analyzed.
Study Retrieval and Selection
A review protocol does not exist for the purposes of the present study. The search engines PsycINFO, Web of Science, and Ovid MEDLINE were searched using the terms bully*, teas*, victim*, mobbing, ragging, and harassment in combination with the term suic*. The search included articles published from January 1, 1910, to January 26, 2013. In addition to this literature search, review articles6,7 were searched for relevant publications. The reference lists of retrieved articles were scanned to identify articles for potential inclusion in the meta-analysis. Articles published in English, Spanish, German, French, Dutch, Portuguese, and Lithuanian were eligible for inclusion in the analysis. Studies from any country were eligible for inclusion. Our search was not limited to published articles; book chapters, dissertations, unpublished articles, and posters were also eligible. A flow diagram of our search results is provided in Figure 1. Studies on self-harm that did not include a measure on suicide were excluded, because it has been argued that self-harm is conceptually different from suicide, and reasons behind self-harm are different from reasons behind suicide.19 Only studies that focused on bullying by peers were included; thus, studies on other types of victimization (eg, assault, sexual abuse, and robbery) or by other perpetrators (eg, parents, teachers, and strangers) were excluded. Studies that included participants older than 21 years were excluded from the meta-analysis. Studies that focused on clinical samples10,20-23 or samples of incarcerated youth24 were excluded from the meta-analysis to ensure that the obtained results could be generalized to a population in a usual setting.25 One longitudinal study26 was included because it provided an effect size in which both peer victimization and suicidal ideation were calculated at the first measurement. Five other studies27-31 using retrospective and prospective designs were excluded. Retrospective and prospective designs are often evaluated separately in meta-analyses because they concern how peer victimization affects victims later in life,32 which is a different question from how peer victimization is immediately related to suicide. Several studies made use of the same data set (Dane County Youth, Global School Health Survey, Add Health, Linkages, and Youth Risk Behavior Survey). When studies used the same data set, we chose to code the study that used the full data set over those that used only a subsample. If multiple studies used the full data set, we chose the study from which an effect size was more easily retrieved. The studies included in the meta-analyses12-15,17,18,26,33-61 are summarized in the Supplement (eTable 1 and eTable 2). Some studies report only on suicidal ideation, others report only on suicide attempts, and some studies report on both measures. If studies reported on both suicidal ideation and suicide attempts, they were included in both meta-analyses. For the relationship between peer victimization and suicidal ideation, 34 studies met our inclusion criteria, with a total of 284 375 participants. For the relationship between peer victimization and suicide attempts, 9 studies met our inclusion criteria, with a total of 70 102 participants. Of the studies included in the meta-analysis on suicidal ideation, 1 article was written in Portuguese34 and 1 article was written in Lithuanian59; all other articles included were written in English.
Because odds ratios (ORs) were the most reported measure of effect size, we coded ORs when available. We included ORs that compared victimized children with a comparison group of children who did not experience victimization. Some articles18,36,39,42,44,46,57 provided separate effect sizes for different levels of victimization (eg, never, less than weekly, and frequently and low, moderate, and high victimization) or used different forms of victimization (eg, physical, relational, or verbal and covert or overt). In these studies we combined the different forms of bullying or used the groups that experienced the least victimization as a control group and combined the groups that reported more victimization into a victimized group; these combinations allowed us to compute a single OR.
Most studies that used multiple items to measure suicidal ideation or attempts used continuous scores to reflect the degree of suicidal ideation or attempt. From some of these studies, ORs could not be obtained; instead, we coded correlations18,26,35,37,53,54,56 or computed the Cohen d38,43,55 from the mean (SD). When using correlations, we determined the correlation between the victimization and suicidal ideation scales as an effect size. When computing the Cohen d we compared the mean scores on suicidal ideation scales for children who were victimized with the scores for children who were not victimized. We used the program Comprehensive Meta-analysis (Biostat; http://www.meta-analysis.com/index.php) to convert correlations and Cohen d values into ORs.62,63 In 2 articles14,33 the effect size had to be coded into a correlation coefficient from a regression coefficient64; the correlation coefficient was then converted to an OR. In 1 article52 the necessary information to compute the effect size over all the respondents was missing; thus, we used the P value to obtain a conservative estimate.65
Eight studies15,18,37,39,42,44,46,49,55 used ORs as well as multiple items to assess suicidal ideation or suicide attempts. Three of these investigations18,46,49 used validated cutoff scores to decide on the absence of suicidal ideation or suicide attempts. Four studies15,37,44,55 considered a positive answer to any item as indicative of suicidal ideation; for these articles we used the operationalization of suicidal ideation provided by the authors. One study39 used an arbitrary categorization of “low, some, and high” suicidal ideation. For this study we used the low suicidal ideation group as the comparison group and combined the some and high suicidal ideation categories into the suicidal ideation group. When multiple independent samples were reported in a study, these were separately coded. Seven studies15,26,43,44,48,55,59 distinguished between traditional victims and individuals who are bullies as well as victims (hereinafter referred to as bully-victims). In all studies, bully-victims and victims were compared with the same control group to compute an effect size. This means that the effect sizes for bully-victims and victims were not independent. In the main analysis, we used the available data to compute effect sizes comparing victims (any child who was victimized, including victims and bully-victims) with the children who were not victimized (uninvolved children and bullies). We argued that because other studies included populations of both victims and bully-victims but classified both groups as victims, combining victims and bully-victims would create the best comparability with studies that did not distinguish between the groups. From the 7 articles15,26,43,44,48,55,59 that reported distinctions between victims and bully-victims, we separately coded the effect sizes and ran separate analyses. We also analyzed the effect of the following variables as confounders: sex, age, ethnicity, substance use, family violence, previous attempted suicides, attempted suicides of family members, and psychopathology. These variables were chosen on the basis of several literature reviews on suicide.6-9 Sample sizes, response rates, the percentage of girls in a study, method of reporting (self vs other), confounders, the country where a study was conducted, measurement of bullying, suicidal ideation and suicide attempts, study design, and effect sizes were coded independently by 2 of the authors (M.v.G. and J.T.). Differences were resolved through discussion. Before discussing disagreement in coding, the authors coded studies identically 96% of the time.
Data were analyzed using the program Comprehensive Meta-analysis. Odds ratios were used as effect sizes. Other effect sizes were transformed into ORs before the analyses. The effect of self-reports or peer reports and cyberbullying vs traditional bullying was tested using a subgroup analysis. To analyze potential moderating effects of age on bullying, the effect sizes of studies with participants younger than 13 years were compared with the effect sizes of studies with participants 13 years or older. To analyze the potential moderating effects of sex, the effect sizes of studies that consisted of girls were compared with the effect sizes of studies that consisted of boys. Three articles12-14 that provided separate measures of cyberbullying were compared with samples of traditional bullying to analyze the moderating effects of cyberbullying. To assess the risk of publication bias, we computed the Orwin fail-safe N, which estimates how many studies with nonsignificant results would be needed to nullify a meta-analytically obtained effect size. If many studies would be needed, we could conclude that, although the meta-analytically obtained effect size may be slightly inflated, the significant effect is not the result of publication bias. We calculated the association between the standardized effect sizes and the variances of these effect sizes as well using the Kendall τ method: a high Kendall τ coefficient suggests that small studies with nonsignificant results tend not to be published, whereas a nonsignificant Kendall τ coefficient suggests the absence of such publication bias. Furthermore, we used the Duvall and Tweedle trim-and-fill procedure,66 which imputes effect sizes until the error distribution closely approximates normality; in this manner the trim-and-fill procedure provides a more unbiased estimate of the effect size than does the observed estimate. Data were analyzed using a random-effects model.
A total of 34 studies12-15,17,18,26,33-59 were identified that focused on the relationship between peer victimization and suicidal ideation. These studies yielded a total of 66 independent effect sizes. The age of the participants in these studies ranged from 9 to 21 years. Only 4 of the samples used other reports of bullying; in all other samples, self-reports were used. Additional characteristics of each study are given in the Supplement (eTable 1). Meta-analytic results showed that there was a large degree of variance in study effect sizes (Q = 438.10; I2 = 85.16). There was a significant relationship between peer victimization and suicidal ideation (OR, 2.23 [95% CI, 2.10-2.37]). Results are summarized in the Table. A forest plot is provided in Figure 2. The Kendall τ was 0.10 (z = 1.23; P = .21). The Duval and Tweedle trim-and-fill procedure suggested that, by imputing 4 studies to achieve a more normal error distribution, the unbiased estimate of the effect size would closely match the observed effect size (the unbiased estimate: OR, 2.18 [95% CI, 2.05-2.32]). The funnel plot is provided in the Supplement (eFigure 1). The funnel plot, Kendall τ, and Duval and Tweedle trim-and-fill procedure all suggest the absence of publication bias. To ensure that the results obtained were not due to studies with nonsignificant results that could not be identified, the Orwin fail-safe N was computed. We found that 480 studies with an OR of 1.00 would need to be included to reduce the obtained results to a trivial OR of 1.10. Results for victims and bully-victims were analyzed separately (OR, 1.75 [95% CI, 1.42-2.14] for victims and 2.35 [1.75-3.15] for bully-victims). Moderator analyses suggested that there were no significant differences in effect size between samples consisting entirely of boys or entirely of girls (Q1 = 0.41; P = .52) and between samples younger than 13 years and older than 13 years (Q1 = 0.01; P = .92). Cyberbullying, however, was more strongly related to suicidal ideation (OR, 3.12 [95% CI, 2.40-4.05]) than was traditional bullying (2.16 [2.05-2.28]); this difference in effect sizes was significant (Q1 = 7.71; P = .02).
We performed several moderator analyses on the methodologic aspects of the studies. Studies using cluster samples, stratified samples, simple random samples, or census data did not differ significantly in effect size from those that used purposive or convenience sampling techniques (Q1 = 3.94; P = .14). Studies using single items to assess suicidal ideation did not differ significantly from those using multiple items (Q1 = 0.54; P = .46). Studies with a response rate higher than 75% did not differ significantly from those with a response rate lower than 75% (Q1 = 0.06; P = .81). The difference in effect size between studies using only self-reports and those using other reports and self-reports was not significant (Q1 = 0.92; P = .34). A meta-regression analysis indicated that there was no relationship between the number of confounders controlled for and the effect sizes of the studies (z = −0.14; P = .89).
A total of 9 studies12,39,43,45,46,48,49,60,61 were identified that focused on the relationship between bully victimization and suicide attempts. These studies yielded a total of 13 independent effect sizes. The age of the participants in these studies ranged from 9 to 21 years. All studies used only self-reports. Additional characteristics of each study are given in the Supplement (eTable 2). Meta-analytic results showed that there was a large degree of variance in study effect sizes (Q = 107.62; I2 = 88.85). There was a significant relationship between peer victimization and suicide attempts (OR, 2.55 [95% CI, 1.95 -3.34]). The results are summarized in the Table. The forest plot is provided in Figure 3. The Kendall τ was 0.11 (z = 0.55; P = .58). The Duval and Tweedle trim-and-fill procedure suggested that no studies needed to be imputed and that the obtained estimate was unbiased. The funnel plot is provided in the Supplement (eFigure 2). The funnel plot, Kendall τ, and Duval and Tweedle trim-and-fill procedure all suggest the absence of publication bias. To ensure that the results obtained were not due to studies with nonsignificant results that could not be identified, the Orwin fail-safe N was computed. We found that 127 studies with an OR of 1.00 would be needed to reduce the obtained results to a trivial OR of 1.10. Because of the small number of studies, we could not perform analyses on sex, age groups, victims and bully-victims, or cyberbullying for suicide attempts. We performed several moderator analyses on the methodologic aspects of the studies. Studies using cluster samples, stratified samples, simple random samples, or census data did not differ in effect size from those that used purposive or convenience sampling techniques (Q1 = 0.57; P = .45). Studies using single items to assess suicide attempts did not differ significantly from those using multiple items (Q1 = 0.03; P = .86). A meta-regression analysis indicated that there was no relationship between the number of confounders controlled for and the effect sizes of the studies (z = 0.81; P = .42).
In this article, the results of a meta-analysis on the relationship between peer victimization and suicidal ideation or suicide attempts are reported. Results showed a positive relationship between peer victimization and suicidal ideation among 284 375 youths and a positive relationship between peer victimization and suicide attempts among 70 102 youths. Furthermore, this meta-analysis demonstrated that peer victimization is related to suicidal ideation for older as well as younger children, boys as well as girls, and victims as well as bully-victims. There were substantial differences between the studies evaluated in response rate, design, confounders that were controlled for, and use of self-report or peer reports of bullying. According to our analyses, these differences between the studies were not related to their effect sizes. Furthermore, analyses indicated that the results were not associated with publication bias. The absence of methodologic moderators and publication bias suggests that the relationship between peer victimization and suicidal ideation as well as suicide attempts is robust, and this meta-analysis further confirms that peer victimization is an important risk factor for adolescent suicide.6,7
Our study did not confirm the notion that the relationship between peer victimization and suicidal ideation was moderated by age or sex. There are few studies16,17 to support this notion. Brunstein Klomek et al46 suggested that, for girls, victimization immediately increases the risk for suicidal ideation, whereas for boys, only prolonged victimization is related to suicidal ideation; this hypothesis could not be tested in the present meta-analysis, because the included articles did not provide the effect sizes necessary to address this relationship.
Whereas previous studies12-14 demonstrated that cybervictimization is as strongly related to suicidal ideation as is traditional victimization, the present meta-analysis suggests that cyberbullying is even more strongly related to suicidal ideation. This result, however, needs to be interpreted carefully, because we could include only 3 studies to estimate an effect size for cyberbullying. Potentially, the effects of cyberbullying are more severe because wider audiences can be reached through the Internet and material can be stored online, resulting in victims reliving denigrating experiences more often.67
Limitations of the study include the broad construct of peer victimization that we used. Although bullying may be both verbal and physical, the effects of verbal and physical victimization may differ.18 Because most studies focused on combinations of different types of bullying, we could not analyze the effects of the different types. Suicidal ideation is also a broad construct, ranging from the wish to commit suicide to actually thinking and planning suicide. We could not analyze distinctions in the severity of suicidal ideation, because many studies mixed items of different severity to create an overall index of suicidal ideation or used only a single item to measure general ideation. In this meta-analysis, we provided moderator analyses for age and sex. Ideally, the effects of other confounders, such as psychopathology and suicide history, would also have been analyzed. However, of the studies that we analyzed, too few included data on earlier suicide attempts, and the studies that controlled for psychopathology focused on a broad range of disorders, so meaningful comparisons could not be made. Longitudinal studies on the relationship between peer victimization and suicide are scarce; thus, the present meta-analysis focused on cross-sectional studies. Most studies focused on suicidal ideation as an outcome measure; others focused on self-reported attempts. What these studies have in common is that they did not evaluate actual suicide. Children who commit suicide may differ from those who perform a nonfatal attempt31; thus, it remains a question how far peer victimization is related to successful suicide. To our knowledge, only 2 studies12,31 focused on the relationship between peer victimization and suicide attempts resulting in hospitalization, and only 1 study31included actual suicide; these investigations suggest that bullying is also a substantial risk factor for suicide attempts leading to hospitalization and completed suicides. Furthermore, suicidal ideation is thought to invariably precede suicide attempts, and suicide attempts are the strongest known risk factor for future actual suicide.68,69
Congruent with narrative reviews,6,7 this meta-analysis establishes that peer victimization is a risk factor of suicidal ideation and suicide attempts. Efforts should continue to identify and help victims of bullying, as well as to create bullying prevention and intervention programs that work.
Accepted for Publication: August 29, 2013.
Corresponding Author: Mitch van Geel, Institute of Education and Child Studies, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, the Netherlands (mgeel@fsw.leidenuniv.nl).
Published Online: March 10, 2014. doi:10.1001/jamapediatrics.2013.4143.
Author Contributions: Drs van Geel and Tanilon had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
Study concept and design: All authors.
Acquisition of data: van Geel, Tanilon.
Analysis and interpretation of data: All authors.
Drafting of the manuscript: van Geel.
Critical revision of the manuscript for important intellectual content: All authors.
Statistical analysis: van Geel, Tanilon.
Administrative, technical, and material support: Vedder.
Study supervision: van Geel, Vedder.
Conflict of Interest Disclosures: None reported.
1.Gini
G, Pozzoli
T. Association between bullying and psychosomatic problems: a meta-analysis.
Pediatrics. 2009;123(3):1059-1065.
PubMedGoogle ScholarCrossref 2.Hawker
DS, Boulton
MJ. Twenty years’ research on peer victimization and psychosocial adjustment: a meta-analytic review of cross-sectional studies.
J Child Psychol Psychiatry. 2000;41(4):441-455.
Google ScholarCrossref 3.Olweus
D. Bullying at School: What We Know and What We Can Do. Oxford, England: Blackwell; 1993.
4.Olweus
D. Bullying at school: basic facts and effects of a school based intervention program.
J Child Psychol Psychiatry. 1994;35(7):1171-1190.
PubMedGoogle ScholarCrossref 5.Nansel
TR, Craig
W, Overpeck
MD, Saluja
G, Ruan
WJ; Health Behaviour in School-aged Children Bullying Analyses Working Group. Cross-national consistency in the relationship between bullying behaviors and psychosocial adjustment.
Arch Pediatr Adolesc Med. 2004;158(8):730-736.
PubMedGoogle ScholarCrossref 7.Brunstein Klomek
A, Sourander
A, Gould
M. The association of suicide and bullying in childhood to young adulthood: a review of cross-sectional and longitudinal research findings.
Can J Psychiatry. 2010;55(5):282-288.
PubMedGoogle Scholar 8.Eaton
DK, Kann
L, Kinchen
S,
et al. Youth risk behavior surveillance—United States, 2005.
MMWR Surveill Summ. 2006;55(5):1-108.
PubMedGoogle Scholar 9.Gould
MS, Greenberg
T, Velting
DM, Shaffer
D. Youth suicide risk and preventive interventions: a review of the past 10 years.
J Am Acad Child Adolesc Psychiatry. 2003;42(4):386-405.
PubMedGoogle ScholarCrossref 10.Shtayermman
O. Peer victimization in adolescents and young adults diagnosed with Asperger’s syndrome: a link to depressive symptomatology, anxiety symptomatology and suicidal ideation.
Issues Compr Pediatr Nurs. 2007;30(3):87-107.
PubMedGoogle ScholarCrossref 11.Klomek
AB, Marrocco
F, Kleinman
M, Schonfeld
IS, Gould
MS. Peer victimization, depression, and suicidiality in adolescents.
Suicide Life Threat Behav. 2008;38(2):166-180.
PubMedGoogle ScholarCrossref 12.Schneider
SK, O’Donnell
L, Stueve
A, Coulter
RW. Cyberbullying, school bullying, and psychological distress: a regional census of high school students.
Am J Public Health. 2012;102(1):171-177.
PubMedGoogle ScholarCrossref 13.Hay
C, Meldrum
R. Bullying victimization and adolescent self-harm: testing hypotheses from general strain theory.
J Youth Adolesc. 2010;39(5):446-459.
PubMedGoogle ScholarCrossref 15.Kim
YS, Koh
YJ, Leventhal
B. School bullying and suicidal risk in Korean middle school students.
Pediatrics. 2005;115(2):357-363.
PubMedGoogle ScholarCrossref 16.Crick
NR, Bigbee
MA. Relational and overt forms of peer victimization: a multiinformant approach.
J Consult Clin Psychol. 1998;66(2):337-347.
PubMedGoogle ScholarCrossref 17.van der Wal
MF, de Wit
CA, Hirasing
RA. Psychosocial health among young victims and offenders of direct and indirect bullying.
Pediatrics. 2003;111(6, pt 1):1312-1317.
PubMedGoogle ScholarCrossref 18.Dempsey
AG, Haden
SC, Goldman
J, Sivinski
J, Wiens
BA. Relational and overt victimization in middle and high schools: associations with self-reported suicidality.
J Sch Violence. 2011;10(4):374-392.
Google ScholarCrossref 20.Luukkonen
AH, Räsänen
P, Hakko
H, Riala
K; STUDY-70 Workgroup. Bullying behavior is related to suicide attempts but not to self-mutilation among psychiatric inpatient adolescents.
Psychopathology. 2009;42(2):131-138.
PubMedGoogle ScholarCrossref 21.Laukkanen
E, Honkalampi
K, Hintikka
J, Hintikka
U, Lehtonen
J. Suicidal ideation among help-seeking adolescents: association with a negative self-image.
Arch Suicide Res. 2005;9(1):45-55.
PubMedGoogle ScholarCrossref 23.Roxborough
HM, Hewitt
PL, Kaldas
J,
et al. Perfectionistic self-presentation, socially prescribed perfectionism, and suicide in youth: a test of the perfectionism social disconnection model.
Suicide Life Threat Behav. 2012;42(2):217-233.
PubMedGoogle ScholarCrossref 24.Viljoen
JL, O'Neill
ML, Sidhu
A. Bullying behaviors in female and male adolescent offenders: prevalence, types, and association with psychosocial adjustment.
Aggress Behav. 2005;31(6):521-536.
Google ScholarCrossref 25.Luukkonen
AH, Riala
K, Hakko
H, Räsänen
P. Bullying behaviour and criminality: a population-based follow-up study of adolescent psychiatric inpatients in Northern Finland.
Forensic Sci Int. 2011;207(1-3):106-110.
PubMedGoogle ScholarCrossref 26.Herba
CM, Ferdinand
RF, Stijnen
T,
et al. Victimization and suicide ideation in the TRAILS study: specific vulnerabilities of victims.
J Child Psychol Psychiatry. 2008;49(8):867-876.
PubMedGoogle ScholarCrossref 27.Klomek
AB, Kleinman
M, Altschuler
E, Marrocco
F, Amakawa
L, Gould
MS. High school bullying as a risk for later depression and suicidality.
Suicide Life Threat Behav. 2011;41(5):501-516.
PubMedGoogle ScholarCrossref 28.Winsper
C, Lereya
T, Zanarini
M, Wolke
D. Involvement in bullying and suicide-related behavior at 11 years: a prospective birth cohort study.
J Am Acad Child Adolesc Psychiatry. 2012;51(3):271–282, e3. doi:10.1016/j.jaac.2012.01.001.
PubMedGoogle ScholarCrossref 29.Kim
YS, Leventhal
BL, Koh
YJ, Boyce
WT. Bullying increased suicide risk: prospective study of Korean adolescents.
Arch Suicide Res. 2009;13(1):15-30.
PubMedGoogle ScholarCrossref 30.Klomek
AB, Sourander
A, Kumpulainen
K,
et al. Childhood bullying as a risk for later depression and suicidal ideation among Finnish males.
J Affect Disord. 2008;109(1-2):47-55.
PubMedGoogle ScholarCrossref 31.Klomek
AB, Sourander
A, Niemelä
S,
et al. Childhood bullying behaviors as a risk for suicide attempts and completed suicides: a population-based birth cohort study.
J Am Acad Child Adolesc Psychiatry. 2009;48(3):254-261.
PubMedGoogle ScholarCrossref 32.Ttofi
MM, Farrington
DP, Lösel
F. School bullying as a predictor of violence later in life: a systematic review and meta-analysis of prospective longitudinal studies.
Aggress Violent Behav. 2012;17(5):405-418.
Google ScholarCrossref 34.Baggio
L, Palazzo
LS, Aerts
DRGC. Suicide planning among teenage students: prevalence and associated factors [in Portuguese].
Cad Saude Publica. 2009;25(1):142-150.
PubMedGoogle ScholarCrossref 35.Bonanno
RA, Hymel
S. Beyond hurt feelings: investigating why some victims of bullying are at greater risk for suicidal ideation.
Merrill-Palmer Q. 2010;56(3):420-440.
Google ScholarCrossref 36.Cleary
SD. Adolescent victimization and associated suicidal and violent behaviors.
Adolescence. 2000;35(140):671-682.
PubMedGoogle Scholar 37.Cluver
L, Bowes
L, Gardner
F. Risk and protective factors for bullying victimization among AIDS-affected and vulnerable children in South Africa.
Child Abuse Negl. 2010;34(10):793-803.
PubMedGoogle ScholarCrossref 38.Delfabbro
P, Winefield
T, Trainor
S,
et al. Peer and teacher bullying/victimization of South Australian secondary school students: prevalence and psychosocial profiles.
Br J Educ Psychol. 2006;76(pt 1):71-90.
PubMedGoogle ScholarCrossref 39.Eisenberg
ME, Neumark-Sztainer
D, Story
M. Associations of weight-based teasing and emotional well-being among adolescents.
Arch Pediatr Adolesc Med. 2003;157(8):733-738.
PubMedGoogle ScholarCrossref 40.Evans
WP, Marte
RM, Betts
S, Silliman
B. Adolescent suicide risk and peer-related violent behaviors and victimization.
J Interpers Violence. 2001;16(12):1330-1348.
Google ScholarCrossref 41.Fleming
LC, Jacobsen
KH. Bullying among middle-school students in low and middle income countries.
Health Promot Int. 2010;25(1):73-84.
PubMedGoogle ScholarCrossref 42.Franić
T, Dodig
G, Kardum
G, Marčinko
D, Ujević
A, Bilušić
M. Early adolescence and suicidal ideations in Croatia: sociodemographic, behavioral, and psychometric correlates.
Crisis. 2011;32(6):334-345.
PubMedGoogle ScholarCrossref 43.Ivarsson
T, Broberg
AG, Arvidsson
T, Gillberg
C. Bullying in adolescence: psychiatric problems in victims and bullies as measured by the Youth Self Report (YSR) and the Depression Self-rating Scale (DSRS).
Nord J Psychiatry. 2005;59(5):365-373.
PubMedGoogle ScholarCrossref 44.Kaltiala-Heino
R, Rimpelä
M, Marttunen
M, Rimpelä
A, Rantanen
P. Bullying, depression, and suicidal ideation in Finnish adolescents: school survey.
BMJ. 1999;319(7206):348-351.
PubMedGoogle ScholarCrossref 46.Brunstein Klomek
A, Marrocco
F, Kleinman
M, Schonfeld
IS, Gould
MS. Bullying, depression, and suicidality in adolescents.
J Am Acad Child Adolesc Psychiatry. 2007;46(1):40-49.
PubMedGoogle ScholarCrossref 47.Lemstra
ME, Nielsen
G, Rogers
MR, Thompson
AT, Moraros
JS. Risk indicators and outcomes associated with bullying in youth aged 9-15 years.
Can J Public Health. 2012;103(1):9-13.
PubMedGoogle Scholar 48.Liang
H, Flisher
AJ, Lombard
CJ. Bullying, violence, and risk behavior in South African school students.
Child Abuse Negl. 2007;31(2):161-171.
PubMedGoogle ScholarCrossref 49.Mills
C, Guerin
S, Lynch
F, Daly
I, Fitzpatrick
C. The relationship between bullying, depression and suicidal thoughts/behaviour in Irish adolescents.
Ir J Psychol Med. 2004;21(4):112-116.
Google Scholar 50.Owusu
A, Hart
P, Oliver
B, Kang
M. The association between bullying and psychological health among senior high school students in Ghana, West Africa.
J Sch Health. 2011;81(5):231-238.
PubMedGoogle ScholarCrossref 51.Park
HS, Schepp
KG, Jang
EH, Koo
HY. Predictors of suicidal ideation among high school students by gender in South Korea.
J Sch Health. 2006;76(5):181-188.
PubMedGoogle ScholarCrossref 52.Peter
T, Roberts
LW, Buzdugan
R. Suicidal ideation among Canadian youth: a multivariate analysis.
Arch Suicide Res. 2008;12(3):263-275.
PubMedGoogle ScholarCrossref 53.Poteat
VP, Mereish
EH, Digiovanni
CD, Koenig
BW. The effects of general and homophobic victimization on adolescents’ psychosocial and educational concerns: the importance of intersecting identities and parent support.
J Couns Psychol. 2011;58(4):597-609.
PubMedGoogle ScholarCrossref 54.Rigby
K, Slee
P. Suicidal ideation among adolescent school children, involvement in bully-victim problems, and perceived social support.
Suicide Life Threat Behav. 1999;29(2):119-130.
PubMedGoogle Scholar 55.Rivers
I, Noret
N. Participant roles in bullying behavior and their association with thoughts of ending one’s life.
Crisis. 2010;31(3):143-148.
PubMedGoogle ScholarCrossref 57.Skapinakis
P, Bellos
S, Gkatsa
T,
et al. The association between bullying and early stages of suicidal ideation in late adolescents in Greece.
BMC Psychiatry. 2011;11:22-30.
PubMedGoogle ScholarCrossref 58.Wang
RH, Lai
HJ, Hsu
HY, Hsu
MT. Risk and protective factors for suicidal ideation among Taiwanese adolescents.
Nurs Res. 2011;60(6):413-421.
PubMedGoogle ScholarCrossref 59.Zaborskis
A, Vareikiene
I. School bullying and its association with health and lifestyle among schoolchildren [in Lithuanian].
Medicina (Kaunas). 2008;44:232–239.
Google Scholar 60.Coggan
C, Bennett
S, Hooper
R, Dickinson
P. Association between bullying and mental health status in New Zealand adolescents.
Int J Ment Health Promot. 2003;5(1):16-22.
Google ScholarCrossref 61.Goodenow
C, Szalacha
L, Westheimer
K. School support groups, other school factors, and the safety of sexual minority adolescents.
Psychol Sch. 2006;43(5):573-589.
Google ScholarCrossref 63.Chinn
S. A simple method for converting an odds ratio to effect size for use in meta-analysis.
Stat Med. 2000;19(22):3127-3131.
PubMedGoogle ScholarCrossref 65.Mullen
B. Advanced Basic Meta-analysis. Hillsdale, NJ: Lawrence Erlbaum Associates; 1989.
66.Borenstein
M, Hedges
LV, Higgins
J, Rothstein
H. Introduction to Meta-analysis. Hoboken, NJ: John Wiley & Sons Inc; 2009.
67.Patchin
JW, Hinduja
S. Bullies move beyond the schoolyard: a preliminary look at cyberbullying.
Youth Violence Juv Justice. 2006;4(2):148-169.
Google ScholarCrossref 68.Lewinsohn
P, Rohde
P, Seeley
J. Adolescent suicidal ideation and attempts: prevalence, risk factors, and clinical implications.
Clin Psychol. 1996;3(1):25-46.
Google Scholar 69.Bridge
JA, Goldstein
TR, Brent
DA. Adolescent suicide and suicidal behavior.
J Child Psychol Psychiatry. 2006;47(3-4):372-394.
PubMedGoogle ScholarCrossref