INTRODUCTION
There have been several psychological, philosophical and sociological descriptions of loneliness. Loneliness is described by researchers as a concept involving cognitive awareness of the individual on his deficiency in social and close relationships, and despair, longing or emotional emptiness reactions accompanying the awareness (1). Others described loneliness as a disturbing experince of the individual when social interactions are qualitatively or quantitatively deficient (2,3). According to this description, loneliness has three scientific aspects. First, loneliness is a consequence of an individual deficit of social relations. Loneliness happens when there is an inconsistency between actual social relations and individual needs or social interaction demands. At times, it results from changing social needs of the individual rather than changes in social relation levels. Second, loneliness is a subjective experience and is not synonymous with social isolation. Individuals may feel lonely when they are alone or they are among crowds. Third, loneliness is an aversive experience. Although loneliness supports personal growth, it is a non-pleasant and distressing experience by itself (2).
According to Kohut (citation from reference 4), humans have a subjective sense of commitment or belonging and they have to feel they are part of something to prevent feelings of loneliness. Chipuer (4) states that individuals lacking a “community feelings” are at a very high risk of social isolation and alienation and that can lead to feelings of loneliness. Larson (5) indicates that adolescents reporting higher loneliness in school and community contexts have lower self-esteem and a higher level of depressive symptoms. On the other hand, parent and teacher reports indicate that these adolescents have a lower adaptive level.
It has been accepted that adolescents are at a higher risk for loneliness experience when compared with children. Adolescents are prone to subjective distress since during adolescence they separate from their parents; show an active search for identity and increased need to be praised in their relations with their peers during this period (6). During adolescence and all developmental periods, being accepted by parents, peers and other social environment and to feel their support is a great social need. When this social need is not fulfilled, individual may prefer to withdraw from social contexts and may have impaired social and personal adaptation with social isolation feeling.
According to Margalit (6), loneliness during childhood is a distressing affective experience, that affects current quality of life of the individual and is a developmental risk factor for future well-being. Loneliness points to a failure in a valuable field of interpersonal relations. Besides, lonely and refused children have problems in social skills development along with dealing with difficulties they experience. Krause-Parello (7) states that loneliness is an emotional state which may affect physical and mental development and impair social development of a student. In children, loneliness involves deficient motivation and feeling pity for oneself. Lonely students have a higher risk of applying to school health services for somatic complaints and higher rate of absenteeism.
Loneliness, besides being an unpleasant and distressing experience, may also threaten mental health of the individual, particularly when it is severe and prolonged. Therefore, loneliness has a worthy position among important subjects which have been investigated by mental health investigators (2). Margalit (6) states that loneliness of children is a great source of distress which can lead to short and long-term negative consequences besides being an important developmental problem. There are important associations between loneliness and various indicators of human mental health. Among these studies, loneliness is positively associated with depression (8,9) social anxiety and social withdrawal (10,11), suicide attempt (12), shyness (10), low peer acceptance (13,14), victimization/being bullied (15-17), school avoidance and social unsatisfaction (18). In some other studies, loneliness is reported to be negatively associated with self-perception (19), self-esteem (10,20), life satisfaction (21), psychological well being (20), social support and social commitment (22), sense of belonging to school (13), commitment to school and society (4). As can be seen from the results of these studies, loneliness must not be ignored by mental health workers, including psychological consultants, psychologists, psychiatrists, etc. Therefore, a valid and reliable instrument to detect severity of loneliness of adolescents is necessary to provide preventive mental health servives to these individuals, during a critical and important human developmental stage.
UCLA Loneliness Scale (ULS-20) long form (23) was used in several studies with adolescents conducted in our country. This form consists of 20 items and reliability and validity of the form was investigated among adults. There is no measure to detect level of loneliness among high-school period adolescents. Therefore, in this study, we investigated psychometric properties of UCLA Loneliness Scale Short Form (ULS-8), which has been widely used in local and foreign literature, since it is short and readily appliable in the adolescent group. We adapted ULS-8, which was developed by Hays and DiMatteo (24), to Turkish and investigated its reliability and validity with this aim.
METHOD
Translation of ULS-8
In order to adapt the scale to adolescent population, Prof. Ronald Dale Hays was contacted by e-mail and necessary permissions were obtained in order to translate the scale. A separate translation study was not conducted. UCLA Loneliness Scale, which was translated by Demir (23), was checked by five separate experts, three English teachers and two Turkish teachers, in order to investigate suitabilty of the items for use in adolescents and after obtaining favorable expert opinions, this former translation was used.
UCLA Loneliness Scale Short Form (ULS-8)
After oblique promax rotation, confirmatory factor analysis (CFA), conducted by Hays and DiMatteo (24) in 199 college students (38.2% male, 61.2% female, mean age 21 years, SD=4.5 years), in order to develop a short form of Revised ULS-20, revealed 8 items with factor loadings between 0.31 ile 0.73, which loaded into a single factor that explains 67.44% of the total variance. There was a high correlation (r=0.91) between ULS-8 and ULS-20. Data obtained from 192 individuals for reliability analysis indicated internal consistency coefficient as 0.84. In order to investigate item discrimination, associations between ULS-20, ULS-4 and ULS-8 and life satisfaction, alienation, social anxiety, locus of control and health related behaviors (e.g. smoking, alcohol, exercise) were investigated, obtained data showed that both ULS-20 and ULS-8 had similar associations with related variables, consistent with conceptual structure of loneliness. Thus, discriminant validity of the item with related conceptual structure was detected. Hays and DiMatteo (24) stressed that, ULS-8 items reflected social isolation, which was perceived as a representative of individual loneliness.
ULS-8 has been used to evaluate severity of feelings of loneliness in individuals, from adolescence to adulthood. Scale consists of 8 items which were loaded into a single factor. ULS-8 is a Likert-type scale with 4 options “(1) Never, (2) Rarely, (3) Sometimes and (4) Always”. “I am an extrovert person” and “I can find friends when I want” items are reverse-scored. Sum of 8 items reveal general loneliness score. Minimum and maximum possible scores are 8 and 32, respectively. Higher scores from USL-8 correspond to severe loneliness in adolescents.
Study Group
Sample of the study included adolescent students from Anatolian High School who were attending school in 2013-2014 academic year. A total of 293 adolescents, 110 (37.5%) males and 183 (62.5%) females, 14-19 years of age (mean age 15.85 years, SD=1.20 years) were included in the study. Data were obtained twice in two weeks from 64 highschool students for test-retest reliability study. Data obtained from 80 students were analyzed to study criterion validity. Demographical features of the subjects were summarized in Table 1.
Scales
The General Belongingness Scale (GBS): GBS, which was developed by Malone et al. (25), is a Likert-type self-report to evaluate general belongingness level of individuals. GBS has two factors named “acceptance/inclusion and rejection/exclusion”. General Belongingness Scale has a four-level structure “(1) Don’t agree, (2) Rarely agree, (3) Usually agree, and (4) Totally agree”. Scale consists of 12 items and items number 3-4-6-7-9-12 were scored reversely. Sum of 6 items give acceptance/inclusion score, addition of 6 items yield rejection/exclusion score and sum of 12 items give general belongingness score. Higher general belongingness scores in adolescents correspond to higher general belongingness levels. Yildiz (26) adapted the scale to Turkish. The study conducted by Yildiz (26) included 567 adolescents and exploratory factor analysis (EFA) indicated that GBS factor loadings were between 0.55 and 0.84. CFA showed that all goodness of fit indexes were at a satisfactory level. Analysis on 140 students to evaluate construct validity indicated that general belongingness was significantly associated with loneliness (r=-0.64), life satisfaction (r=0.36), attachment to parent (ranged between r=0.21 and r=0.39) and bonding to friends (ranged between r=0.33 and r=0.39). Composite reliability (CR) and average variance extracted (AVE) values of GBS for acceptance/inclusion factor were 0.77 and 0.459 (45.9%), for rejection/exclusion factor were 0.85 and 0.635 (63.5%), and for the total scale were 0.90 and 0.690 (69.0%) respectively. Cronbach alfa coefficient was α=0.76 for acceptance/inclusion factor, α=0.85 for rejection/exclusion factor and α=0.81 for total scale. Test-retest reliability, which was obtained by applying the scale twice to 97 students in two weeks, was r=0.80 for total scale.
Life Satisfaction Scale (LSS): LSS is developed to evaluate individual’s satisfaction from life. Life Satisfaction Scale consists of 5 items with a single dimension and it is rated on 7 level Likert scale, (1=Don’t agree, 7=Absolutely agree). Highest possible score is 35 and lowest is 5. Higher scores from the scale reflect higher life satisfaction. The scale can be applied to all ages from adolescence to adulthood. The scale was adapted to Turkish by Koker (27). Reliability analysis indicated test-retest reliability r=0.85, while item-test correlations were between 0.71 and 0.80.
Data Analysis
Data were analyzed with SPSS 17.0, LISREL 8.80 and Monte Carlo PCA Parallel Analysis softwares. In order to detect construct validity EFA and CFA were conducted. Criterion validity was also tested. In order to evaluate reliability, test-retest correlation, internal consistency coefficient Cronbach alpha value and CR and AVE were computed.
RESULTS
Validity of ULS-8
Exploratory Factor Analysis (EFA) Results
In order to evaluate construct validity, EFA was used first. Factors with eigenvalues higher than 1 were used in the analysis (28-32). A minimum factor loading of 0.30 was necessary for any item to be included in a factor (32-34). When an item was loaded into more than one factor, a minimum item loading difference of 0.10 was taken into account.
Before CFA, KMO (Kaiser-Meyer-Olkin) value indicating suitability of data was 0.83 and Bartlett Test was significant (χ2=392.670, df=21, p<0.001) (29). Minimum KMO value for CFA is suggested as 0.60 (30,31,34). These results showed that data were suitable for CFA.
Scree-plot graphics and total variance table were analyzed together to detect number of factors (Figure 1). As can be seen in Figure 1, there was a steep break followed by two breaks which were smaller and closer to eah other. While steep declines in the graphic indicate dimensions, parallel analyses were conducted to detect whether the scale included separate factors. Pallant (30) suggests that parallel analysis were necessary in education and psychology fields and that the results must be reported. Eigenvalues obtained from parallel analysis and CFA were summarized in Table 2.
As can be seen in Table 2, eigenvalues in the first factor obtained by EFA were higher than obtained by parallel analysis. In the second factor, eigenvalues obtained by parallel analysis were higher. In addition to these analysis, when total variance table was investigated, it was evident that single factor explained 40.99% of total variance. When these results were taken together, it was concluded that the scale had a single dimension as in the original form.
EFA analysis showed that factor loading of third item (“I am an extrovert person.”) was 0.15. Since this was lower than critical loading value 0.30, third item was excluded and analyses were done with remaining items. As can be seen in Table 3, EFA results indicated that ULS-8, consisting of 7 items, had a single factor structure and explained 40.99% of total variance. Factor loadings were between 0.31 and 0.73. ULS-8 EFA results were presented in Table 3.
Confirmatory Factor Analysis (CFA) Results
CFA has been used extensively during scale development processes for psychometric evaluation and to determine construct validity and examine latent structure of the scale. With this method, researcher investigates a structure based on past evidence and hypothesis and its indicators. Thus, CFA is used to confirm the existing structure of a previously developed scale. CFA is an isdispensable analytic tool in social and behavioral sciences to confirm structures (28). Therefore, we evaluated whether the structure of USL-8 was confirmed in our culture by CFA. First CFA analysis to test the model with 8 items with a single latent variable indicated that t value of third item was 1.50 and that this was not significant, therefore this item was excluded from the analysis. EFA also showed that third item did not work in the factor analysis, as indicated by low loading value.
Later, goodness of fit indexes obtained from CFA to test the model of 7 items with a single latent variable were examined and it was found that chi-square value was significant (χ2=27.12, sd=14, χ2/df=1.94, p=0.02). When the goodness of fit indexes were examined, the results were as following: Root Mean Square Error of Approximation (RMSEA)=0.06, Root Mean Square Residuals (RMR)=0.03, Standardized Root Mean Square Residuals, (SRMR)=0.04, Goodness of Fit Index (GFI)=0.97, Adjusted Goodness of Fit Index (AGFI)=0.95, Comparative Fit Index (CFI)=0.98, Normed Fit Index (NFI)=0.96 and Non-normed Fit Index (NNFI)=0.97. These results indicated that, regarding goodness of fit indexes, the model and observed data were consistent and the proposed model showed good fitness. Critical N (CN) value is one of the goodness of fit measures used to determine whether sample size is sufficient to obtain a fit model and to make sure that the model will not be rejected in Structural Equation Model analysis and it has been suggested that CN value must be 200 or higher (35,36). CN=325.52 value obtained in the present study indicated that the sample size was sufficient. In the literature, CFA goodness of fit indexes are evaluated as “acceptable (A) and perfect (P)” (28,31,37,38). Goodness of fit indexes of the model were presented in Table 4 and path diagram was presented in Figure 2.
Standardized Lambda values of USL-8 were between λ=0.23 and λ=0.67 (Figure 2) and all items were significant (t>2.576). In order to test construct validity of the scale, measurement of CR, and Average Variance Extracted (AVE) is recommended (29). Hair et al. (29) reported that CR values between 0.60 and 0.70 are acceptable and values higher than 0.70 are good. For AVE, values over 0.50 are recommended (29,39). In Table 5, t, multiple correlation squares (R2), CR and AVE values of the items obtained from CFA analysis were presented. All values are significant at p<0.05 level.
In order to test criterion validity of ULS-8, associations between scores obtained from loneliness scale and belongingness and life satisfaction scores were investigated. As can be seen in Table 6, there was a moderate negative correlation between loneliness and life satisfaction (r=-0.42). While there was a positive correlation between loneliness and GBS rejection factor (r=0.63), there were negative correlations between loneliness and acceptance factor (r=-0.65) and general belongingness score (r=-0.71).
Scoring of USL-8
USL-8 is responsed with a four level structure as “(1) Never, (2) Rarely, (3) Sometimes and (4) Always”. “I can find a friend when I want” item is reverse scored. Since one item was excluded in this study, the scale is scored with 7 items. Addition of 7 items gave general loneliness score. Minimum and maximum possible scores are 7 and 28, respectively. Lower scores indicate lower feelings of lonelines and higher scores indicate more severe feelings of loneliness in adolescents.
Reliability of USL-8
Cronbach alpha coefficient, indicating internal consistency of the scale was α=0.74 for whole scale. Test-retest reliability coefficient, which was obtained by applying the test twice in two weeks to 64 students was r=0.84 (p<0.001) for whole scale. Reliability measures specific to Structural Equation Model, AVE and CR, were also computed. AVE was 0.40 (40%) and CR was 0.75 for USL-8.
DISCUSSION
In this study, psychometric properties of the ULS-8, which was developed by Hays and DiMatteo (24) to measure loneliness levels of individuals, were investigated in an adolescent sample. When the EFA and CFA results, which were conducted to measure construct validity of the scale, were investigated, it was found that USL-8 had a single factor structure as in the original form. However, it was evident that third item of the scale did not have sufficient factor loading (>0.30) and therefore this item was excluded from the scale. Wu and Yao (40) also showed in their study with Taiwanese students that third item of USL-8 was weak. In another study, Zhou et al. (41), studied psychometric properties of USL-8 in a Chinese elderly population. Their results indicated that third and sixth items were excluded from the scale since these items had low loadings. Similar results in these studies suggest that, there may be problems in comprehensibility of these items in different cultures. One reason may be that “extroversion” is a product of Western culture (42) and that counterpart of this concept is not readily comprehensible in Eastern cultures. Therefore, the third item (“I am an extrovert person”) may not be fully understood by adolescents.
Besides this item, sixth item also had a relatively lower factor loading and lambda value when compared with other items. However, since factor loading of this item was greater than 0.30 and t value obtained from CFA was significant, it was not excluded from the scale. In Zhou et al.’s study (41), this item was excluded for low factor loading. Factor loadings and lambda values of other items were quite high. Average variance extracted value of USl-8 was somewhat lower than the recommended value of 0.50. This value can be computed again in different samples.
According to Pallant (30) construct validity is about the association of scale scores and a definite, measurable construct. In this context, Perlman and Peplau (2), stated that loneliness in emotional field was associated with general unsatisfaction and sorrow and that in cognitive field, lonely individuals were more cautious in their interpersonal relations; thus they continuously checked whether other persons responded to their interpersonal needs and that they were very sensitive to acceptance and rejection stimuli. There are studies which supported this notion in the literature. Studies showed that there is a significant negative association between loneliness and belongingness (4,25,26,43) and life satisfaction (26,43,44). Since the significant associations between loneliness and belongingness and life satisfaction were supported by research and theoretical explanations are in line with this, it has been accepted that scales measuring belongingness and life satisfaction can be used as criterion validity measures for loneliness. In the present study, analysis for criterion validity showed that there were negative correlations between loneliness, life satisfaction and general belongingness. These results are consistent with the literature and theoretical explanations. Results indicated that criterion validity of USL-8 is sufficient.
Internal consistency coefficient, CR value and test-retest reliability of USL-8 were computed to evaluate reliaiblity of the scale in adolescent sample. Internal consistency coefficient, CR value and test-retest reliability of USL-8 indicated that the scale was highly reliable.
In conclusion, results obtained from validity and reliability studies of adaptation of USL-8 in Turkish for adolescents showed that this scale can be used reliably in studies with adolescents. Besides, shortness of the scale will provide easiness and functionality of use in future studies investigating loneliness in adolescents. A limitation of this study is that the adolescents in the sample did not have a clinical diagnosis. In future studies, investigating psychometric properties of the scale in an adolescent sample with clinical diagnosis and evaluation of associations between loneliness and mental problems will contribute to a better understanding of loneliness among adolescents.
REFERENCES
1. Asher SR, Paquette JA. Loneliness and peer relations in childhood. Curr Dir Psychol Sci 2003; 12:75-78.
2. Perlman D, Peplau LA. Loneliness Research: A Survey of Empirical Findings: In Peplau LA, Goldston SE (editors). Preventing the Harmful Consequences of Severe and Persistent Loneliness. Rockville Maryland: National Institute of Mental Health, 1984, 13-46.
3. Perlman D, Peplau LA. Loneliness: In Friedman H (editor). Encyclopedia of Mental Health. Vol. 2. San Diego, CA: Academic Press, 1998, 571-581.
4. Chipuer HM. Dyadic attachments and community connectedness: Links with youths’ loneliness experiences. J Community Psychol 2001; 29:429-446.
5. Larson RW. The Uses of Loneliness in Adolescence: In Rotenberg KJ, Hymel S (editors). Loneliness in Childhood and Adolescence. New York: Cambridge University Press, 1999, 244-262.
6. Margalit M. Lonely Children and Adolescents Self-Perceptions, Social Exclusion, and Hope. New York: Springer, 2010; 1-24.
7. Krause-Parello CA. Loneliness in the school setting. J Sch Nurs 2008; 24:66-70.
8. Koenig LJ, Issacs AM, Schwartz JAJ. Gender differences in adolescent depression and loneliness: why are boys lonelier if girls are more depressed? J Res Pers 1994; 28:27-43.
9. Lau S, Chan DWK, Lau PS. Facets of loneliness and depression among Chinese children and adolescents. J Soc Psychol 1999; 139:713-729.
10. Erozkan A. The Predictors of Loneliness in Adolescents Elementary Education Online 2009; 8:809-819. (Turkish)
11. Johnson HD, Lavoie JC, Mahoney MA. Interparental conflict and family cohesion: predictors of loneliness, social anxiety, and social avoidance in late adolescents. J Adolesc Res 2001; 16:304-318.
12. Eskin M. Adolescent loneliness, coping methods and the relationship of loneliness to suicidal behavior. Klinik Psikiyatri 2001; 4:5-11. (Turkish)
13. Mouratidis AA, Sideridis GD. On social achievement goals: their relations with peer acceptance, classroom belongingness, and perceptions of loneliness. The Journal of Experimental Education 2009; 77:285-307.
14. Parker J, Asher S. Friendship and friendship quality in middle childhood: links with peer group acceptance and feelings of loneliness and social dissatisfaction. Dev Psychol 1993; 29:611-621.
15. Kochenderfer BJ, Ladd GW. Peer victimization: cause or consequence of school maladjustment. Child Dev 1996; 67:1305-1317.
16. Storch EA, Brassard MR, Masia-Warner C. The relationship of peer victimization to social anxiety and loneliness in adolescence. Child Study Journal 2003; 33:1-18.
17. Storch EA, Masia-Warner C. The relationship of peer victimization to social anxiety and loneliness in adolescent females. J Adolesc 2004; 27:351-362.
18. Ladd GW, Kochenderfer BJ, Coleman CC. Classroom peer acceptance, friendship, and victimization: distinct relational systems that contribute uniquely to children’s school adjustment? Child Dev 1997; 68:1181-1197.
19. Salmivalli C, Isaacs J. Prospective relations among victimization, rejection, friendlessness, and children’s self- and peer-perceptions. Child Dev 2005; 76:1161-1171.
20. Guloglu B, Karairmak O. Self-esteem and resilience as the predictors of loneliness among university students. Ege Egitim Dergisi 2010; 11:73-88. (Turkish)
21. Civitci N, Civitci A, Fiyakalı NC. Loneliness and life satisfaction in adolescents with divorced and non-divorced parents. Educational Sciences: Theory & Practice 2009; 9:513-525. (Turkish)
22. Duru E. The role of social support and social connectedness in predicting loneliness. Turkish Journal of Psychology 2008; 23: 15-24. (Turkish)
23. Demir A. Reliability and validity of UCLA loneliness scale. Turkish Journal of Psychology 1989; 7:14-18. (Turkish)
24. Hays RD, DiMatteo MR. A short-form measure of loneliness. J Pers Assess 1987; 51:69-81.
25. Malone GP, Pillow DR, Osman A. The General Belongingness Scale (GBS): assessing achieved belongingness. Pers Individ Dif 2012; 52:311-316.
26. Yildiz MA. Adaptation of the general belongingness scale to Turkish in adolescents: validity and reliability studies. 2013 World Congress of Psychological Counseling & Guidance, Proceeding Book, 2013, 256-258. (Turkish)
27. Koker S. Comparison of the levels of life-satisfaction of normal adolescents and adolescents with problems. Unpublished Master Thesis, the Institute of Social Sciences, Ankara University, Ankara, 1991. (Turkish)
28. Brown TA. Confirmatory Factor Analysis for Applied Research. New York & London: The Guilford Press, 2006.
29. Hair JrJF, Black WC, Babin BJ, Anderson RE. Multivariate Data Analysis. Seventh ed., New Jersey: Pearson Prentice Hall, 2010.
30. Pallant J. SPSS Survival Manual A Step by Step Guide to Data Analysis Using SPSS. Fourth ed., Australia: Allen & Unwin, 2011.
31. Tabachnick BG, Fidell LS. Using Multivariate Statistics. Fifth ed., New York: Allyn and Bacon, 2007.
32. Tavsancil E. Measuring Attitudes and Data Analysis with SPSS. Third ed. Ankara: Nobel Yayin Dagitim, 2006. (Turkish)
33. Buyukozturk S. Data Analysis Manual for Social Sciences. Ninth ed., Ankara: Pegem Akademi Yayincilik, 2008. (Turkish)
34. Seker H, Gencdogan B. Development of Measurement Instrument in Psychology and Education. First ed., Ankara: Nobel Yayin Dagitim, 2006. (Turkish)
35. Hox JJ. Amos, Eqs and Lisrel for Windows: a comparative review. Struct Equ Modeling 1995; 2:79-91.
36. Schumacker RE, Lomax RG. A Beginner’s Guide to Structural Equation Modeling. Second ed., Mahwah, New Jersey: Lawrence Erlbaum Associates, Publishers, 2004.
37. Cokluk O, Sekercioglu G, Buyukozturk S. Multivariate Statistics for Social Sciences: SPSS and LISREL Applications. First ed., Ankara: Pegem Akademi Yayincilik, 2010. (Turkish)
38. Simsek OF. Introduction to Structural Equation Modelling: Basic Principals and LISREL Applications. First ed., Ankara: Ekinoks Yayinlari 2007. (Turkish)
39. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res 1981; 18:39-50.
40. Wu C-H, Yao G. Psychometric analysis of the short-form UCLA Loneliness Scale (ULS-8) in Taiwanese undergraduate students. Pers Individ Dif 2008; 44:1762-1771.
41. Zhou L, Li Z, Hu Mi, Xiao S. Reliability and validity of ULS-8 loneliness scale in elderly samples in a rural community. J Cent South Univ (Med Sci) 2012; 37:1124-1128.
42. Jung CG. Psychological Types: In Hull RFC (editor). The Collected Works of Carl G. Jung. Vol. 6. New Jersey: Princeton University Press, 1971.
43. Mellor D, Stokes M, Firth L, Hayash Y, Cummins, R. Need for belonging, relationship satisfaction, loneliness, and life satisfaction. Pers Individ Dif 2008; 45:213-218.
44. Kapikiran S, Yagci U. Loneliness and life satisfaction of adolescents: the mediator and moderator role of playing musical instruments and joining a band. Elementary Education Online 2012; 11:738-747. (Turkish)