Research Article
BibTex RIS Cite

Consequences of Workplace Bullying: Findings from Public Sector via PLS-SEM

Year 2023, Volume: 7 Issue: 3, 1387 - 1400, 29.09.2023
https://doi.org/10.29023/alanyaakademik.1302573

Abstract

Bu çalışma, kamu sektöründe iş yeri zorbalığının çalışmaya tutkunluk, algılanan stres, iş tatmini ve işten ayrılma niyeti üzerindeki açıklayıcılık gücünü tespit etmeyi amaçlamaktadır. Çalışma, nicel araştırma yöntemi ile tasarlanmıştır. 2023 yılı Mart ve Nisan ayında anket tekniği aracılığıyla veri toplanmıştır. Örneklem, Türkiye’deki bir İl Özel İdaresi'nde çalışan 218 kişiden oluşmaktadır. Araştırma hipotezlerinin testi için kısmi en küçük kareler yapısal eşitlik modellemesi (KEKK-YEM) kullanılmıştır. Bulgulara göre, azalan sırayla, iş yeri zorbalığı ilk olarak algılanan stresi ve ikinci olarak işten ayrılma niyetini açıklamada olumlu yönde katkı yapmaktadır. İş yeri zorbalığı üçüncü olarak iş tatminini ve son olarak işe adanmışlığı açıklamada olumsuz yönde katkı yapmaktadır. Çalışmanın kuramsal ve uygulamaya yönelik katkıları tartışılarak gelecekteki araştırmalara önerilerde bulunulmuştur.

References

  • ARENAS, A., GIORGI, G., MONTANI, F., MANCUSO, S., PEREZ, J. F., MUCCI, N., & ARCANGELI, G. (2015). “Workplace Bullying In a Sample of Italian and Spanish Employees and Its Relationship with Job Satisfaction, and Psychological Well-Being”. Frontiers in Psychology, 6: 1-10.
  • AYDIN, O., & ÖCEL, H. (2009). “The Negative Act Questionnaire: A Study for Validity and Reliability”. Turkish Psychological Articles, 12(24): 94-103.
  • BILGE, A., F. ÖĞCE., GENÇ, R. E., & ORAN, N. T. (2009). “Psychometric Properties of a Turkish Version of the Perceived Stress Scale (PSS)”. Ege Üniversitesi Hemşirelik Yüksekokulu Dergisi, 2(25): 61-72.
  • BLAU, P. M. (1964). Exchange and Power in Social Life. John Wiley & Sons.
  • BODDY, C. R. (2011). “Corporate Psychopaths, Bullying and Unfair Supervision in the Workplace”. Journal of Business Ethics. 100(3): 367-379.
  • BOUDRIAS, V., TRÉPANIER, S. G., & SALIN, D. (2021). “A Systematic Review of Research on the Longitudinal Consequences of Workplace Bullying and the Mechanisms Involved”. Aggression and Violent Behavior, 56: 1-17.
  • COHEN, S., KAMARCK, T., & MERMELSTEIN, R. (1983). “A Global Measure of Perceived Stress”. Journal of Health and Social Behavior, 24(4): 385-396.
  • COHEN, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum.
  • COOPER, C. L., HOEL, H., & FARAGHER, B. (2004). “Bullying is Detrimental to Health, But All Bullying Behaviours are not Necessarily Equally Damaging”. British Journal of Guidance & Counselling, 32(3): 367-387.
  • CRONBACH, L. J. (1951). “Coefficient Alpha and the Internal Structure of Tests”. Psychometrika, 16(3): 297-334.
  • ÇAVUŞ, M. F., & DEVELİ, A. (2022). “Entropic Organizational Climate, Organizational Indifference and Job Satisfaction: Concepts and Measurement Tools”. Journal of Organizational Behavior Studies, 2(2): 110-123.
  • DEVELİ, A., & CAVUS, M. F. (2019). Time Perspectives and Task Performance: An Investigation through PLS Path Modeling. In K. Ozyer & M. S. Doven (Eds.) 2nd International Conference on Contemporary Issues in Business & Economics Conference Proceedings (pp. 285-291), Tokat Gaziosmanpasa University.
  • DEVELİ, A. (2020). A Research for Determining the Relationship between Work Ability, Job Satisfaction and Task Performance [Unpublished doctoral thesis]. Osmaniye Korkut Ata University.
  • DEVELİ, A., & YILDIZ, H. (2021). “Investigation of Employees' Perceptions towards the Unions: A Multi-Group Analysis”. Beykoz Akademi Dergisi, 9(2): 85-97.
  • DIENER, E., EMMONS, R. A., LARSEN, R. J., & GRIFFIN, S. (1985). “The Satisfaction with Life Scale”. Journal of Personality Assessment, 49(1): 71-75.
  • EINARSEN, S., & SKOGSTAD, A. (1996). “Bullying at Work: Epidemiological Findings in Public and Private Organizations”. European Journal of Work and Organizational Psychology, 5(2): 185-201.
  • EINARSEN, S., & RAKNES, B. I. (1997). “Harassment in the Workplace and the Victimization of Men”. Violence and Victims, 12(3): 247-263.
  • EINARSEN, S. (1999). “The Nature and Causes of Bullying at Work”. International Journal of Manpower, 20(1/2): 16-27.
  • EINARSEN, S., & HOEL, H. (2001). The Negative Act Questionnaire: Development, Validation and Revision of a Measure of Bullying at Work. 10th Europen Congress on Work and Organizational Psychology, Prague-Czech Republic.
  • EINARSEN, S. V., SKOGSTAD, A., RØRVIK, E., LANDE, Å. B., & NIELSEN, M. B. (2018). “Climate for Conflict Management, Exposure to Workplace Bullying and Work Engagement: A Moderated Mediation Analysis”. The International Journal of Human Resource Management, 29(3): 549-570.
  • ERYILMAZ, E., & DOĞAN, T. (2012). “Subjective Well-Being at Work: Investigating of Psychometric Properties of Utrecht Work Engagement Scale”. Klinik Psikiyatri, 15: 49-55.
  • FORNELL, C., & LARCKER, D. F. (1981). “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error”. Journal of Marketing Research, 18(1), 39-50.
  • GEISSER, S. (1974). “A Predictive Approach to the Random Effect Model”. Biometrika, 61(1): 101-107.
  • GOOGLE FORMS (n.d.). Google Forms. Retrieved February 1, 2023 from https://docs.google.com/forms/create?hl=tr.
  • GÜLER, M., ÇETIN, F., & BASIM, H. N. (2019). “The Validity and Reliability Study of Work Engagement Ultra Short Version (UWES-3) Proposal of an Alternative Version (UWES-6)”. The Journal of Human and Work, 6(2): 189-197.
  • HAIR, J. F., RINGLE, C. M., & SARSTEDT, M. (2013). “Partial Least Squares Structural Equation Modeling: Rigorous Applications, Better Results and Higher Acceptance”. Long Range Planning, 46(1-2): 1-12.
  • HAIR, J. F., BLACK, W. C., BABIN, B. J., & ANDERSON. R. E. (2014). Multivariate Data Analysis: Pearson New International Edition (7th ed.). Pearson Education Limited.
  • HAIR JR, J. F., HULT, G. T. M., RINGLE, C., & SARSTEDT, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), (2nd edition). Sage Publications.
  • HAIR, J. F., RISHER, J. J., SARSTEDT, M., & RINGLE, C. M. (2019). “When to Use and How to Report the Results of PLS-SEM”. European Business Review, 31(1): 2-24.
  • HARMAN, H. H. (1979). Modern Factor Analysis (3rd ed.). University of Chicago Press.
  • HENSELER, J., RINGLE, C. M., & SARSTEDT, M. (2015). “A New Criterion for Assessing Discriminant Validity in Variance-Based Structural Equation Modeling”. Journal of the Academy of Marketing Science, 43(1): 115-135.
  • HENSELER, J., HUBONA G. S., & RAY, P. A. (2016). “Using PLS Path Modeling in New Technology: Updated Guidelines”. Industrial Management & Data Systems, 116(1): 2-20.
  • HIRIGOYEN, M. F. (2016). “Bullying As a Symptom of the Modern World”. Annales Medico-Psychologiques, 174(7): 575-579.
  • HOEL, H., COOPER, C. L., & FARAGHER, B. (2001). “The Experience of Bullying in Great Britain: The Impact of Organizational Status”. European Journal of Work and Organizational Psychology, 10(4): 443-465.
  • LATAN, H., & GHOZALI, I. (2015). Partial Least Squares: Concepts, Techniques and Application Using Program SmartPLS 3.0. (2nd edition). Diponegoro University Press.
  • LEE, Y., LEE, M., & BERNSTEIN, K. (2013). “Effect of Workplace Bullying and Job Stress on Turnover Intention in Hospital Nurses”. Journal of Korean Academy of Psychiatric and Mental Health Nursing, 22(2): 77-87.
  • MAHALANOBIS, P. C. (1936). On the Generalized Distance in Statistics. Proceedings of the National Institute of Sciences (India), 2(1): 49-55.
  • MATHISEN, G. E., EINARSEN, S., & MYKLETUN, R. (2011). “The Relationship between Supervisor Personality, Supervisors’ Perceived Stress and Workplace Bullying”. Journal of Business Ethics, 99(4): 637-651.
  • NUNNALLY, J. C. (1978). Psychometric Theory. McGraw-Hill
  • OFLAZ, M., & POLAT, E. (2023). “The Effect of Workplace Bullying and Job Satisfaction on Job Stress: An Investigation in Hotel Organizations”. Güncel Turizm Araştırmaları Dergisi, 7(1): 258-280.
  • ÖCEL, H., & AYDIN, O. (2012). “Workplace Bullying and Turnover Intention: The Moderating Role of Belief in a Just World”. International Journal of Business and Social Science, 3(13): 248-258.
  • RAYNER, C., HOEL, H., & COOPER, C. (2001). Workplace Bullying: What We Know, Who is to Blame and What Can We Do? CRC Press.
  • ROSIN, H., & KORABIK, K. (1995). “Organizational Experiences and Propensity to Leave: A Multivariate Investigation of Men and Women Managers”. Journal of Vocational Behavior, 46(1): 1-16.
  • PODSAKOFF, P. M. & ORGAN, D. W. (1986). “Self-Reports in Organizational Research: Problems and Prospects”. Journal of Management, 12(4): 531-544.
  • PODSAKOFF, P. M., MACKENZIE, S. B., LEE, J. Y., & PODSAKOFF, N. P. (2003). “Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies”. Journal of Applied Psychology, 88(5): 879.
  • SALİN, D. (2003). “Bullying and Organisational Politics in Competitive and Rapidly Changing Work Environments”. International Journal of Management and Decision Making, 4(1): 35-46.
  • SARSTEDT, M., HAIR, J. F., RINGLE, C. M., THIELE, K. O., & GUDERGAN, S. P. (2016). “Estimation Issues with PLS and CBSEM: Where the Bias Lies!” Journal of Business Research, 69(10): 3998-4010.
  • SCHAUFELI, W. B., BAKKER, A. B., & SALANOVA, M. (2006). “The Measurement of Work Engagement with a Short Questionnaire: A Cross-National Study”. Educational and Psychological Measurement, 66(4): 701-716.
  • STONE, M. (1974). “Cross‐Validatory Choice and Assessment of Statistical Predictions”. Journal of the Royal Statistical Society: Series B (Methodological), 36(2): 111-133.
  • TANRIÖVER, U. (2005). The Effects of Learning Organization Climate and Self-Directed Learning on Job Satisfaction, Affective Commitment and Intention to Turnover [Unpublished master thesis]. Marmara University
  • TORTUMLU, M., & UZUN K. (2022). “Investigation of the Mediator Role of Hope and Problem Solving Skills in the Effect of Workplace Bullying On Employees' Life Satisfaction”. Çukurova Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 31(1): 220-241.
  • WEISS, H. M., & CROPANZANO, R. (1996). Affective Events Theory: A Theoretical Discussion of the Structure, Causes and Consequences of Affective Experiences at Work. In B. M. Staw & L. L. Cummings (Eds.), Research in Organizational Behavior: An Annual Series of Analytical Essays and Critical Reviews, Vol. 18, pp. 1-74. Elsevier Science/JAI Press.

Consequences of Workplace Bullying: Findings from Public Sector via PLS-SEM

Year 2023, Volume: 7 Issue: 3, 1387 - 1400, 29.09.2023
https://doi.org/10.29023/alanyaakademik.1302573

Abstract

This study aims to determine the predictive power of workplace bullying on work engagement, perceived stress, job satisfaction, and turnover intention in the public sector. The study was patterned with a quantitative research method. Data were collected through survey techniques in March and April 2023. The sample consisted of 218 individuals working in a Special Provincial Administration in Türkiye. Partial least squares structural equation modeling (PLS-SEM) was used to test research hypotheses. According to findings, in descending order, workplace bullying positively contributes to explaining perceived stress first and turnover intention second. Workplace bullying negatively contributes to explaining, thirdly job satisfaction, and, finally, work engagement. The theoretical and practical contributions of the study were discussed, and suggestions were made for further research.

References

  • ARENAS, A., GIORGI, G., MONTANI, F., MANCUSO, S., PEREZ, J. F., MUCCI, N., & ARCANGELI, G. (2015). “Workplace Bullying In a Sample of Italian and Spanish Employees and Its Relationship with Job Satisfaction, and Psychological Well-Being”. Frontiers in Psychology, 6: 1-10.
  • AYDIN, O., & ÖCEL, H. (2009). “The Negative Act Questionnaire: A Study for Validity and Reliability”. Turkish Psychological Articles, 12(24): 94-103.
  • BILGE, A., F. ÖĞCE., GENÇ, R. E., & ORAN, N. T. (2009). “Psychometric Properties of a Turkish Version of the Perceived Stress Scale (PSS)”. Ege Üniversitesi Hemşirelik Yüksekokulu Dergisi, 2(25): 61-72.
  • BLAU, P. M. (1964). Exchange and Power in Social Life. John Wiley & Sons.
  • BODDY, C. R. (2011). “Corporate Psychopaths, Bullying and Unfair Supervision in the Workplace”. Journal of Business Ethics. 100(3): 367-379.
  • BOUDRIAS, V., TRÉPANIER, S. G., & SALIN, D. (2021). “A Systematic Review of Research on the Longitudinal Consequences of Workplace Bullying and the Mechanisms Involved”. Aggression and Violent Behavior, 56: 1-17.
  • COHEN, S., KAMARCK, T., & MERMELSTEIN, R. (1983). “A Global Measure of Perceived Stress”. Journal of Health and Social Behavior, 24(4): 385-396.
  • COHEN, J. (1988). Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum.
  • COOPER, C. L., HOEL, H., & FARAGHER, B. (2004). “Bullying is Detrimental to Health, But All Bullying Behaviours are not Necessarily Equally Damaging”. British Journal of Guidance & Counselling, 32(3): 367-387.
  • CRONBACH, L. J. (1951). “Coefficient Alpha and the Internal Structure of Tests”. Psychometrika, 16(3): 297-334.
  • ÇAVUŞ, M. F., & DEVELİ, A. (2022). “Entropic Organizational Climate, Organizational Indifference and Job Satisfaction: Concepts and Measurement Tools”. Journal of Organizational Behavior Studies, 2(2): 110-123.
  • DEVELİ, A., & CAVUS, M. F. (2019). Time Perspectives and Task Performance: An Investigation through PLS Path Modeling. In K. Ozyer & M. S. Doven (Eds.) 2nd International Conference on Contemporary Issues in Business & Economics Conference Proceedings (pp. 285-291), Tokat Gaziosmanpasa University.
  • DEVELİ, A. (2020). A Research for Determining the Relationship between Work Ability, Job Satisfaction and Task Performance [Unpublished doctoral thesis]. Osmaniye Korkut Ata University.
  • DEVELİ, A., & YILDIZ, H. (2021). “Investigation of Employees' Perceptions towards the Unions: A Multi-Group Analysis”. Beykoz Akademi Dergisi, 9(2): 85-97.
  • DIENER, E., EMMONS, R. A., LARSEN, R. J., & GRIFFIN, S. (1985). “The Satisfaction with Life Scale”. Journal of Personality Assessment, 49(1): 71-75.
  • EINARSEN, S., & SKOGSTAD, A. (1996). “Bullying at Work: Epidemiological Findings in Public and Private Organizations”. European Journal of Work and Organizational Psychology, 5(2): 185-201.
  • EINARSEN, S., & RAKNES, B. I. (1997). “Harassment in the Workplace and the Victimization of Men”. Violence and Victims, 12(3): 247-263.
  • EINARSEN, S. (1999). “The Nature and Causes of Bullying at Work”. International Journal of Manpower, 20(1/2): 16-27.
  • EINARSEN, S., & HOEL, H. (2001). The Negative Act Questionnaire: Development, Validation and Revision of a Measure of Bullying at Work. 10th Europen Congress on Work and Organizational Psychology, Prague-Czech Republic.
  • EINARSEN, S. V., SKOGSTAD, A., RØRVIK, E., LANDE, Å. B., & NIELSEN, M. B. (2018). “Climate for Conflict Management, Exposure to Workplace Bullying and Work Engagement: A Moderated Mediation Analysis”. The International Journal of Human Resource Management, 29(3): 549-570.
  • ERYILMAZ, E., & DOĞAN, T. (2012). “Subjective Well-Being at Work: Investigating of Psychometric Properties of Utrecht Work Engagement Scale”. Klinik Psikiyatri, 15: 49-55.
  • FORNELL, C., & LARCKER, D. F. (1981). “Evaluating Structural Equation Models with Unobservable Variables and Measurement Error”. Journal of Marketing Research, 18(1), 39-50.
  • GEISSER, S. (1974). “A Predictive Approach to the Random Effect Model”. Biometrika, 61(1): 101-107.
  • GOOGLE FORMS (n.d.). Google Forms. Retrieved February 1, 2023 from https://docs.google.com/forms/create?hl=tr.
  • GÜLER, M., ÇETIN, F., & BASIM, H. N. (2019). “The Validity and Reliability Study of Work Engagement Ultra Short Version (UWES-3) Proposal of an Alternative Version (UWES-6)”. The Journal of Human and Work, 6(2): 189-197.
  • HAIR, J. F., RINGLE, C. M., & SARSTEDT, M. (2013). “Partial Least Squares Structural Equation Modeling: Rigorous Applications, Better Results and Higher Acceptance”. Long Range Planning, 46(1-2): 1-12.
  • HAIR, J. F., BLACK, W. C., BABIN, B. J., & ANDERSON. R. E. (2014). Multivariate Data Analysis: Pearson New International Edition (7th ed.). Pearson Education Limited.
  • HAIR JR, J. F., HULT, G. T. M., RINGLE, C., & SARSTEDT, M. (2017). A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM), (2nd edition). Sage Publications.
  • HAIR, J. F., RISHER, J. J., SARSTEDT, M., & RINGLE, C. M. (2019). “When to Use and How to Report the Results of PLS-SEM”. European Business Review, 31(1): 2-24.
  • HARMAN, H. H. (1979). Modern Factor Analysis (3rd ed.). University of Chicago Press.
  • HENSELER, J., RINGLE, C. M., & SARSTEDT, M. (2015). “A New Criterion for Assessing Discriminant Validity in Variance-Based Structural Equation Modeling”. Journal of the Academy of Marketing Science, 43(1): 115-135.
  • HENSELER, J., HUBONA G. S., & RAY, P. A. (2016). “Using PLS Path Modeling in New Technology: Updated Guidelines”. Industrial Management & Data Systems, 116(1): 2-20.
  • HIRIGOYEN, M. F. (2016). “Bullying As a Symptom of the Modern World”. Annales Medico-Psychologiques, 174(7): 575-579.
  • HOEL, H., COOPER, C. L., & FARAGHER, B. (2001). “The Experience of Bullying in Great Britain: The Impact of Organizational Status”. European Journal of Work and Organizational Psychology, 10(4): 443-465.
  • LATAN, H., & GHOZALI, I. (2015). Partial Least Squares: Concepts, Techniques and Application Using Program SmartPLS 3.0. (2nd edition). Diponegoro University Press.
  • LEE, Y., LEE, M., & BERNSTEIN, K. (2013). “Effect of Workplace Bullying and Job Stress on Turnover Intention in Hospital Nurses”. Journal of Korean Academy of Psychiatric and Mental Health Nursing, 22(2): 77-87.
  • MAHALANOBIS, P. C. (1936). On the Generalized Distance in Statistics. Proceedings of the National Institute of Sciences (India), 2(1): 49-55.
  • MATHISEN, G. E., EINARSEN, S., & MYKLETUN, R. (2011). “The Relationship between Supervisor Personality, Supervisors’ Perceived Stress and Workplace Bullying”. Journal of Business Ethics, 99(4): 637-651.
  • NUNNALLY, J. C. (1978). Psychometric Theory. McGraw-Hill
  • OFLAZ, M., & POLAT, E. (2023). “The Effect of Workplace Bullying and Job Satisfaction on Job Stress: An Investigation in Hotel Organizations”. Güncel Turizm Araştırmaları Dergisi, 7(1): 258-280.
  • ÖCEL, H., & AYDIN, O. (2012). “Workplace Bullying and Turnover Intention: The Moderating Role of Belief in a Just World”. International Journal of Business and Social Science, 3(13): 248-258.
  • RAYNER, C., HOEL, H., & COOPER, C. (2001). Workplace Bullying: What We Know, Who is to Blame and What Can We Do? CRC Press.
  • ROSIN, H., & KORABIK, K. (1995). “Organizational Experiences and Propensity to Leave: A Multivariate Investigation of Men and Women Managers”. Journal of Vocational Behavior, 46(1): 1-16.
  • PODSAKOFF, P. M. & ORGAN, D. W. (1986). “Self-Reports in Organizational Research: Problems and Prospects”. Journal of Management, 12(4): 531-544.
  • PODSAKOFF, P. M., MACKENZIE, S. B., LEE, J. Y., & PODSAKOFF, N. P. (2003). “Common Method Biases in Behavioral Research: A Critical Review of the Literature and Recommended Remedies”. Journal of Applied Psychology, 88(5): 879.
  • SALİN, D. (2003). “Bullying and Organisational Politics in Competitive and Rapidly Changing Work Environments”. International Journal of Management and Decision Making, 4(1): 35-46.
  • SARSTEDT, M., HAIR, J. F., RINGLE, C. M., THIELE, K. O., & GUDERGAN, S. P. (2016). “Estimation Issues with PLS and CBSEM: Where the Bias Lies!” Journal of Business Research, 69(10): 3998-4010.
  • SCHAUFELI, W. B., BAKKER, A. B., & SALANOVA, M. (2006). “The Measurement of Work Engagement with a Short Questionnaire: A Cross-National Study”. Educational and Psychological Measurement, 66(4): 701-716.
  • STONE, M. (1974). “Cross‐Validatory Choice and Assessment of Statistical Predictions”. Journal of the Royal Statistical Society: Series B (Methodological), 36(2): 111-133.
  • TANRIÖVER, U. (2005). The Effects of Learning Organization Climate and Self-Directed Learning on Job Satisfaction, Affective Commitment and Intention to Turnover [Unpublished master thesis]. Marmara University
  • TORTUMLU, M., & UZUN K. (2022). “Investigation of the Mediator Role of Hope and Problem Solving Skills in the Effect of Workplace Bullying On Employees' Life Satisfaction”. Çukurova Üniversitesi Sosyal Bilimler Enstitüsü Dergisi, 31(1): 220-241.
  • WEISS, H. M., & CROPANZANO, R. (1996). Affective Events Theory: A Theoretical Discussion of the Structure, Causes and Consequences of Affective Experiences at Work. In B. M. Staw & L. L. Cummings (Eds.), Research in Organizational Behavior: An Annual Series of Analytical Essays and Critical Reviews, Vol. 18, pp. 1-74. Elsevier Science/JAI Press.
There are 52 citations in total.

Details

Primary Language English
Subjects Operation
Journal Section Makaleler
Authors

Alptekin Develi 0000-0001-7232-5603

Tuğba Tuğçe Turak 0009-0005-2471-4379

Publication Date September 29, 2023
Acceptance Date August 22, 2023
Published in Issue Year 2023 Volume: 7 Issue: 3

Cite

APA Develi, A., & Turak, T. T. (2023). Consequences of Workplace Bullying: Findings from Public Sector via PLS-SEM. Alanya Akademik Bakış, 7(3), 1387-1400. https://doi.org/10.29023/alanyaakademik.1302573