COMPARATIVE PEDAGOGY OF SENTIMENT ANALYSIS IN DIGITAL LINGUISTICS
Abstract and keywords
Abstract:
The article introduces an experiment conducted during classes on text tonality as part of a Master’s Degree course of Computational Linguistics. These classes develop competencies in vocabulary methods, ready-made software libraries, and neural network language models. The experiment involved 16 first-year Digital Linguistics students majoring in Smart Systems in the Humanities at St. Petersburg Polytechnic University in 2024–2025. The didactic design of assignments made it possible to gradually increase the complexity of tasks and combine the acquisition of theoretical knowledge with practical skill development. Module 1 focused on the use of English and Russian tonality dictionaries. The students learned to identify the fundamental limitations of the lexicographic approach, e.g., incomplete dictionaries, as well as difficulties associated with contextual meaning, negations, sarcasm, and cultural specificity. Module 2 involved training a DistilBERT model and working with various datasets. The students reflected on the role of data in prediction quality, as well as on the limitations of modern neural architectures in analyzing complex semantic phenomena. Module 3 involved a group project. The students compared lexicon-based, neural, and library-based (VADER, TextBlob, Flair) approaches for advantages, disadvantages, and applicability. The experiment fostered critical thinking and the ability to make informed decisions when electing tools for specific tasks and available resources. A comprehensive synergy of methods is efficient as it allows students to test both the strengths and the weaknesses of each approach. Integrating sentiment analysis into digital linguistics curricula is a key challenge for modern higher education.

Keywords:
computational linguistics, opinion mining, sentiment analysis, digital methods in linguistics, large language models, sentiment lexicons, teaching methodology
Text
Text (RU) (PDF): Read Download
References

1. Bolshakova E. I., Vorontsov K. V., Efremova N. E., Klyshinskii E. S., Lukashevich N. V., Sapin A. S. Automatic natural language text processing and data analysis. Moscow: HSE University, 2017, 269. (In Russ.) https://elibrary.ru/vscjgb

2. Valkova Yu. E. Artificial intelligence for the foreign language classes at higher education institution. Lomonosov Pedagogical Education Journal, 2025, 23(1): 137–151. (In Russ.) https://elibrary.ru/znfrfb

3. Gadzhieva L. A. The use of artificial intelligence systems in the process of the English language teaching of bachelor’s degree students. Baltic Humanitarian Journal, 2023, 12(3): 26–30. (In Russ.) https://elibrary.ru/vhlaws

4. Dmitriev A. V., Kogan M. S. The potential of corpus linguistics in training foreign language teachers majoring in computer assisted language teaching. St. Petersburg State Polytechnical University Journal. Humanities and Social Sciences, 2019, 10(4): 69–85. (In Russ.) https://doi.org/10.18721/JHSS.10407

5. Dyulicheva Yu. Yu. Application of learning analytics in higher education: Datasets, methods and tools. Higher Education in Russia, 2024, 33(5): 86–111. (In Russ.) https://doi.org/10.31992/0869-3617-2024-33-5-86-111

6. Yiwen G. Using large language models to develop skills in analyzing media context in students of philological specialties. Informatization of Education, 2024, 39(6): 82–96. (In Russ.) https://doi.org/10.32517/0234-0453-2024-39-6-82-96

7. Kotova E. E., Pisarev I. A. Construction of thematic ontologies using the method of automated thesauri development. LETI Transactions on Electrical Engineering & Computer Science, 2016, (3): 37–47. (In Russ.) https://elibrary.ru/vpupbr

8. Krishtal M. M., Bogdanova A. V., Myagkov M. G., Alexandrova Yu. K. Digital footprint: Assessing student satisfaction with education quality. Higher Education in Russia, 2024, 33(2): 89–108. (In Russ.) https://doi.org/10.31992/0869-3617-2024-33-2-89-108

9. Loukachevitch N. V. Automatic sentiment analysis towards the entity and its characteristics. Russian Digital Libraries Journal, 2015, 18(3-4): 88–119. (In Russ.) https://elibrary.ru/ygkqbh

10. Loukachevitch N. V. Automatic sentiment analysis of texts: Problems and methods. Intelligent Systems. Theory and Applications, 2022, 26(1): 50–61. (In Russ.) https://elibrary.ru/iibyws

11. Loukachevitch N. V., Rubtsova Yu. V. Entity-oriented sentiment analysis of tweets: Results and problems. Data analytics and management in data-intensive areas: Proc. XVII Intern. Conf., Obninsk, 13–16 Oct 2015. Obninsk: IATE NRNU MEPhI, 2015, 499–507. (In Russ.) https://elibrary.ru/vzydrt

12. Magomedova P. S., Maksyutova Z. G. Use of information-communicative technologies in teaching linguistic disciplines in the university. Upravlenie v Sovremennykh Sistemakh, 2018, (2): 20–25. (In Russ.) https://elibrary.ru/urowlo

13. Martynova I. N. Teaching computational linguistics at German universities. I. Yakovlev Chuvash State Pedagogical University Bulletin, 2018, (3): 231–238. (In Russ.) https://elibrary.ru/ygiqqp

14. Saidullaeva Kh. V. The use of computer technology in teaching foreign languages. Voprosy Ustojchivogo Razvitiya Obshchestva, 2020, (3-2): 785–789. (In Russ.) https://elibrary.ru/mxlxrv

15. Urmakshinova E. R. On formation of computer information skills for linguistic students. Information systems and technologies in education, science and business: Proc. Region. Sci.-Prac. Conf. with Intern. Participation, Ulan-Ude, 1 Jun 2020. Ulan-Ude: Dorzhi Banzarov Buryat State University, 2020, 40–43. (In Russ.) https://doi.org/10.18101/978-5-9793-1497-6-40-43

16. Sharipbai A. A., Niyazova R. S., Turebaeva R. D., Razakhova B. Sh., Kudubaeva S. A. Competence-based approach to the development of an educational program in computational linguistics. North-Eastern Journal of Humanities, 2019, (3): 77–86. (In Russ.) https://elibrary.ru/uiqiua

17. Charnine M. M., Schagaev I., Protasov V. I., Rodina I. V., Zolotarev O. V., Popova O. A. Web semantics for improving the educational programs of universities. Vestnik Moskovskogo gosudarstvennogo gumanitarnogo universiteta im. M. A. Sholokhova. Filologicheskie nauki, 2015, (2): 97–112. (In Russ.) https://elibrary.ru/uapser

18. Adinolfi P., D’Avanzo E., Lytras M. D., Novo-Corti I., Picatoste J. Sentiment analysis to evaluate teaching performance. International Journal of Knowledge Society Research, 2016, 7(4): 86–107. https://doi.org/10.4018/IJKSR.2016100108

19. Amaro R. Teaching computational linguistics: Challenges and target audiences. WCCSETE'2016, Castelo Branco, 4–7 Sep 2016. Castelo Branco: WCCSETE, 2016, 38–42.

20. Anderson C. J. A prompting assignment for exploring pretrained LLMs. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 81–84.

21. Barnes J., Touileb S., Øvrelid L., Velldal E. Lexicon information in neural sentiment analysis: A multi-task learning approach. Proceedings of the 22nd Nordic Conference on Computational Linguistics, Turku, 30 Sep – 2 Oct 2019. Linköping University Electronic Press, 2019, 175–186.

22. Brown A., Steuer J., Mosbach M., Klakow D. An interactive toolkit for approachable NLP. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 119–127.

23. Deshpande S. B., Tangod K. K., Srinivasaiah S. H., Alahmadi A. A., Alwetaishi M., Goh K. O. M., Rajendran S. Elevating educational insights: Sentiment analysis of faculty feedback using advanced machine learning models. Advances in Continuous and Discrete Models, 2025, (1). https://doi.org/10.1186/s13662-025-03933-9

24. Hartmann J., Heitmann M., Siebert Ch., Schamp Ch. More than a feeling: Accuracy and application of sentiment analysis. International Journal of Research in Marketing, 2023, 40(1): 75–87. https://doi.org/10.1016/j.ijresmar.2022.05.005

25. Hatzivassiloglou V., McKeown K. R. Predicting the semantic orientation of adjectives. 35th Annual Meeting of the Association for Computational Linguistics and 8th Conference of the European Chapter of the Association for Computational Linguistics, Madrid, 7–12 Jul 1997. San Francisco: ACL, 1997, 174–181.

26. He R., Lee W. S., Ng H. T., Dahlmeier D. An interactive multi-task learning network for end-to-end aspect-based sentiment analysis. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, 28 Jul – 2 Aug 2019. ACL, 2019, 504–515.

27. Helcl J., Kasner Z., Dušek O., Limisiewicz T., Macháček D., Musil T., Libovický J. Teaching LLMs at Charles University: Assignments and activities. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 69–72.

28. Hou Y., Tran T. T., Long Vu D. N., Cao Y., Li K., Rohde L., Gurevych I. A course shared task on evaluating LLM output for clinical questions. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 77–80.

29. Hu M., Liu B. Mining and summarizing customer reviews. KDD'04: Proc. 10 ACM SIGKDD Intern., Conf., Seattle, 22–25 Aug 2004. NY: ACL, 2004, 168–177. https://doi.org/10.1145/1014052.1014073

30. Joshi A., Renzella J., Bhattacharyya P., Jha S., Zhang X. Striking a balance between classical and deep learning approaches in natural language processing pedagogy. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 23–32.

31. Kaibassova D., La L., Smagulova A., Nurtay M., Lisitsyna L., Shikov A. Methods and algorithms of analyzing syllabuses for educational programs forming intellectual system. Journal of Theoretical and Applied Information Technology, 2020, 98(5): 876–888. https://elibrary.ru/sukkov

32. Kaibassova D., Nurtay M. The comparative analysis of machine learning models for quality assessment of textual academic works. 2022 SIST: Proc. Intern. Conf., Nur-Sultan, 28–30 Apr 2022. IEEE, 2022, 1–4. https://doi.org/10.1109/SIST54437.2022.9945714

33. Kastrati Z., Dalipi F., Imran A. Sh., Pireva Nuci K., WanI M. A. Sentiment analysis of students’ feedback with NLP and deep learning: A systematic mapping study. Applied Sciences, 2021, 11(9). https://doi.org/10.3390/app11093986

34. Kessler G. Technology and the future of language teaching. Foreign Language Annals, 2018, 51(1): 205–218. https://doi.org/10.1111/flan.12318

35. Koto F., Beck T., Talat Z., Gurevych I., Baldwin T. Zero-shot sentiment analysis in low-resource languages using a multilingual sentiment lexicon. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics, St. Julian’s, 17–22 Mar 2024. ACL, 2024, 298–320.

36. Li M., Chen L., Zhao J., Li Q. Sentiment analysis of Chinese stock reviews based on BERT model. Applied Intelligence, 2021, 51(7): 5016–5024. https://doi.org/10.1007/s10489-020-02101-8

37. Liu B. Sentiment analysis and opinion mining. Morgan & Claypool Publishers, 2012, 167.

38. McCrae J. P. Co-creational teaching of natural language processing. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 33–42.

39. Mohsen M. A., Althebi S., Qadhi S. Mapping the evolution of computer-assisted language learning research: A 44-year bibliometric overview. European Journal of Education, 2025, 60(2). https://doi.org/10.1111/ejed.70051

40. Nikishina I., Tikhonova M., Chekalina V., Zaytsev A., Vazhentsev A., Panchenko A. Industry vs academia: Running a course on transformers in two setups. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 7–22.

41. Pang B., Lee L. Opinion mining and sentiment analysis. Foundations and Trends in Information Retrieval, 2008, 2(1-2): 1–135.

42. Pang B., Lee L., Vaithyanathan S. Thumbs up? Sentiment classification using machine learning techniques. Proceedings of the 2002 Conference on Empirical Methods in Natural Language Processing, Online, 6 Jul 2002. Stroudsburg: ACL, 2002, 79–86.

43. Parde N. Example-driven course slides on natural language processing concepts. Proceedings of the Sixth Workshop on Teaching NLP, Bangkok, 15 Aug 2024. ACL, 2024, 4–6.

44. Rajput Q., Haider S., Ghani S. Lexicon-based sentiment analysis of teachers’ evaluation. Applied Computational Intelligence and Soft Computing, 2016. https://doi.org/10.1155/2016/2385429

45. Reimers N., Gurevych I. Sentence-BERT: Sentence embeddings using siamese BERT-networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, Hong Kong, 3–7 Nov 2019. ACL, 2019, 3982–3992. https://doi.org/10.18653/v1/D19-1410

46. Ruder S., Ghaffari P., Breslin J. G. A hierarchical model of reviews for aspect-based sentiment analysis. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, 1–4 Nov 2016. ACL, 2016, 999–1005. https://doi.org/10.18653/v1/D16-1103

47. Son J. B., Ružić N. K., Philpott A. Artificial intelligence technologies and applications for language learning and teaching. Journal of China Computer-Assisted Language Learning, 2025, 5(1): 94–112. https://doi.org/10.1515/jccall-2023-0015

48. Teng Z., Vo D.-T., Zhang Y. Context-sensitive lexicon features for neural sentiment analysis. Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, Austin, 1–4 Nov 2016. ACL, 2016, 1629–1638. https://doi.org/10.18653/v1/D16-1169

49. Turney P. D. Thumbs up or thumbs down? Semantic orientation applied to unsupervised classification of reviews. Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, Philadelphia, 6–12 Jul 2002. ACL, 2002, 417–424. https://doi.org/10.3115/1073083.1073153

50. Wiebe J. M. Learning subjective adjectives from corpora. Proceedings of the Seventeenth National Conference on Artificial Intelligence and Twelfth Conference on Innovative Applications of Artificial Intelligence, Austin, 30 Jul – 3 Aug 2000. AAAI Press, 2000, 735–740.

51. Wiebe J. M., Bruce R. F., O’Hara T. P. Development and use of a gold-standard data set for subjectivity classifications. Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics, College Park, 20–26 Jun 1999. ACL, 1999, 246–253. https://doi.org/10.3115/1034678.1034721


Login or Create
* Forgot password?