<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">lingngu</journal-id><journal-title-group><journal-title xml:lang="ru">Вестник НГУ. Серия: Лингвистика и межкультурная коммуникация</journal-title><trans-title-group xml:lang="en"><trans-title>NSU Vestnik. Series: Linguistics and Intercultural Communication</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1818-7935</issn><publisher><publisher-name>Новосибирский государственный университет</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.25205/1818-7935-2024-22-3-98-111</article-id><article-id custom-type="elpub" pub-id-type="custom">lingngu-789</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>КОМПЬЮТЕРНАЯ И ПРИКЛАДНАЯ ЛИНГВИСТИКА</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="en"><subject>COMPUTER AND APPLIED LINGUISTICS</subject></subj-group></article-categories><title-group><article-title>Бинарный классификатор для экспериментального поиска триггеров в шутках на английском языке</article-title><trans-title-group xml:lang="en"><trans-title>Binary Classifier for Experimental Search of Triggers in Jokes in English</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-3655-4369</contrib-id><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Заковоротная</surname><given-names>Е. М.</given-names></name><name name-style="western" xml:lang="en"><surname>Zakovorotnaia</surname><given-names>E. M.</given-names></name></name-alternatives><bio xml:lang="ru"><p>Заковоротная Евгения Максимовна, аспирант факультета гуманитарных наук </p><p>Москва</p></bio><bio xml:lang="en"><p>Eugeniia M. Zakovorotnaia, Postgraduate Student of the Faculty of Humanities</p><p>Moscow</p></bio><email xlink:type="simple">haylin65@yandex.ru</email><xref ref-type="aff" rid="aff-1"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Национальный исследовательский университет «Высшая школа экономики»</institution><country>Россия</country></aff><aff xml:lang="en"><institution>National Research University Higher School of Economics</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2024</year></pub-date><pub-date pub-type="epub"><day>10</day><month>12</month><year>2024</year></pub-date><volume>22</volume><issue>3</issue><fpage>98</fpage><lpage>111</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Заковоротная Е.М., 2024</copyright-statement><copyright-year>2024</copyright-year><copyright-holder xml:lang="ru">Заковоротная Е.М.</copyright-holder><copyright-holder xml:lang="en">Zakovorotnaia E.M.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://lingngu.elpub.ru/jour/article/view/789">https://lingngu.elpub.ru/jour/article/view/789</self-uri><abstract><p>Описывается создание модели, которая решает задачу распознавания юмористических и неюмористических текстов. Была обучена гибридная модель с предобученной нейронной сетью BERT в качестве эмбеддингового слоя и Bi-LSTM для классификации последовательностей. В качестве основного материала использовался обучающий и тестовый корпусы из 76 тысяч текстов, шуток и не-шуток. Особое внимание уделено идентичности лексики; данный критерий необходим, чтобы модель не распознавала разные категории текстов по лексике. В работе также описывается применение гибридной нейросети в серии экспериментов по лингвистическим преобразованиям юмористических и неюмористических текстов. Цель данных экспериментов заключается в поиске ключевых частей и слов, без которых шутка перестает быть юмористической. В рамках некоторых междисциплинарных теорий юмора подобные слова и выражения называют триггерами [Attardo S., 1994]. По результатам количественного и качественного анализа можно сделать вывод, что 78 из 100 шуток в валидационном датасете хотя бы один раз меняют метку класса на противоположную при использовании системы правил преобразований. При этом в 16 из оставшихся 22 шуток содержится явная или неявная экстралингвистическая информация. Т-критерий распределения Стьюдента, измеренный на вероятностных оценках исходного и измененного текста для каждого типа преобразования, позволил выявить преобразования, при которых чаще всего шутки из валидационного датасета перестают быть юмористическими: удаление панчлайна, удаление от 1 до 3 токенов с начала текста, удаление от 1 до 3 токенов с середины текста, удаление всех существительных.</p></abstract><trans-abstract xml:lang="en"><p>This paper describes the development of a binary classifier differentiating humorous and non-humorous texts. The proposed seq2seq model consists of a pre-trained BERT embedding layer and a Bi-LSTM layer used for sequence classification. Training and validation corpora include 76,000 jokes and non-jokes with identical vocabulary; this is essential in preventing vocabulary choice from being employed as a distinguishing factor between humor and non-humor. Further, this paper also describes the application of the trained neural network in a series of experiments on linguistic transformations of humorous and non-humorous texts. The purpose of these experiments is to identify the essential parts and words, without which the joke ceases to be humorous. Some interdisciplinary theories of humor specify such expressions as triggers [Attardo S., 1994]. Based on the results of quantitative and qualitative analyses, 78 of the jokes from the validation dataset changed the label to the opposite at least once when the text was transformed. At the same time, 16 of the remaining 22 jokes contain explicit or implicit extralinguistic information. T-test, which measured probabilistic estimates of the original and modified texts for each type of linguistic transformation, revealed (keep tense consistent) the most common types of them: deletion of the punchline, deletion of the setup, deletion of 1 to 3 tokens from the beginning of the text, deletion of 1 to 3 tokens from the middle of the text and deletion of all the nouns.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>автоматическая обработка естественного языка</kwd><kwd>изучение юмора</kwd><kwd>эксперименты</kwd><kwd>компьютерная лингвистика</kwd></kwd-group><kwd-group xml:lang="en"><kwd>automatic natural language processing</kwd><kwd>humor study</kwd><kwd>experiments</kwd><kwd>computational linguistics</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title><ref id="cit1"><label>1</label><citation-alternatives><mixed-citation xml:lang="ru">Annamoradnejad I. ColBERT: Using BERT Sentence Embedding for Humor Detection. 2022, URL: https://arxiv.org/abs/2004.12765</mixed-citation><mixed-citation xml:lang="en">Annamoradnejad I. ColBERT: Using BERT Sentence Embedding for Humor Detection. 2022, URL: https://arxiv.org/abs/2004.12765</mixed-citation></citation-alternatives></ref><ref id="cit2"><label>2</label><citation-alternatives><mixed-citation xml:lang="ru">Attardo S. Linguistic theories of humor. Mouton de Gruyter. 1994</mixed-citation><mixed-citation xml:lang="en">Attardo S. Linguistic theories of humor. Mouton de Gruyter. 1994</mixed-citation></citation-alternatives></ref><ref id="cit3"><label>3</label><citation-alternatives><mixed-citation xml:lang="ru">Blinov V., Bolotova-Baranova V., Braslavski P. Large Dataset and Language Model Fun-Tuning for Humor Recognition // In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, p. 4027–4032.</mixed-citation><mixed-citation xml:lang="en">Blinov V., Bolotova-Baranova V., Braslavski P. Large Dataset and Language Model Fun-Tuning for Humor Recognition // In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, 2019, p. 4027–4032.</mixed-citation></citation-alternatives></ref><ref id="cit4"><label>4</label><citation-alternatives><mixed-citation xml:lang="ru">Chen Y., Shi B., Si M. Prompt to GPT-3: Step-by-Step Thinking Instructions for Humor Generation. 2023, URL: https://arxiv.org/abs/2306.13195</mixed-citation><mixed-citation xml:lang="en">Chen Y., Shi B., Si M. Prompt to GPT-3: Step-by-Step Thinking Instructions for Humor Generation. 2023, URL: https://arxiv.org/abs/2306.13195</mixed-citation></citation-alternatives></ref><ref id="cit5"><label>5</label><citation-alternatives><mixed-citation xml:lang="ru">Devlin J., Chang M.-W., Lee K., Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno logies, 2019, vol. 1 (Long and Short Papers), p. 4171–4186.</mixed-citation><mixed-citation xml:lang="en">Devlin J., Chang M.-W., Lee K., Toutanova K. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding // In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno logies, 2019, vol. 1 (Long and Short Papers), p. 4171–4186.</mixed-citation></citation-alternatives></ref><ref id="cit6"><label>6</label><citation-alternatives><mixed-citation xml:lang="ru">Epstein B. The Internal and the External in Linguistic Explanation. // Croatian Journal of Philosophy, 2008, vol. 8(22), p. 77–111.</mixed-citation><mixed-citation xml:lang="en">Epstein B. The Internal and the External in Linguistic Explanation. // Croatian Journal of Philosophy, 2008, vol. 8(22), p. 77–111.</mixed-citation></citation-alternatives></ref><ref id="cit7"><label>7</label><citation-alternatives><mixed-citation xml:lang="ru">Hasan M. K., Rahman W., Zadeh A. B., Zhong J., Tanveer M. I., Morency L.-P., Hoque M. UR-FUNNY: A Multimodal Language Dataset for Understanding Humor. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th Internatio nal Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, p. 2046–2056.</mixed-citation><mixed-citation xml:lang="en">Hasan M. K., Rahman W., Zadeh A. B., Zhong J., Tanveer M. I., Morency L.-P., Hoque M. UR-FUNNY: A Multimodal Language Dataset for Understanding Humor. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th Internatio nal Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, p. 2046–2056.</mixed-citation></citation-alternatives></ref><ref id="cit8"><label>8</label><citation-alternatives><mixed-citation xml:lang="ru">He H., Peng N., Liang P. Pun Generation with Surprise // In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2019, p. 1734–1744.</mixed-citation><mixed-citation xml:lang="en">He H., Peng N., Liang P. Pun Generation with Surprise // In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), 2019, p. 1734–1744.</mixed-citation></citation-alternatives></ref><ref id="cit9"><label>9</label><citation-alternatives><mixed-citation xml:lang="ru">IberLEF2019, URL: https://sites.google.com/view/iberlef-2019/</mixed-citation><mixed-citation xml:lang="en">IberLEF2019, URL: https://sites.google.com/view/iberlef-2019/</mixed-citation></citation-alternatives></ref><ref id="cit10"><label>10</label><citation-alternatives><mixed-citation xml:lang="ru">Karande A. What Humour Tells Us About Discourse Theories // Conference of the European Chapter of the Association for Computational Linguistics, 2006, p. 31–38.</mixed-citation><mixed-citation xml:lang="en">Karande A. What Humour Tells Us About Discourse Theories // Conference of the European Chapter of the Association for Computational Linguistics, 2006, p. 31–38.</mixed-citation></citation-alternatives></ref><ref id="cit11"><label>11</label><citation-alternatives><mixed-citation xml:lang="ru">Liu Y., Ott M., Goyal N., Du J., Joshi M, Chen D., Levy O., Lewis M., Zettlemoyer L., Stoyanov V. // ‘RoBERTa: A Robustly Optimized BERT Pretraining Approach’, URL: https://arxiv.org/abs/1907.11692.</mixed-citation><mixed-citation xml:lang="en">Liu Y., Ott M., Goyal N., Du J., Joshi M, Chen D., Levy O., Lewis M., Zettlemoyer L., Stoyanov V. // ‘RoBERTa: A Robustly Optimized BERT Pretraining Approach’, URL: https://arxiv.org/abs/1907.11692.</mixed-citation></citation-alternatives></ref><ref id="cit12"><label>12</label><citation-alternatives><mixed-citation xml:lang="ru">Morreall J. “Philosophy of Humor”, The Stanford Encyclopedia of Philosophy (Fall 2020 Edition). Edward N. Zalta (ed.), Metaphysics Research Lab, Stanford University, 2020, vol. 2. URL: https://plato.stanford.edu/archives/fall2020/entries/humor/</mixed-citation><mixed-citation xml:lang="en">Morreall J. “Philosophy of Humor”, The Stanford Encyclopedia of Philosophy (Fall 2020 Edition). Edward N. Zalta (ed.), Metaphysics Research Lab, Stanford University, 2020, vol. 2. URL: https://plato.stanford.edu/archives/fall2020/entries/humor/</mixed-citation></citation-alternatives></ref><ref id="cit13"><label>13</label><citation-alternatives><mixed-citation xml:lang="ru">Pritchett Bradley L. Garden Path Phenomena and the Grammatical Basis of Language Processing // Language 64, 1988, p. 539–576.</mixed-citation><mixed-citation xml:lang="en">Pritchett Bradley L. Garden Path Phenomena and the Grammatical Basis of Language Processing // Language 64, 1988, p. 539–576.</mixed-citation></citation-alternatives></ref><ref id="cit14"><label>14</label><citation-alternatives><mixed-citation xml:lang="ru">Raskin V. Semantic Mechanisms of Humor, Volume 24 Springer Netherlands, Dordrecht, 1984, p. 99–147.</mixed-citation><mixed-citation xml:lang="en">Raskin V. Semantic Mechanisms of Humor, Volume 24 Springer Netherlands, Dordrecht, 1984, p. 99–147.</mixed-citation></citation-alternatives></ref><ref id="cit15"><label>15</label><citation-alternatives><mixed-citation xml:lang="ru">Raskin V., Attardo S. Script theory revis(it)ed: joke similarity and joke representation model // Humor – International Journal of Humor Research, Voume. 4 (Issue 3-4), 2020, p. 293–348.</mixed-citation><mixed-citation xml:lang="en">Raskin V., Attardo S. Script theory revis(it)ed: joke similarity and joke representation model // Humor – International Journal of Humor Research, Voume. 4 (Issue 3-4), 2020, p. 293–348.</mixed-citation></citation-alternatives></ref><ref id="cit16"><label>16</label><citation-alternatives><mixed-citation xml:lang="ru">SemEval2020, URL: https://alt.qcri.org/semeval2020/</mixed-citation><mixed-citation xml:lang="en">SemEval2020, URL: https://alt.qcri.org/semeval2020/</mixed-citation></citation-alternatives></ref><ref id="cit17"><label>17</label><citation-alternatives><mixed-citation xml:lang="ru">SemEval2021, URL: https://semeval.github.io/SemEval2021/</mixed-citation><mixed-citation xml:lang="en">SemEval2021, URL: https://semeval.github.io/SemEval2021/</mixed-citation></citation-alternatives></ref><ref id="cit18"><label>18</label><citation-alternatives><mixed-citation xml:lang="ru">Spacy-model “en_core_web_trf”: https://huggingface.co/spacy/en_core_web_trf</mixed-citation><mixed-citation xml:lang="en">Spacy-model “en_core_web_trf”: https://huggingface.co/spacy/en_core_web_trf</mixed-citation></citation-alternatives></ref><ref id="cit19"><label>19</label><citation-alternatives><mixed-citation xml:lang="ru">Tang L., Cai A., Li S., Wang J. The Naughtyformer: A Transformer Understands Offensive Humor, 2023, URL: https://arxiv.org/abs/2211.14369</mixed-citation><mixed-citation xml:lang="en">Tang L., Cai A., Li S., Wang J. The Naughtyformer: A Transformer Understands Offensive Humor, 2023, URL: https://arxiv.org/abs/2211.14369</mixed-citation></citation-alternatives></ref><ref id="cit20"><label>20</label><citation-alternatives><mixed-citation xml:lang="ru">Toplyn J. Witscript 3: A hybrid ai system for improvising jokes in a conversation. 2023, URL: https://arxiv.org/abs/2301.02695</mixed-citation><mixed-citation xml:lang="en">Toplyn J. Witscript 3: A hybrid ai system for improvising jokes in a conversation. 2023, URL: https://arxiv.org/abs/2301.02695</mixed-citation></citation-alternatives></ref><ref id="cit21"><label>21</label><citation-alternatives><mixed-citation xml:lang="ru">Veale T. Figure-Ground Reversal in Linguistic Humour:A multimodal prespective // Lodz Papers in Pragmatics 4.1, Special Issue on Humour, 2008, p. 63–81.</mixed-citation><mixed-citation xml:lang="en">Veale T. Figure-Ground Reversal in Linguistic Humour:A multimodal prespective // Lodz Papers in Pragmatics 4.1, Special Issue on Humour, 2008, p. 63–81.</mixed-citation></citation-alternatives></ref><ref id="cit22"><label>22</label><citation-alternatives><mixed-citation xml:lang="ru">Wang M.,Yang H., Qin Y., Sun S., Deng Y. Unified Humor Detection Based on Sentence-pair Augmentation and Transfer Learning // In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 2020, p. 53–59.</mixed-citation><mixed-citation xml:lang="en">Wang M.,Yang H., Qin Y., Sun S., Deng Y. Unified Humor Detection Based on Sentence-pair Augmentation and Transfer Learning // In Proceedings of the 22nd Annual Conference of the European Association for Machine Translation, 2020, p. 53–59.</mixed-citation></citation-alternatives></ref><ref id="cit23"><label>23</label><citation-alternatives><mixed-citation xml:lang="ru">Weller O., Seppi K. Humor Detection: A Transformer Gets the Last Laugh // Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, p. 3621–3625.</mixed-citation><mixed-citation xml:lang="en">Weller O., Seppi K. Humor Detection: A Transformer Gets the Last Laugh // Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), 2019, p. 3621–3625.</mixed-citation></citation-alternatives></ref></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
