Multimodal Means of Representing Pragmatic Potential in Advertising Discourse

This article is an attempt to study multimodal means used to reveal pragmatic potential of advertising posts in the social network VKontakte. In the paper we explore the concept of multimodality and multimodal text as a semiotic unity. We proceed from the fact that such a unity is achieved through coherence of social context. An advertising text is understood as a multimodal complex in which information is transmitted through a variety of semiotic codes which are socially and culturally determined. These codes serve as semiotic resources to produce meaning. We claim that advertising messages in the social network VKontakte are a form of a media text whose inherent characteristics exceed verbal means and possess such features as coherence, recontextuality, multilevelness, multimodality and multimediality. We have used a multimodal discourse analysis, which is in line with social semiotics concepts and works by G. Kress. He argues that the goal of such an analysis is to develop a number of methods which make it possible to study the interaction between social meanings and their polysemiotic representations in a text. The analysis is aimed at exploring four key components: text; context, actions, and interactions of participants in the discourse; the impact of the text and ideology. The research is carried out at the micro and macro levels. At the micro level, a textual analysis of both verbal and non-verbal means was conducted. At the macro level, we singled out discursive strategies employed to influence potential customers and determined relationships between directly observable (verbal and non-verbal units) and implicit ideas these units convey. The results reveal that cognitive strategies encode interpretations of cultural experience and forms of social interaction. Despite the importance of the verbal semiotic code, non-verbal means are an essential part of advertising messages that form a multidimensional unity of all the semiotic codes. Visual representational structures serve to communicate such important socio-cultural codes as PART OF OUR WORLD VS OTHERS (INVOVEMENT VS DETACHMENT), SOCIAL DISTANCE, POWER. All this allows us to create an integral image of the thermal resort “Baden-Baden” and intensifies the degree of pragmatic impact on potential customers.

1. Boldyrev N. N. Cognitive Semantics. Tambov, Publishing House of TSU named after G. R. Derzhavin, 2014, 236 p. (in Russ.)

2. Discourse and digital practices: Doing Discourse Analysis in the Digital Age. Ed. by Jones, R. H., Chik A., Hafner C. A. New York, Routledge, 2015, 262 p.

3. Falikman M. V. Human Cognitive Processes, 2014. URL: https://postnauka.ru/video/37973 (accessed 10.10.2022). (in Russ.)

4. Issers O. S. Verbal Manipulation. Moscow, Nauka, 2017, 240 p. (in Russ.)

5. Kibrik A. A., Fedorova O. V. On the Structure of Multichannel Discourse. Images of Language and Zigzags of Discourse: A Collection of Scientific Articles Dedicated to the 70th Anniversary of V. Z. Demyankov. Moscow, 2018, pp. 180–191. (in Russ.)

6. Kress G. Multimodality. A Social Semiotic Approach to Contemporary Communication. London, Routledge, 2010, 212 p.

7. Kress G., Leeuwen T. V. Reading Images: the Grammar of Visual Design. London, Routledge, 2006, 291 p.

8. Kress G., Leeuwen T. V. Multimodal Discourse: The Modes and Media of Contemporary Communication. London, Edward Arnold, 2001, 152 p.

9. Kreydlin G. E. The Semiotic Conceptualization of the Human Body and the Question of Multimodality. Ecology of Language and Communicative Practice, 2014, no. 2, pp. 100–120. (in Russ.)

10. Lotman Yu. M. Brain – Text – Culture – Artificial Intelligence. Selected Articles: in 3 vols. vol. 1: Articles on Semiotics and Typology of Culture. Tallinn, Alexandra, 1992, pp. 25–33. (in Russ.)

11. Lotman Yu. M. Problems in the typology of texts. Abstracts of Reports of the Second Summer School on Secondary Modeling Systems. Tartu, TGU, 1966, pp. 83–91. (in Russ.)

12. Maslova Zh. N. Creative Linguistic Consciousness. Tambov, Publishing House of TSU named after G. R. Derzhavin, 2015, 300 p. (in Russ.)

13. Multimodal Discourse Analysis. Systemic-Functional Perspectives. Ed. by O’Halloran, K. L. London, Continuum, 2004, 252 p.

14. O’Halloran K. L. Matter, meaning and semiotics. Visual Communication, 2023, vol. 22(1), pp. 174– 201.

15. O’Halloran K. L. Multimodal Discourse Analysis. Continuum Companion to Discourse Analysis. Ed. By Hyland K. and Paltridge B. US, Continuum International Publishing Group, 2011, Pp. 120–137.

16. Sapolsky R. Monkeyluv: And Other Essays on Our Lives as Animals. New York, Scribner, 2005, 209 p.

17. Sorokina Yu. V. Notion of Multimodality and Issues of Multimodal Lecture Discourse Analysis. Philological Sciences. Issues of Theory and Practice, 2017, no. 10 (76): in 3 pt, pt. 1, pp. 168– 170. (in Russ.)

18. Tsurikova L. V. Discourse Strategies in Cognitive-Pragmatic Analysis of Communication. Issues of Cognitive Linguistics, 2007, no.4 (13), pp.98–108. (in Russ.)