To save content items to your account,
please confirm that you agree to abide by our usage policies.
If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account.
Find out more about saving content to .
To save content items to your Kindle, first ensure no-reply@cambridge.org
is added to your Approved Personal Document E-mail List under your Personal Document Settings
on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part
of your Kindle email address below.
Find out more about saving to your Kindle.
Note you can select to save to either the @free.kindle.com or @kindle.com variations.
‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi.
‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.
This Element in Construction Grammar addresses one of its hottest topics and asks: is the unimodal conception of Construction Grammar as a model of linguistic knowledge at odds with the usage-based thesis and the multimodality of language use? Are constructions verbal, i.e. unimodal form-meaning pairings, or are they, or at least are some of them, multimodal in nature? And, more fundamentally, how do we know? These questions have been debated quite controversially over the past few years. This Element presents the current state of research within the field, paying special attention to the arguments that are put forward in favour and against the uni-/multimodal nature of constructions and the various case studies that have been conducted. Although significant progress has been made over the years, the debate points towards a need for a diversification of the questions asked, the data studied, and the methods used to analyse these data.
Blended, or hybrid, approaches to language learning continue to gain prominence. Resonant with established definitions of CALL, such approaches seek to promote ecological perspectives and embrace the ubiquity of technology. Questions of effectiveness and the justification of resources may result in a greater need for argument-based evaluation. Future research in blended language learning must take into account concepts inherent in multimodality, social semiotics, and computer mediated communication. Rather than revisit blended learning, however, porosity of environments may forge new metaphors of understanding and research.
Opening with an analysis of Instagram, Chapter 2 is concerned with how to think about postdigitality. Touching on multimodality, time-space-place, and responsive loops, this chapter highlights the contrast between digital life and postdigital life, unravelling the many dimensions of postdigitality. It concludes that postdigitality represents a world of symbiosis, whether that be of body and mind, physical life and screen life, representation and non-representation, immersion and connectivity, or interaction and convergence. These combinations are what lends digital media its unique power to move across time, space, and place. To explore these ideas, Chapter 2 analyses data which has been processed through ATLAS.ti to produce a list of postdigital keywords used by crescent voices.
After exploring the multimodal effects of BeReal, and the way in which it foregrounds place and event, this chapter explores the work of Hayles, Barad, and Braidotti, before utilizing New Literacy Studies to explore contrastive socio-cultural and social practices. The chief focus is on teasing out a theory of digital-materiality: not only what materialities and modes are present on screens, but also what inferences, values, and agendas these materialities carry. Postdigital lives entail entirely new relationships with materialities, though this does not mean a break with the physical and embodied, since postdigital life also contains many embodied ways of engaging with screens, ones which work across both the physical and the digital. This chapter attempts to conceptualize the distinct logic that people use to understand screens, while striking at more lived understandings of literacy. Consulting crescent voices on where they find comfort in their screen lives, this chapter reconciles people’s conflicting desires to pursue a flesh-and-blood life away from screens, as well as to use their screens to manifest and actualize the real aspects of their lives.
The emphasis in L2 learning has mainly focused on individual writers and monomodal academic genres (e.g. narration, argumentation), neglecting the potential of collaborative composing and the use of digital genres that introduce additional semiotic sources, for fear of having to deal with “a messy transition to digital multimodal communication” (Lotherington, 2021: 220). Yet, because Web 2.0 technological upgrades have enabled interactivity, literacy has morphed from discretely reading and writing a static page to dynamically reading and writing a multimodal one, which underpins collaborative authorship and (local and global) audience awareness. Considering the inclusion of working collaboratively with multimodal tasks in the L2 classroom, the question of how to help students effectively incorporate multimodal with academic monomodal texts remains unanswered. In response to this challenge, this study examines the design and implementation of an online task to foster multiliteracies. Thirty-seven international students of diverse disciplines (e.g. economics, engineering, history), enrolled in a Spanish as a second language course, worked collaboratively to create multimodal texts based on previously created monomodal texts. Informed by a student questionnaire and a teacher focus group, we analyzed both students’ and teachers’ perceptions to ascertain the effectiveness of the intervention and the possibilities these kinds of tasks bring to the foreign language classroom. Both sets of participants reported positive results concerning linguistic advancement, motivation, and multiliteracies development. Pedagogical recommendations related to the inclusion of this pedagogical practice are provided.
The chapter provides an introduction to the relationship between politics and semiotics, to Cognitive CDA as a framework for studying politics and semiotics, and to shifts in political performance and media landscapes which demand a multimodal approach to political discourse analysis. It starts by highlighting the symbolic nature of politics and the discursive means by which politics is primarily performed. The historical development of Cognitive CDA is described. The practical aims, theoretical commitments and methodological practices of Cognitive CDA are also discussed. The central position of the media in communicating politics is considered alongside the relationship between political and media institutions. Changes brought about by the advent of the internet and digital social media are discussed with a focus on the new genres of political discourse that have emerged as a result and on the more participatory forms of politics that are potentially afforded. The chapter discusses the rise of right-wing populism that has coincided with changes to the media landscape and the shifts in communicative style by which it is marked.
The European Commission against Racism and Intolerance states that hate speech ‘poses grave dangers for the cohesion of a democratic society, the protection of human rights and the rule of law’. In hate speech, human dignity is violated through the use of dehumanising communicative means and through the tendency to rank people in hierarchies, in which some groups are considered more and others less worthy. In this chapter, I shall argue that critical linguistic awareness is a useful tool in combatting hate speech. The theoretical contribution is a linguistically based definition of hate speech, drawing on concepts from speech act theory, social semiotics and multimodality. The aim of this chapter is twofold: to enhance language activists’ and the general public’s understanding of the way hate speech is performed through communicative means and to provide activists with an analytic tool to cultivate critical linguistic awareness about hate speech.
Eric Knight and Matthias Wenzel examine the multimodality of strategizing. Drawing parallels to research in other domains of organization studies, they show that the enactment of strategic practices involves, amongst others, discursive modes (i.e., written or oral texts such as speech acts, emails, documents or newspaper articles), bodily modes (i.e., bodily movements such as gestures, gazes, nodding or pointing) and material modes (i.e., objects and artefacts such as tables, chairs, rooms or tools). As the concept of multimodality signals, these different modes are typically interrelated. That is, one typically finds a constellation of different modes involved in strategy work. The authors review existing strategy as practice research in terms of how they have conceptualized and captured the multimodality of strategy work. They distinguish three different conceptualizations, which they label ‘multimodality as representation’ (treating different modes as reflected in each other), ‘multimodality as co-creation’ (treating different modes as recursively shaping each other) and ‘multimodality as intertwinement’ (treating different modes as amalgamated). They discuss how each view of multimodality allows for different types of insights to be gained on the doing of strategy.
Politics is an inherently symbolic practice. This innovative book advances a framework for the critical analysis of political texts and talk based in cognitive linguistics. Through detailed analyses of attested semiotic practices, it provides a current, comprehensive and authoritative statement on the paradigm of Cognitive Critical Discourse Analysis (Cognitive CDA). The ideological effects of dominant conceptualisations and their implications for the legitimation of social action are explored with reference to political topics that have defined the last decade, including immigration, the rise of nationalism, the right to protest, Brexit and Covid-19. A range of conceptual phenomena are addressed, including image schematic patterning, attentional distribution, viewpoint and metaphor, as they feature in various contexts, genres and modes of political discourse. In a major advancement of the paradigm, the book extends Cognitive CDA to images and gesture to consider the role played by multiple semiotic modes in the discursive performance of politics.
Chapter 1 provides an overview of screen time concerns reported in the media and research, with consideration of relevant learning and interaction theories which indicate that face-to-face social interaction, talk and play are essential for the linguistic and cognitive development of children. This chapter also revisits the fundamental multimodality of face-to-face interaction. The shift from face-to-face to online multimodal interaction therefore requires users to make complex linguistic and interactional adaptations to be able to achieve understanding and affiliation with interlocutors in online contexts, as occurred with the advent of the telephone. This is especially true of the most common form of online interaction, text chat, which is a unique hybrid form of social written interaction, with its own specific affordances and constraints for children’s social and linguistic development. This chapter presents key interactional differences between face-to-face and written online interaction, based on conversational resources available (or unavailable) to users in either setting, including videogame settings. This discussion provides a necessary basis for investigation of children’s written interaction in subsequent chapters.
While the preceding chapters of the Handbook have focused on practical skills in CA research methods, this chapter looks towards the path ahead. A diverse group of conversation analysts were asked to outline possible projects, point readers toward un- or under-described interactional phenomena, and discuss persistent issues in the field. The contributions address future advances in data collection, specific interactional practices, the complex interplay between language and the body, and cross-cultural and crosslinguistic comparisons, among other issues. The chapter concludes with a concise reiteration of the bedrock principle that underpins all CA research methods.
This chapter provides for principles, guidance, and illustrations about the way multimodality is conceptualized and operationalized within Conversation Analysis. It discusses the foundations of CA multimodal studies and shows how multimodal analysis can be conducted, on the basis of several empirical exemplary cases. The introduction of this chapter focuses on the conceptualization and definition of multimodality, and their methodological consequences. The subsequent sections guide readers through empirical analyses of various phenomena that have progressively expanded multimodal analysis, beginning with apparently simple co-speech gestures, and showing how they actually involve the entire body, continuing with the temporality of multiactivity, the spatiality of mobile activities, and the materiality of multisensoriality. These phenomena constitute exemplary areas of study in which the body features in a crucial way, and in which the interplay of linguistic and embodied resources provide for the accountability and intersubjectivity of the ongoing action in interaction.
This chapter deals with the methodological procedures of a CA study by tracking the development of a collection of instances of a multimodal practice and its variants. We describe the development of a study of the use of the German formats darf/kann ich…? (‘may/can I…?’; Deppermann & Gubina, 2021). Requesters use this format to ask if they may/can perform some embodied action while already starting or even fully performing it before the requestee’s confirmation. We first describe the process of sampling candidate cases to create a collection allowing us to identify a certain practice. Second, we describe how we analyzed (i) the time course of embodied action and its relationship to participants’ talk, (ii) the relationship the linguistic turn format, the sequential position and the multimodal context of the turn, and (iii) the relationship between situated action formation, linguistic design, action types, and interactional properties of a practice. Finally, we stress the importance of applying various strategies of comparative analysis and analytic induction to a larger dataset. We also discuss attending to the multimodal formation of social action on the basis of video data and multimodal transcripts is crucial for our understanding and analysis of face-to-face interaction.
Conversation-analytic (CA) research projects have begun to involve the collection of interaction data in laboratory settings, as opposed to field settings, not for the purpose of experimentation, but in order to systematically analyze interactional phenomena that are elusive, not in the sense of being rare (i.e., ‘seldom occurring’), but in the sense of not being reliably or validly detected by analysts in the field using relatively standard recording equipment. This chapter (1) describes two, CA, methodological mandates – ‘maintaining mundane realism’ and ‘capturing the entirety of settings’ features’ – and their tensions; (2) provides four examples of elusive phenomena that expose these tensions, including gaze orientation, blinking, phonetic features during overlapping talk, and inhaling; and (3) discusses analytic ramifications of elusive phenomena, and provides a resultant series of data collection recommendations for both field and lab settings.
Hypertranslation refers to a vast and virtual field of mobile relations comprising the interplay of signs across languages, modes, and media. In hypertranslation, the notions of source/target, directionality, and authenticity are set in perpetual flow and flux, resulting in a many-to-many interactive dynamic. Using illustrations drawn from a wide range of literary and artistic experiments, this Element proposes hypertranslation as a theoretical lens on the heterogeneous, remediational, extrapolative, and networked nature of cultural and knowledge production, particularly in cyberspace. It considers how developments in artificial intelligence have led to an expansion in intersemiotic potentialities and the liquidation of imagined boundaries. Exploring the translational aspects of our altered semiotic ecology, where the production, circulation, consumption, and recycling of memes extend beyond human intellect and creativity, this Element positions hypertranslation as a fundamental condition of contemporary posthuman communication in Web 5.0 and beyond.
This chapter positions digital editions within a broader and longer tradition of textual scholarship, book history, and scholarly editions. In it we consider the spatial, conceptual, and methodological approaches to editorial practice used in print editions and show the ways in which digital scholarly editions both extend and remake existing editorial paradigms and practices. In particular, we consider three elements of digital editions: networked structures, interactive reading, and multimodality. Throughout the chapter we consider both the potential and the ongoing challenges of making and using digital editions.
This Element outlines current issues in the study of speech acts. It starts with a brief outline of four waves of speech act theory, that is, the philosophical, the experimental, the corpus-based and the discursive approaches. It looks at some of the early experimental and corpus-based methods and discusses their more recent developments as a background to the most important trends in current speech act research. Discursive approaches shift the focus from single utterances to interaction and interactional sequences. Multimodal approaches show that the notion of 'speech act' needs to be extended in order to cover the multimodality of communicative acts. And diachronic approaches focus on the historicity of speech acts. The final section discusses some open issues and potential further developments of speech act research.
Movement scientists have proposed to ground the relation between prosody and gesture in ‘vocal-entangled gestures’, defined as biomechanical linkages between upper limb movement and the respiratory–vocal system. Focusing on spoken language negation, this article identifies an acoustic profile with which gesture is plausibly entangled, specifically linking the articulatory behaviour of onset consonant lengthening with forelimb gesture preparation and facial deformation. This phenomenon was discovered in a video corpus of accented negative utterances from English-language televised dialogues. Eight target examples were selected and examined using visualization software to analyse the correspondence of gesture phase structures (preparation, stroke, holds) with the negation word’s acoustic signal (duration, pitch and intensity). The results show that as syllable–onset consonant lengthens (voiced alveolar /n/ = 300 ms on average) with pitch and intensity increasing (e.g. ‘NNNNNNEVER’), the speaker’s humerus is rotating with palm pronating/adducing while his or her face is distorting. Different facial distortions, furthermore, were found to be entangled with different post-onset phonetic profiles (e.g. vowel rounding). These findings illustrate whole-bodily dynamics and multiscalarity as key theoretical proposals within ecological and enactive approaches to language. Bringing multimodal and entangled treatments of utterances into conversation has important implications for gesture studies.
This monograph examines the ways in which Caribbean content creators use elements of Caribbean Englishes and Creoles in their performances of identity in image macro memes and TikTok videos. It also examines the ideologies that underlie these performances. The data comprises memes from Trinidadian Facebook pages, as well as videos by Guyanese, Barbadian, and Trinidadian TikTokers, and was analysed using the multimodal method designed by Kress. For meme makers, identity is understood as a system of distinction between ingroups and outgroups, and language and other semiotic features, notably emojis, are used to distinguish Trinidadians from other nationalities, and groups of Trinidadians from one another. TikTokers establish their Caribbean identity primarily through knowledge of lexis, but this works in concert with other linguistic features to create authentic identities. Social media content is underpinned by the tension between the acceptance and rejection of standard language ideologies.
This study investigated whether speakers use multimodal information (speech and gesture) to differentiate the physical and emotional meanings of the polysemous verb touch. We analyzed 302 hand gestures that co-occurred with this perception verb. For each case, we annotated (1) the meaning of touch (physical vs. emotional), (2) the gesture referent speakers physically touched (other-touch vs. self-touch), (3) the personal pronoun following the verb and (4) if they used intensifiers and negation. There were three main findings. First, we have seen that when speakers express the physical meaning, they are likely to reach an external referent (other-touch), but when they imply the emotional meaning, they tend to touch their own body (self-touch). Second, the most frequent co-speech gesture (chest-touching gesture) was associated with the emotional meaning, uncovering the metaphor the heart is container for emotions. Third, this study showed that the physical meaning of touch usually coexists with a wide variety of personal pronouns and negation words; in contrast, the emotional meaning of touch occurs primarily with the pronoun me and it is usually modified by intensifiers. Thus, speakers use both speech and gesture to differentiate the meanings of the polysemous verb touch.