The chapter provides an introduction to the relationship between politics and semiotics, to Cognitive CDA as a framework for studying politics and semiotics, and to shifts in political performance and media landscapes which demand a multimodal approach to political discourse analysis. It starts by highlighting the symbolic nature of politics and the discursive means by which politics is primarily performed. The historical development of Cognitive CDA is described. The practical aims, theoretical commitments and methodological practices of Cognitive CDA are also discussed. The central position of the media in communicating politics is considered alongside the relationship between political and media institutions. Changes brought about by the advent of the internet and digital social media are discussed with a focus on the new genres of political discourse that have emerged as a result and on the more participatory forms of politics that are potentially afforded. The chapter discusses the rise of right-wing populism that has coincided with changes to the media landscape and the shifts in communicative style by which it is marked.

Chapter 1 provides an overview of screen time concerns reported in the media and research, with consideration of relevant learning and interaction theories which indicate that face-to-face social interaction, talk and play are essential for the linguistic and cognitive development of children. This chapter also revisits the fundamental multimodality of face-to-face interaction. The shift from face-to-face to online multimodal interaction therefore requires users to make complex linguistic and interactional adaptations to be able to achieve understanding and affiliation with interlocutors in online contexts, as occurred with the advent of the telephone. This is especially true of the most common form of online interaction, text chat, which is a unique hybrid form of social written interaction, with its own specific affordances and constraints for children’s social and linguistic development. This chapter presents key interactional differences between face-to-face and written online interaction, based on conversational resources available (or unavailable) to users in either setting, including videogame settings. This discussion provides a necessary basis for investigation of children’s written interaction in subsequent chapters.

While the preceding chapters of the Handbook have focused on practical skills in CA research methods, this chapter looks towards the path ahead. A diverse group of conversation analysts were asked to outline possible projects, point readers toward un- or under-described interactional phenomena, and discuss persistent issues in the field. The contributions address future advances in data collection, specific interactional practices, the complex interplay between language and the body, and cross-cultural and crosslinguistic comparisons, among other issues. The chapter concludes with a concise reiteration of the bedrock principle that underpins all CA research methods.

This chapter provides for principles, guidance, and illustrations about the way multimodality is conceptualized and operationalized within Conversation Analysis. It discusses the foundations of CA multimodal studies and shows how multimodal analysis can be conducted, on the basis of several empirical exemplary cases. The introduction of this chapter focuses on the conceptualization and definition of multimodality, and their methodological consequences. The subsequent sections guide readers through empirical analyses of various phenomena that have progressively expanded multimodal analysis, beginning with apparently simple co-speech gestures, and showing how they actually involve the entire body, continuing with the temporality of multiactivity, the spatiality of mobile activities, and the materiality of multisensoriality. These phenomena constitute exemplary areas of study in which the body features in a crucial way, and in which the interplay of linguistic and embodied resources provide for the accountability and intersubjectivity of the ongoing action in interaction.

This chapter deals with the methodological procedures of a CA study by tracking the development of a collection of instances of a multimodal practice and its variants. We describe the development of a study of the use of the German formats darf/kann ich…? (‘may/can I…?’; Deppermann & Gubina, 2021). Requesters use this format to ask if they may/can perform some embodied action while already starting or even fully performing it before the requestee’s confirmation. We first describe the process of sampling candidate cases to create a collection allowing us to identify a certain practice. Second, we describe how we analyzed (i) the time course of embodied action and its relationship to participants’ talk, (ii) the relationship the linguistic turn format, the sequential position and the multimodal context of the turn, and (iii) the relationship between situated action formation, linguistic design, action types, and interactional properties of a practice. Finally, we stress the importance of applying various strategies of comparative analysis and analytic induction to a larger dataset. We also discuss attending to the multimodal formation of social action on the basis of video data and multimodal transcripts is crucial for our understanding and analysis of face-to-face interaction.

Conversation-analytic (CA) research projects have begun to involve the collection of interaction data in laboratory settings, as opposed to field settings, not for the purpose of experimentation, but in order to systematically analyze interactional phenomena that are elusive, not in the sense of being rare (i.e., ‘seldom occurring’), but in the sense of not being reliably or validly detected by analysts in the field using relatively standard recording equipment. This chapter (1) describes two, CA, methodological mandates – ‘maintaining mundane realism’ and ‘capturing the entirety of settings’ features’ – and their tensions; (2) provides four examples of elusive phenomena that expose these tensions, including gaze orientation, blinking, phonetic features during overlapping talk, and inhaling; and (3) discusses analytic ramifications of elusive phenomena, and provides a resultant series of data collection recommendations for both field and lab settings.

This chapter positions digital editions within a broader and longer tradition of textual scholarship, book history, and scholarly editions. In it we consider the spatial, conceptual, and methodological approaches to editorial practice used in print editions and show the ways in which digital scholarly editions both extend and remake existing editorial paradigms and practices. In particular, we consider three elements of digital editions: networked structures, interactive reading, and multimodality. Throughout the chapter we consider both the potential and the ongoing challenges of making and using digital editions.

This chapter gives an overview of the relation between indexicality, deixis, and space in gesture from a semiotic and a linguistic point of view. Directive pointing gestures are not the only type of cospeech gestures that contributes to deixis. Iconic gestures that form part of the multimodal utterance may instantiate the targets to be pointed at and function as the deictic object of the deictic relation. In turn they may be interpreted as signs that stand for something else. A Peircean approach combined with a Bühlerian one, as suggested in this chapter, not only allows for a tertium comparationis with respect to the modality of the deictic and indexical signs under investigation. It also provides us with tools for representing semiotic processes like complex sign concatenation (e.g. deixis at signs vs. deixis at non-signs; deixis at metonymies or metaphors) as well as the collaborative creation of deictic space (sphere-like, map-like, screen-like; separated or shared) in multimodal interaction. The proposed schema of four semiotic subfields of space substantiates the view that space has to be thought of as a dynamic process of semiosis, not as a static entity.

This chapter presents the role and use of gesture in first language development and its integration in the child’s multimodal communicative system. It includes an overview of theories and methods that have triggered and facilitated the study of gestures in language development. The main issues are illustrated with detailed analyses of examples extracted from longitudinal data in English and French. The human communication system develops in a space of shared meanings in which adults socialize children into language in situated activities; consequently, this overview highlights the crucial role of caregivers in child–adult interactions. We first focus on the role of gestures in adults’ communicative input and then follow children’s development into the use of the adults’ multimodal communicative system. At the end of the developmental process, speech becomes clearly predominant but is both complemented and supplemented by other semiotic resources according to variables such as linguistic context, situation, interlocutor, activity, or discourse genre. Children learn to master the dynamic multimodal communicative system used around them and with them in their daily interactions.

As there are many different methods of linguistic analysis, there are many different ways of approaching gesture analysis. This chapter gives a selective overview of the current state of art on gesture coding and annotation systems. It opens with a discussion on the difference between coding and annotation, before it considers aims and challenges in gesture coding and annotation. Afterward, the chapter reviews existing systems and reflects on the interrelation between subject, research question, coding and annotation system. The chapter emphasizes that coding and annotations systems are always influenced by the particular theoretical framework in which they are situated. Accordingly, similar to the analysis of language, a theory-neutral analysis of gestures is not possible. Rather, theoretical assumptions influence subjects, aspects and levels of analysis and as such also make themselves visible in annotation systems. This will be illustrated by exemplary research topics in gestures studies: language, language development, cognition, interaction, and human–machine interaction. The account of the individual systems thereby does not aim at an extensive discussion, but rather focuses on their general logic for answering their particular research question. Here, differences between systems addressing the same research topic (e.g. language) as well as differences across research topics (e.g. language vs. interaction) will be explored. The chapter closes with some considerations on possible future developments.

Social media is resplendent with a creative blend of non-standardised graphical resources such as images, memes, digital stickers, avatars and GIFs that extend beyond the rigid parameters of Unicode emoji character encoding. This chapter explores how emoji interact with other kinds of visual resources beyond language in social media posts such as graphicons. The chapter aims to give the reader a sense of how a social semiotic intermodal approach furnishes a flexible toolkit for an analyst to explore emoji’s relations with other modes. It primarily analyses the meanings made through combinations of emoji, language and GIFs in tweets. The analysis reveals how graphicons such as GIFs and digital stickers often realise a salient ‘New’ of the posts wherein they occur, and thus foreground interpersonal meaning.

Conversation Analysis (CA) is a major contributing discipline to the study of language use and social action in context. Originating in the discipline of sociology, it forms the basis for the burgeoning field of interactional linguistics. This chapter offers an overview of major themes in the field. Beginning with a brief discussion of the intellectual background of the field, the chapter sketches three distinctive levels of analysis: sequential organization, practices of turn construction, and the organization of these practices as sets of resources for dealing with recurrent problems in the social organization of interaction. Sections of the chapter deal with sequence organization, preference, turn design, the fitting of talk to specific contexts and recipients (recipient design), progressivity, multimodality, and interaction in the context of specific social institutions such as medicine, legal discourse, and news conferences.

This chapter presents a view on context as understood within functional models of language, specifically the theoretical framework of Systemic Functional Linguistics (SFL). Amongst the functional approaches to language, SFL is recognized as a framework which has maintained an account of context that has prioritized its relationship with lexicogrammar, allowing it to make a causal connection between culture and language. The aim of this chapter is to highlight and explain the principal ways in which context works within the SFL framework and explore the main themes and parameters which situate context within an integrated theory of language as a semiotic resource. As no theory emerges in a vacuum, the first part of the chapter will consider the historical development of context as a concept within SFL theory with reference to how context is situated in other related functional grammars. Following this, we examine two areas of challenge related to the approach to context outlined in the chapter. Finally, the chapter concludes with closing remarks and key directions for future research in this area.