Multimodal text combines two or more semiotic systems. These systems include linguistic (vocabulary, grammar), visual (color, viewpoint), and can manifest in paper (books, comics), digital (slide presentations, social media, video games), or live forms (ballet, theater).
The five semiotic systems are linguistic (grammar, vocabulary), visual (color, images, viewpoints), audio (volume, pitch, rhythm), gestural (movement, facial expression, body language), and spatial (proximity, layout, organization of objects). Examples like billboards and posters are used to illustrate these concepts.
Multimodal texts can be classified as paper-based (books, comics, flyers), digital (social media, YouTube videos, e-posters), live performances (ballet, theater), or transmedia (storytelling across various platforms, often used in educational settings). The importance of appropriate background music in presentations is also highlighted.
The second part of the video focuses on critically evaluating text and images. The objective is to analyze media messages using a media literacy framework and create effective multimodal advertisements. Examples of problematic public signage and advertisements are presented to encourage critical observation.
Several advertisements are analyzed for their potential to offend. Examples include an anti-smoking ad compared to a terrorist attack, a 'Save the whales, lose the blubber' ad criticized as body-shaming, and an H&M hoodie with a 'coolest monkey in the jungle' slogan deemed racist. These examples emphasize the need for cultural sensitivity.
To be an effective communicator and listener, it's crucial to seek clarification, empathize with others' feelings and beliefs, and be sensitive to verbal and non-verbal cues. This applies to both producers and consumers of multimodal texts, especially in social media interactions.
Ferdinand de Saussure's concepts of signifier (the physical form, e.g., the word 'apple') and signified (the mental concept it represents) are introduced. Denotation (literal dictionary meaning) and connotation (implied or cultural meaning) are also explained, using examples like 'crocodile' and 'hilarious' vs. 'funny' to show how words can carry different meanings.
The video reiterates that if a signifier in an advertisement is culturally offensive or insensitive, it will fail to achieve its goal. Cultural sensitivity involves being aware of and acknowledging the diverse cultural differences of people globally.
The media literacy framework is presented as a guide for evaluating messages. Students are given two activities: creating a multimodal advertisement for a cause-oriented event and analyzing a social media post for cultural sensitivity and potential disadvantages, applying the concepts discussed.