Abstract
This chapter discusses the limited research in multimodal creativity, which subsequently hinders the effectiveness of existing pedagogies in digital literacy, multimodal literacy, and creativity literacy, particularly in the aspect of transfer. Using the Analytical Framework for Creativity in Multimodal Texts (AFCMT), this study demonstrates how the transfer of learning can be facilitated through a digital creativity multimodal analysis (DCMA) of several viral social media posts from Hong Kong, placing emphasis on instructional design, content relevance and transfer specificity. Key components of AFCMT, namely the IEEE matrix and the Cline of Creativity Complexity (CCC), are discussed in terms of their flexibility and potential incorporative power with theories, hypotheses, or frameworks of other research approaches from various disciplines.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
100億負能量戰士. (2018, January 4). 「生意好的時候必然預計下年環球經濟會轉 [Status update; Image attached]. Facebook. https://www.facebook.com/negativepowerfighter/photos/a.1518278508246493/1751530668254608/
Anderson, H. H. (1959). Creativity and its cultivation.
Apple Daily. (2016a, 12 13). 葡萄X淑儀寸財:爺辭職唔係咁簡單要有諮詢. Retrieved from 特首選戰 2017—【特首選戰】: https://ce2017.appledaily.com.hk/articles/1_56042609
Apple Daily. (2016b, October 30). 葡萄X淑儀 德國佬都抽水添. Retrieved from 蘋果日報: https://hk.apple.nextmedia.com/news/art/20161030/19817115
Baldry, A., & Thibault, P. J. (2006). Multimodal transcription and text analysis: A multimedia toolkit and coursebook. London: Equinox.
Baldry, A., & Thibault, P. J. (2008). Applications of multimodal concordances. Hermes—Journal of Language and Communication Studies, 11–41.
Baldwin, T., & Ford, J. K. (1988). Transfer of training: A review and directions for future research. Personnel Psychology, 41, 63–105.
Bateman, J. A. (2007). Towards a grande paradigmatique of film: Christian Metz reloaded. Semiotica, 167(1–4), 13–64.
Bateman, J. A. (2008). Multimodality and genre: A foundation for the systematic analysis of multimodal documents. Hampshire: Palgrave Macmillan.
Bateman, J. A. (2013). Hallidayan systemic-functional semiotics and the analysis of the moving audiovisual image. Text & Talk, 33(4–5), 641–663.
Bateman, J. A., & Schmidt, K.-H. (2012). Multimodal film analysis: How films mean. London & New York: Routledge.
Bednarek, M., & Caple, H. (2012). News discourse. London & New York: Continuum.
Blair, G. M. (1949). The content of educational psychology. Journal of Educational Psychology, 40(5), 267–274.
Bock, Z. (2016). Multimodality, creativity and children’s meaning-making: Drawings, writings, imaginings. Stellenbosch Papers in Linguistics Plus, 49, 1–21. https://doi.org/10.5842/49-0-669
Boden, M. A. (1994). What is creativity? In M. A. Boden (Ed.), Dimensions of creativity (pp. 75–117). Cambridge, Massachusetts: MIT Press.
Boden, M. A. (1998). Creativity and artificial intelligence. Artificial Intelligence, 103, 347–356.
Boden, M. A. (2004). The creative mind: Myths and mechanisms (2nd ed.). London: Routledge.
Boden, M. A. (2009). Computer models of creativity. AI Magazine, 30(3), 23–34.
Caple, H. (2013). Photojournalism: A social semiotic approach. Hampshire & New York: Palgrave Macmillan.
Carter, R. (2004). Language and creativity: The art of common talk. London: Routledge.
Census and Statistics Department. (2017, February 27). Proportion of population aged 5 and over able to speak selected languages/dialects by year. Retrieved March 15, 2017, from 2016 Population By-census: https://www.bycensus2016.gov.hk/en/bc-mt.html
cheksiuting. (2016, October 27). [原創][改詞] 葡萄*淑儀. Retrieved from 香港膠登 HKGalden: https://hkgalden.com/view/384946
Cheng, K. (2018a, September 17). Community groups urge Chief Exec. Carrie Lam to order day off for Super Typhoon Mangkhut clean-up. Retrieved from Hong Kong Free Press HKFP: https://www.hongkongfp.com/2018/09/17/community-groups-urge-chief-exec-carrie-lam-order-day-off-super-typhoon-mangkhut-clean/
Cheng, K. (2018b, September 17). Chief Executive urges employers to be considerate as damage from Typhoon Mangkhut causes delays. Retrieved from Hong Kong Free Press HKFP: https://www.hongkongfp.com/2018/09/17/chief-executive-urges-employers-considerate-damage-typhoon-mangkhut-causes-delays/
Cheng, K. (2018c, September 18). In pictures: Hongkongers’ post-typhoon commutes spawn memes and Photoshop wizardry. Retrieved from Hong Kong Free Press HKFP: https://www.hongkongfp.com/2018/09/18/pictures-hongkongers-post-typhoon-commutes-spawn-memes-photoshop-wizardry/
Chow, V., & Cheung, A. (2016). [膠登音樂台] 《葡萄乘淑儀》(原曲:《葡萄成熟時》, 陳奕迅) [Recorded by 小. 妁]. Hong Kong, Hong Kong: T. Shek. Retrieved March 17, 2017, from https://www.youtube.com/watch?v=m5GCpHBljCI
Christie, F. (2005). Language education in the primary years. Sydney: University of New South Wales Press.
Christie, F., & Martin, J. (Eds.). (2007). Language, knowledge and pedagogy: Functional linguistic and sociological perspectives. London and New York: Continuum.
Clark, R. E., & Voogel, A. (1985). Transfer of training principles for instructional design. Education Communication and Technology Journal, 33, 113–123.
Coconuts Hong Kong. (2016, December 15). R.IP: Netizens Photoshop Regina Ip’s Chief Executive campaign poster to spell out ‘death’ for Hong Kong. Retrieved from Coconuts Hong Kong: https://coconuts.co/hongkong/news/rip-chief-executive-hopeful-regina-ip-mocked-online-campaign-poster-gaffe/
Coffin, C. (2013, August). Using systemic functional linguistics to explore digital technologies in educational contexts. In: S. Sarangi (Ed.), Text & Talk, 33(4–5), 497–522.
Csikszentmihalyi, M. (1988). Society, culture, and person: A systems view of creativity. In R. Sternberg (Ed.), The nature of creativity. Cambridge, UK: Cambridge University Press.
Csikszentmihalyi, M. (1997). Creativity: Flow and the psychology of discovery and invention. New York: Harper Collins.
Csikszentmihalyi, M. (1999). Implications of a systems perspective for the study of creativity. In R. J. Sternberg (Ed.), Handbook of creativity (pp. 313–335). Cambridge, UK: Cambridge University Press.
Djonov, E., & Zhao, S. (Eds.). (2014). Critical multimodal studies of popular culture. New York: Routledge.
Drevdahl, J. E. (1956). Factors of importance for creativity. Journal of Clinical Psychology, 12(1), 21–26.
Drevdahl, J. E., & Cattell, R. B. (1958). Journal of Clinical Psychology. Personality and creativity in artists and writers.
ET Net. (2017, February 17). 《立會透視鏡–馬天娜》西環為林鄭組織「突擊隊」. Retrieved from 經濟通 ET Net: https://www.etnet.com.hk/www/tc/news/categorized_news_detail.php?category=latest&newsid=ETN270217903
German Consulate General Hong Kong. (2016, October 29). Word of the week: Saucer. Retrieved from German Consulate General Hong Kong Facebook: https://www.facebook.com/GermanConsulateGeneralHongKong/photos/a.527198957480227.1073741830.500121550187968/583340511866071/?type=3&theater
Goldstein, I. L. (1986). Training in organizations: Needs assessment, development, and evaluation. Pacific Grove, CA: Brooks/Cole.
GovHK. (2008, March 17). Chapter I : General principles. Retrieved March 15, 2017, from Basic Law Full Text: https://www.basiclaw.gov.hk/en/basiclawtext/chapter_1.html
GovHK. (2017, March 15). Homepage (Residents). Retrieved March 15, 2017, from GovHK 香港政府一站通: https://www.basiclaw.gov.hk/tc/basiclawtext/
Guo, S. N., & Feng, D. Z. (2015). Infusing multiliteracies into English language curriculum: The visual construction of knowledge in English textbooks from an ontogenetic perspective. Linguistics and Education, 31, 115–129.
Halliday, M. (1967). Notes on transitivity and theme in English: Part 2. Journal of Linguistics, 3(2), 199–244.
Halliday, M. (1978). Language as social semiotic. London: Edward Arnold.
Halliday, M. (1985). An introduction to functional grammar. London: Edward Arnold.
Halliday, M., & Matthiessen, C. M. (2014 [1985]). Halliday's introduction to functional grammar (4th edn.) London, New York: Routledge.
Haskell, R. (2001). Transfer of learning: Cognition, instruction, and reasoning (Educational psychology). San Diego: Academic Press.
Heberle, V. M., & Abreu, B. B. (2012). Investigating multimodality: An analysis of students’ diary journals. Linguagem Em Foco, 1, 77–96.
Hong Kong Observatory. (2018). Super Typhoon Mangkhut (1822): 7 to 17 September 2018. Retrieved from Hong Kong Observatory: https://www.weather.gov.hk/informtc/mangkhut18/report.htm
Hyland, K., & Paltridge, B. (Eds.). (2011). Bloomsbury companion to discourse analysis. London & New York: Continuum.
James, M. A. (2014). Learning transfer in English-for-academic-purposes contexts: A systematic review of research. Journal of English for Academic Purposes, 14, 1–13.
Jarvis, C. [chasejarvis]. (2018, September 17). Reminder—you can’t stand out and fit in at the same time [Tweet; Image attached]. Twitter. https://twitter.com/chasejarvis/status/1041500744980082688
Jewitt, C. (Ed.). (2009). The Routledge handbook of multimodal analysis. London: Routledge.
Ji, X., & Shen, H. (2013). The research of “crossover” marketing strategy. In E. Qi, J. Shen, & R. Dou (Ed.), The 19th International Conference on Industrial Engineering and Engineering Management, pp. 1363–1370. Berlin, Heidelberg: Springer. Retrieved from https://link.springer.com/chapter/10.1007/978-3-642-38442-4_143
Johnson, R. E. (1948). Fine arts as a means of personality integration. The School Review, 223–228.
Keefer, D. (1996). Review of Michael O'Toole’s the language of displayed art. Retrieved November 24, 2014, from Rhode Island School of Design: https://faculty.risd.edu/dkeefer/ldarev.htm
Kemlo, J. (2008). Different voices? Film and text or film as text: Considering the process of film adaptation from the perspective of discourse. MHRA Working Papers in the Humanities, 3, 13–24.
Knox, J. S. (2009, August 21). Multimodal discourse on online newspaper home pages: A social-semiotic perspective. Retrieved May 8, 2013, from The Sydney eScholarship Repository: https://ses.library.usyd.edu.au/handle/2123/7696
Kontoghiorghes, C. (2002). Predicting motivation to learn and motivation to transfer learning back to the job in a service organization: A new systemic model for training effectiveness. Performance Improvement Quarterly, 15(3), 114–129.
Kress, G. (2009). What is mode? In C. Jewitt (Ed.), The Routledge handbook of multimodal approach (pp. 54–66). London: Routledge.
Kress, G., & van Leeuwen, T. (1998). Front pages. The critical analysis of newspaper layout. In A. Bell, & P. Garrett (Eds.), Approaches to media discourse (pp. 186–219). Oxford: Wiley Blackwell.
Kress, G., & van Leeuwen, T. (1996 [2006]). Reading images: The grammar of visual design . (2nd edn.) London and New York: Routledge.
Law, L. (2018). House M.D. and creativity: A corpus linguistic systemic functional discourse analysis approach. Ph.D. Thesis, The Hong Kong Polytechnic University. PolyU Electronic Theses. https://theses.lib.polyu.edu.hk/handle/200/9777
Law, L. (2020). Creativity and multimodality: An analytical framework for creativity in multimodal texts (AFCMT). Linguistics and Human Sciences, 14(1–2), 36–69. https://doi.org/10.1558/lhs.33598
Law, L. (2020). Enhancing digital literacy through the understanding of multimodal creativity in social media: a case study of Elon Musk's social-influencer discourse in his Twitter posts. Journal of Global Literacies, Technologies, and Emerging Pedagogies.
Law, L. & Fong, N. (2020). Applying partial least squares structural equation modeling (PLS-SEM) in an investigation of undergraduate students’ learning transfer of academic English. Journal of English for Academic Purposes.
Lim, D. H. (2000). Training design factors influencing transfer of training to the workplace within an international context. Journal of Vocational Education and Training, 52(2), 243–257.
Lim, D. H., & Morris, M. L. (2006). Influence of trainee characteristics, instructional satisfaction, and organizational climate on perceived learning and training transfer. Human Resource Development Quarterly, 17(1), 85–115. https://doi.org/10.1002/hrdq.1162
Marchetti, L., & Cullen, P. (2016). A multimodal approach in the classroom for creative learning and teaching. CASALC Review 2/2016-2017, 2, 39–51.
Martin, J., & White, P. R. (2005). The language of evaluation: Appraisal in English. Hampshire & New York: Palgrave Macmillian.
Martinec, R. (1998). Cohesion in action. Semiotica, 120(1–2), 168–180.
Martinec, R. (2000). Types of processes in action. Semiotica, 130(3–4), 243–268.
Martinec, R. (2001). Interpersonal resources in action. Semiotica, 135(1–4), 117–145.
Meer, B., & Stein, M. I. (1955). Measures of intelligence and creativity. The Journal of Psychology, 39(1), 117–126.
OFCA. (2019, March 12). Key communications statistics. Retrieved March 17, 2017, from Office of the Communications Authority: https://www.ofca.gov.hk/en/media_focus/data_statistics/key_stat/
O’Halloran, K. L. (2007). Multimodal analysis and digital technology. In A. Baldry, & E. Montagna (Eds.), Interdisciplinary perspectives on multimodality: Theory and practice. Campobasso: Palladino.
O’Halloran, K. L. (2008). Systemic functional-multimodal discourse analysis (SF-MDA): Constructing ideational meaning using language and visual imagery. Visual Communication, 7(4), 443–475.
O’Halloran, K. L. (2011). Multimodal discourse analysis. In K. Hyland & B. Paltridge (Eds.), Companion to discourse. London and New York: Continuum.
O’Halloran, K. L., & Smith, B. (Eds.). (2011). Multimodal studies: Exploring issues and domains. New York: Routledge.
O'Halloran, K. L., Tan, S., Smith, B., & Podlasov, A. (2010). Challenges in designing digital interfaces for the study of multimodal phenomena. Information Design Journal.
O’Toole, M. (1994). The language of displayed art. Cranbury: Associated University Presses.
Pang, A. K. (2004). Making history in From Colony to Nation: A multimodal analysis of a museum exhibition in Singapore. In K. L. O’Halloran (Ed.), Multimodal discourse analysis: Systemic functional perspectives (pp. 28–54). London & New York: Continuum.
Park, Y. H., Lim, D. H., & Chang, J. H. (2017). Trainee versus supervisor assessment of training transfer: Mediational analysis of transfer variables. Asia Pacific Journal of Human Resources, 55, 192–212. https://doi.org/10.1111/1744-7941.12116
Perkins, D. N., & Salomon, G. (1994). Contribution to the international encyclopedia of education (2nd ed.). Retrieved December 3, 2018, from https://web.archive.org/web/20070208182842/http:/learnweb.harvard.edu/alps/thinking/docs/traencyn.htm
Pope, R. (2005). Creativity: Theory, history, practice. London: Routledge.
Prensky, M. (2001). Digital natives, Digital immigrants, part 1. On the Horizon, 9(5), 1–6. https://doi.org/10.1108/10748120110424816
Rainsun, L. (2015, July 24). 再來一次,何足掛齒/林雨陽. Retrieved from 謎米音樂: https://news.memehk.com/posts/9004
Rogers, C. R. (1954). Toward a theory of creativity. ETC, 11, 249–260.
Rothemund, S. (Dir.). (1977). The fruit is ripe (Griechische feigen) [Motion Picture].
Royce, T. (2007a). Intersemiotic complementarity: A framework for multimodal discourse analysis. In T. Royce & W. L. Bowcher (Eds.), New directions in the analysis of multimodal discourse (pp. 63–109). New Jersey and London: Lawrence Erlbaum Associates.
Royce, T. (2007b). Multimodal communicative competence in second language contexts. In T. Royce & W. L. Bowcher (Eds.), New directions in the analysis of multimodal discourse (pp. 361–403). New Jersey and London: Lawrence Erlbaum Associates.
Royce, T., & Bowcher, W. (2007). New direction in the analysis of multimodal discourse. Mahwah, New Jersey: Lawrence Erlbaum Associates.
Runco, M. A., Nemiro, J., & Walberg, H. J. (1998). Personal explicit theories of creativity. Journal of Creative Behavior, 32(1), 1–17.
Salomon, G., & Perkins, D. N. (1989). Rocky roads to transfer: Rethinking mechanisms of a neglected phenomenon. Educational Psychologist, 24(2), 113–142.
The Standard. (2018, September 18). Laughing in the face of the big blow. Retrieved from The Standard: https://www.thestandard.com.hk/section-news.php?id=200291
Thurlow, C., & Mroczek, K. R. (Eds.). (2011). Multimodal creativity and identities of expertise in the digital ecology of a World of Warcraft guild. New York: Oxford University Press.
Unsworth, L. (2008). Multimodal semiotics: Functional analysis in contexts of education. London & New York: Continuum.
Unsworth, L. (2013). Re-configuring image-language relations and interpretive possibilities in picture books as animated movies: A site for developing multimodal literacy pedagogy. In V. V. Heberle (Ed.), Ilha do Desterro: A Journal of English Language, Literature in English and Cultural Studies, 15–48.
van Leeuwen, T. (1999). Speech, music, sound. London: Macmillan.
Veloso, F. O., & Bateman, J. A. (2013). The multimodal construction of acceptability: Marvel’s Civil War comic books and the PATRIOT Act. Critical Discourse Studies, 10(4), 1–19.
Ventola, E., Charles, C., & Kaltenbacher, M. (2004). Introduction. In E. Ventola, C. Charles, & M. Kaltenbacher (Eds.), Perspectives on multimodality (pp. 1–6). Amsterdam/Philadelphia: John Benjamins Publishing Company.
Vo, T. A., & Carter, R. (2010). What can a corpus tell us about creativity? In A. O’Keeffe & M. McCarthy (Eds.), The Routledge handbook of corpus linguistics (pp. 302–315). Abingdon: Routledge.
Zhao, S. (2012, May 28). Learning through multimedia interaction: The construal of primary social science knowledge in web-based digital learning materials. Retrieved December 1, 2014, from The Sydney eScholarship Repository: Learning Through Multimedia Interaction: The Construal of Primary Social Science Knowledge in Web-based Digital Learning Materials: https://ses.library.usyd.edu.au/handle/2123/8376
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Law, L. (2020). Creativity and Education: Facilitating Transfer of Learning Through Digital Creativity Multimodal Analysis (DCMA) of Social Media Posts. In: Lam, S.Sk. (eds) New Media Spectacles and Multimodal Creativity in a Globalised Asia . Digital Culture and Humanities, vol 3. Springer, Singapore. https://doi.org/10.1007/978-981-15-7341-5_5
Download citation
DOI: https://doi.org/10.1007/978-981-15-7341-5_5
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-15-7340-8
Online ISBN: 978-981-15-7341-5
eBook Packages: Literature, Cultural and Media StudiesLiterature, Cultural and Media Studies (R0)