“声”入人心:声音的营销效应、机制与自动提取技术

“Sound” Touches Hearts: The Marketing Effect, Mechanism, and Automatic Extraction Technique of Audio

冉雅璇,董林康,黄雨婷,向力子

2024 第 46 卷 第 11 期 页码 85-102

DOI: 10.16538/j.cnki.fem.20240815.301

PDF全文下载 HTML全文

摘要

“未见其人,先闻其声”——声音作为一种重要的沟通工具,在营销中无处不在。相比其他营销沟通工具(如文字、图片、气味等),声音具有渠道广、影响隐性且深入、营销目的不易察觉等优势,引起学界和业界的关注。理解营销中声音有何具体作用及其理论机制,是有效利用声音的关键前提,是推动声音研究的重要议题。文章系统地介绍了声音研究的发展脉络,并揭示了声音研究三大主题(包括感官营销、多模态和人工智能)的关键词。声音会使个体产生一系列情绪和认知反应,促进购买和服从行为,达成营销效果。神经机制、注意控制理论、预测加工理论和联想心理学四个解释机制是认识声音营销效应的关键视角。文章归纳和对比了声音的分析方法,梳理了其自动化提取和分析流程。最后,文章提出了四大未来议题,包括人工智能声音、中国本土声音、AIGC多模态声音研究和自动提取技术的开发。

As an important communication tool, audio is ubiquitous in marketing. Compared with other marketing communication tools (such as text, picture, smell, etc.), audio has the advantages of wide channels, implicit and deep influence, and unobservable marketing purposes, which has attracted the attention of academia and practice. Understanding the specific role and theoretical mechanism of audio in marketing is the key premise for the effective use of audio, and an important issue to promote audio research. This paper systematically introduces the development of audio research and reveals the keywords of three major themes of audio research, including sensory marketing, multimodal, and AI. Audio can lead to a series of emotional and cognitive responses, and then promote individual purchase and prosocial behaviors to achieve the marketing effect or marketing performance. Neural mechanism, attentional control theory, prediction processing theory, and associative psychology are the key perspectives to understand the marketing effect of audio. This paper summarizes and compares the analysis methods of audio, and sorts out the technical process of automatic extraction and calculation. Finally, this paper puts forward four future topics, including the research on AI audio, Chinese native sound, and AIGC multimodal sound, and the development of automatic extraction technique.

参考文献

2 刘德文, 高维和, 闵凉宇. 声音特征和文本策略的说服效应研究[J]. 管理学报, 2022, 19(9): 1373-1381,1408. DOI:10.3969/j.issn.1672-884x.2022.09.013
3 刘扬, 张苗辉, 郑逢斌. 听觉选择性注意的认知神经机制与显著性计算模型[J]. 计算机科学, 2013, 40(6): 283-287. DOI:10.3969/j.issn.1002-137X.2013.06.063
5 徐震南, 陈可, 郭晓凌, 等. “声”临其境: 营销沟通中的方言积极效应[J/OL]. 南开管理评论, http://kns.cnki.net/kcms/detail/12.1288.f.20230216.1751.014.html, 2023-02-21.
8 Ahlbom C P, Roggeveen A L, Grewal D, et al. Understanding how music influences shopping on weekdays and weekends[J]. Journal of Marketing Research, 2023, 60(5): 987-1007. DOI:10.1177/00222437221150930
9 Al-Qershi O M, Kwon J, Zhao S N, et al. Predicting crowdfunding success with visuals and speech in video ads and text ads[J]. European Journal of Marketing, 2022, 56(6): 1610-1649. DOI:10.1108/EJM-01-2020-0029
10 Anikin A. The link between auditory salience and emotion intensity[J]. Cognition and Emotion, 2020, 34(6): 1246-1259. DOI:10.1080/02699931.2020.1736992
11 Ashraf M, Abid F, Din I U, et al. A hybrid CNN and RNN variant model for music classification[J]. Applied Sciences, 2023, 13(3): 1476. DOI:10.3390/app13031476
12 Baddeley A, Eysenck M W, Anderson M C. Memory[M]. New York: Psychology Press, 2009.
13 Belin P, Bestelmeyer P E G, Latinus M, et al. Understanding voice perception[J]. British Journal of Psychology, 2011, 102(4): 711-725. DOI:10.1111/j.2044-8295.2011.02041.x
14 Bhatia R, Garg R, Chhikara R, et al. Sensory marketing—A review and research agenda[J]. Academy of Marketing Studies Journal, 2021, 25(4): 1528-1558.
15 Bigand E, Vieillard S, Madurell F, et al. Multidimensional scaling of emotional responses to music: The effect of musical expertise and of the duration of the excerpts[J]. Cognition and Emotion, 2005, 19(8): 1113-1139. DOI:10.1080/02699930500204250
16 Biswas D, Lund K, Szocs C. Sounds like a healthy retail atmospheric strategy: Effects of ambient music and background noise on food sales[J]. Journal of the Academy of Marketing Science, 2019, 47(1): 37-55. DOI:10.1007/s11747-018-0583-8
17 Black J W. Relationships among fundamental frequency, vocal sound pressure, and rate of speaking[J]. Language and Speech, 1961, 4(4): 196-199. DOI:10.1177/002383096100400402
18 Chang H H, Mukherjee A, Chattopadhyay A. More voices persuade: The attentional benefits of voice numerosity[J]. Journal of Marketing Research, 2023, 60(4): 687-706. DOI:10.1177/00222437221134115
19 Chattopadhyay A, Dahl D W, Ritchie R J B, et al. Hearing voices: The impact of announcer speech characteristics on consumer response to broadcast advertising[J]. Journal of Consumer Psychology, 2003, 13(3): 198-204. DOI:10.1207/S15327663JCP1303_02
20 Choi K, Fazekas G, Sandler M, et al. Convolutional recurrent neural networks for music classification[A]. Proceedings of 2017 IEEE international conference on acoustics, speech and signal processing[C]. New Orleans: IEEE, 2017.
21 Clark A. Whatever next? Predictive brains, situated agents, and the future of cognitive science[J]. Behavioral and Brain Sciences, 2013, 36(3): 181-204. DOI:10.1017/S0140525X12000477
22 de Benito-Gorron D, Lozano-Diez A, Toledano D T, et al. Exploring convolutional, recurrent, and hybrid deep neural networks for speech and music detection in a large audio dataset[J/OL]. EURASIP Journal on Audio, Speech, and Music Processing, https://doi.org/10.1186/s13636-019-0152-1, 2019-12-01.
23 de Paulo F J, Simiqueli A A, Tabet C J, et al. The effect of background music on sensory evaluation of craft beer[J]. Research, Society and Development, 2022, 11(9): e27611931620. DOI:10.33448/rsd-v11i9.31620
24 Failing M, Theeuwes J. Selection history: How reward modulates selectivity of visual attention[J]. Psychonomic Bulletin & Review, 2018, 25(2): 514-538.
25 Friston K. The free-energy principle: A unified brain theory?[J]. Nature Reviews Neuroscience, 2010, 11(2): 127-138. DOI:10.1038/nrn2787
26 Fu S X, Wu Y, Du Q Z, et al. The secret of voice: How acoustic characteristics affect video creators’ performance on Bilibili[J]. Decision Support Systems, 2024, 179: 114167. DOI:10.1016/j.dss.2023.114167
27 Ge J Q, Peng G, Lyu B J, et al. Cross-language differences in the brain network subserving intelligible speech[J]. Proceedings of the National Academy of Sciences of the United States of America, 2015, 112(10): 2972-2977.
28 Hasan R, Shams R, Rahman M. Consumer trust and perceived risk for voice-controlled artificial intelligence: The case of Siri[J]. Journal of Business Research, 2021, 131: 591-597. DOI:10.1016/j.jbusres.2020.12.012
29 Hofbauer L M, Rodriguez F S. Emotional valence perception in music and subjective arousal: Experimental validation of stimuli[J]. International Journal of Psychology, 2023, 58(5): 465-475. DOI:10.1002/ijop.12922
30 Hopfield J J. Neural networks and physical systems with emergent collective computational abilities[J]. Proceedings of the National Academy of Sciences of the United States of America, 1982, 79(8): 2554-2558.
31 Huang X, Labroo A A. Cueing morality: The effect of high-pitched music on healthy choice[J]. Journal of Marketing, 2020, 84(6): 130-143. DOI:10.1177/0022242918813577
32 Ijiga O M, Idoko I P, Enyejo L A, et al. Harmonizing the voices of AI: Exploring generative music models, voice cloning, and voice transfer for creative expression[J]. World Journal of Advanced Engineering Technology and Sciences, 2024, 11(1): 372-394. DOI:10.30574/wjaets.2024.11.1.0072
33 Jia X S. A music emotion classification model based on the improved convolutional neural network[J/OL]. Computational Intelligence and Neuroscience, https://doi.org/10.1155/2022/6749622, 2022-01-01.
34 Juslin P N, Västfjäll D. Emotional responses to music: The need to consider underlying mechanisms[J]. Behavioral and Brain Sciences, 2008, 31(5): 559-575. DOI:10.1017/S0140525X08005293
35 Kaya E M, Elhilali M. Modelling auditory attention[J]. Philosophical Transactions of the Royal Society B: Biological Sciences, 2017, 372(1714): 20160101. DOI:10.1098/rstb.2016.0101
36 Kimble C E, Seidel S D. Vocal signs of confidence[J]. Journal of Nonverbal Behavior, 1991, 15(2): 99-105. DOI:10.1007/BF00998265
37 Klein K, Melnyk V, Völckner F. Effects of background music on evaluations of visual images[J]. Psychology & Marketing, 2021, 38(12): 2240-2246.
38 Lai C J, Chiang C C. Effects of placement point of background music on shopping website[J]. Work, 2012, 41(S1): 5419-5421.
39 Lang M, Shaw D J, Reddish P, et al. Lost in the rhythm: Effects of rhythm on subsequent interpersonal coordination[J]. Cognitive Science, 2016, 40(7): 1797-1815. DOI:10.1111/cogs.12302
40 Loui P, Bachorik J P, Li H C, et al. Effects of voice on emotional arousal[J]. Frontiers in Psychology, 2013, 4: 675.
41 Lowe M L, Loveland K E, Krishna A. A quiet disquiet: Anxiety and risk avoidance due to nonconscious auditory priming[J]. Journal of Consumer Research, 2019, 46(1): 159-179. DOI:10.1093/jcr/ucy068
42 Menon V, Levitin D J. The rewards of music listening: Response and physiological connectivity of the mesolimbic system[J]. NeuroImage, 2005, 28(1): 175-184. DOI:10.1016/j.neuroimage.2005.05.053
43 Moreno-Lobato A, Di-Clemente E, Hernández-Mogollón J M, et al. How emotions sound. A literature review of music as an emotional tool in tourism marketing[J]. Tourism Management Perspectives, 2023, 48: 101154. DOI:10.1016/j.tmp.2023.101154
44 Morreale F, Masu R, De Angeli A, et al. The effect of expertise in evaluating emotions in music[A]. Proceedings of the 3rd international conference on music & emotion[C]. Jyväskylä: University of Jyväskylä, 2013.
45 Nestor M, Loredana F, Erik B, et al. The AI index 2023 annual report[R]. California: The Stanford Institute for Human-Centered Artificial Intelligence, 2023.
46 Oleszkiewicz A, Pisanski K, Lachowicz-Tabaczek K, et al. Voice-based assessments of trustworthiness, competence, and warmth in blind and sighted adults[J]. Psychonomic Bulletin & Review, 2017, 24(3): 856-862.
47 Pardi M B, Vogenstahl J, Dalmay T, et al. A thalamocortical top-down circuit for associative memory[J]. Science, 2020, 370(6518): 844-848. DOI:10.1126/science.abc2399
48 Plack C J. The sense of hearing[M]. 3rd ed. London: Routledge, 2018.
49 Puligadda S, Vanbergen N. The influence of sound logo instruments on brand personality perceptions: An investigation of brand ruggedness and sophistication[J]. Journal of Business Research, 2023, 156: 113531. DOI:10.1016/j.jbusres.2022.113531
50 Rodero E. Effectiveness, attention, and recall of human and artificial voices in an advertising story. Prosody influence and functions of voices[J]. Computers in Human Behavior, 2017, 77: 336-346. DOI:10.1016/j.chb.2017.08.044
51 Rodero E. Do your ads talk too fast to your audio audience? How speech rates of audio commercials influence cognitive and physiological outcomes[J]. Journal of Advertising Research, 2020, 60(3): 337-349. DOI:10.2501/JAR-2019-038
52 Roschk H, Loureiro S M C, Breitsohl J. Calibrating 30 years of experimental research: A meta-analysis of the atmospheric effects of music, scent, and color[J]. Journal of Retailing, 2017, 93(2): 228-240. DOI:10.1016/j.jretai.2016.10.001
53 Scherer K R, Ekman P. Approaches to emotion[M]. New York: Psychology Press, 2014.
54 Shang J C, Liu Z H. The “beauty premium” effect of voice attractiveness of long speech sounds in outcome-evaluation event-related potentials in a trust game[J]. Frontiers in Psychology, 2022, 13: 1010457. DOI:10.3389/fpsyg.2022.1010457
55 Spence C, Keller S. Sonic branding: A narrative review at the intersection of art and science[J]. Psychology & Marketing, 2024, 41(7): 1530-1548.
56 Venkatesh S, Moffat D, Miranda E R. You only hear once: A YOLO-like algorithm for audio segmentation and sound event detection[J]. Applied Sciences, 2022, 12(7): 3293. DOI:10.3390/app12073293
57 Vuust P, Heggli O A, Friston K J, et al. Music in the brain[J]. Nature Reviews Neuroscience, 2022, 23(5): 287-305. DOI:10.1038/s41583-022-00578-5
58 Wang X, Bendle N, Pan Y J. Beyond text: Marketing strategy in a world turned upside down[J]. Journal of the Academy of Marketing Science, 2024a, 52(4): 939-954.
59 Wang X, Lu S J, Li X I, et al. Audio mining: The role of vocal tone in persuasion[J]. Journal of Consumer Research, 2021, 48(2): 189-211. DOI:10.1093/jcr/ucab012
60 Wang Y, Yang Y, Wang X Q, et al. How do voice characteristics affect tourism interpretation purchases? An empirical study based on voice mining[J]. Journal of Travel Research, 2024b, 63(2): 481-495.
61 Wei W, Huang Z R, Feng C, et al. Predicting phonological information in language comprehension: Evidence from ERP representational similarity analysis and Chinese idioms[J]. Cerebral Cortex, 2023, 33(15): 9367-9375. DOI:10.1093/cercor/bhad209
62 Zhou X Y, Yan X, Jiang Y W. Making sense? The sensory-specific nature of virtual influencer effectiveness[J]. Journal of Marketing, 2024, 88(4): 84-106. DOI:10.1177/00222429231203699
63 Zwicker E, Fastl H. Psychoacoustics: Facts and models[M]. Berlin Heidelberg: Springer, 1990.