Owheo Building, G.30
Phone: TBA
Email: s.livingstone@otago.ac.nz
My research is in affective data science, where I apply programming, statistics, and machine learning to understand emotion and its related disorders. I am also interested in the rehabilitation of facial and vocal deficits in neurodegenerative disorders such as Parkinson's disease. For more information, please see my research page.
I lead the Affective Data Science Lab (ADSL) here at Otago. We focus on developing techniques and technologies that can recognize, predict, and express emotion. We often work with physiological equipment that generate large amounts of data, including motion capture and electromyography.
My background is in computer science and psychology. I studied Physics and Information Technology at the University of Queensland, and then did my PhD in Computer Science at UQ entitled “Changing musical emotions with a computational rule system”. I was then a postdoctoral fellow at McGill University, Canada, in Psychology, followed by fellowship positions at Ryerson University and McMaster University, Canada, in Psychology. Following this, I was an Assistant Professor in Computer Science at the University of Wisconsin, River Falls, where I taught the Data Science program. I joined the University of Otago in 2019.
Publications
Swarbrick, D., Bosnyak, D., Livingstone, S. R., Bansal, J., Marsh-Rollo, S., Woolhouse, M., & Trainor, L. (2019). How live music moves us: Head movement differences in audiences to live versus recorded music. Frontiers in Psychology, 9, 2682. doi: 10.3389/fpsyg.2018.02682
Chang, A., Kragness, H., Livingstone, S. R., Bosnyak, D., & Trainor, L. (2019). Body sway reflects joint emotional expression in music ensemble performance. Scientific Reports, 9, 205. doi: 10.1038/s41598-018-36358-4
Livingstone, S. R., & Russo, F. (2018). The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE, 13(5), e0196391. doi: 10.1371/journal.pone.0196391
Chang, A., Livingstone, S. R., Bosnyak, D., & Trainor, L. (2017). Body sway reflects leadership in joint music performance. PNAS, 114(21), E4134-E4141. doi: 10.1073/pnas.1617657114
Livingstone, S. R., Vezer, E., McGarry, L. M., Lang, A. E., & Russo, F. (2016). Deficits in the mimicry of facial expressions in Parkinson's disease. Frontiers in Psychology, 7, 780. doi: 10.3389/fpsyg.2016.00780
Chapter in Book - Research
Livingstone, S. R. (2014). Facial expression. In W. F. Thompson (Ed.), Music in the social and behavioral sciences: An encyclopedia (Vol. 1). (pp. 447-449). Thousand Oaks, CA: Sage. doi: 10.4135/9781452283012.n149
Livingstone, S. R., & Thompson, W. F. (2010). Émergence de la musique et théorie de l'esprit. In I. Deliege, O. Vitouch & O. Ladinig (Eds.), Musique et évolution: Les origines et l'évolution de la musique. (pp. 47-63). Wavre, Belgium: Mardaga.
Journal - Research Article
Swarbrick, D., Bosnyak, D., Livingstone, S. R., Bansal, J., Marsh-Rollo, S., Woolhouse, M., & Trainor, L. (2019). How live music moves us: Head movement differences in audiences to live versus recorded music. Frontiers in Psychology, 9, 2682. doi: 10.3389/fpsyg.2018.02682
Chang, A., Kragness, H., Livingstone, S. R., Bosnyak, D., & Trainor, L. (2019). Body sway reflects joint emotional expression in music ensemble performance. Scientific Reports, 9, 205. doi: 10.1038/s41598-018-36358-4
Livingstone, S. R., & Russo, F. (2018). The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English. PLoS ONE, 13(5), e0196391. doi: 10.1371/journal.pone.0196391
Chang, A., Livingstone, S. R., Bosnyak, D., & Trainor, L. (2017). Body sway reflects leadership in joint music performance. PNAS, 114(21), E4134-E4141. doi: 10.1073/pnas.1617657114
Livingstone, S. R., Vezer, E., McGarry, L. M., Lang, A. E., & Russo, F. (2016). Deficits in the mimicry of facial expressions in Parkinson's disease. Frontiers in Psychology, 7, 780. doi: 10.3389/fpsyg.2016.00780
Livingstone, S. R., & Palmer, C. (2016). Head movements encode emotions during speech and song. Emotion, 16(3), 365-380. doi: 10.1037/emo0000106
Livingstone, S. R., Thompson, W. F., Wanderley, M. M., & Palmer, C. (2015). Common cues to emotion in the dynamic facial expressions of speech and song. Quarterly Journal of Experimental Psychology, 68(5), 952-970. doi: 10.1080/17470218.2014.971034
Livingstone, S. R., Choi, D. H., & Russo, F. A. (2014). The influence of vocal training and acting experience on measures of voice quality and emotional genuineness. Frontiers in Psychology, 5, 156. doi: 10.3389/fpsyg.2014.00156
Chan, L. P., Livingstone, S. R., & Russo, F. A. (2013). Facial mimicry in response to song. Music Perception, 30(4), 361-367. doi: 10.1525/MP.2013.30.4.361
Livingstone, S. R. (2013). The kinematics of musical expression in the spatiotemporal dimension. Empirical Musicology Review, 8(2), 124-127. doi: 10.18061/emr.v8i2.3931
Livingstone, S. R., Palmer, C., & Schubert, E. (2012). Emotional response to musical repetition. Emotion, 12(3), 552-567. doi: 10.1037/a0023747
Thompson, W. F., Russo, F. A., & Livingstone, S. R. (2010). Facial expressions of singers influence perceived pitch relations. Psychonomic Bulletin & Review, 17(3), 317-322. doi: 10.3758/PBR.17.3.317
Livingstone, S. R., Muhlberger, R., Brown, A. R., & Thompson, W. F. (2010). Changing musical emotion: A computational rule system for modifying score and performance. Computer Music Journal, 34(1), 41-64. doi: 10.1162/comj.2010.34.1.41
Livingstone, S. R., & Thompson, W. F. (2009). The emergence of music from the Theory of Mind. Musicæ Scientiæ, 13(2, Suppl.), 83-115. doi: 10.1177/1029864909013002061
Livingstone, S. R., Thompson, W. F., & Russo, F. A. (2009). Facial expressions and emotional singing: A study of perception and production with motion capture and electromyography. Music Perception, 26(5), 475-488. doi: 10.1525/mp.2009.26.5.475
Livingstone, S. R., Mühlberger, R., Brown, A. R., & Loch, A. (2007). Controlling musical emotionality: An affective computational architecture for influencing musical emotions. Digital Creativity, 18(1), 43-53. doi: 10.1080/14626260701253606
Journal - Research Other
Livingstone, S. R., & Thompson, W. F. (2006). Multimodal affective interaction: A comment on musical origins. Music Perception, 24(1), 89-94. doi: 10.1525/mp.2006.24.1.89
Conference Contribution - Published proceedings: Full paper
Zhao, S., Rudzicz, F., Carvalho, L., Márquez-Chin, C., & Livingstone, S. (2014). Automatic detection of expressed emotion in Parkinson's Disease. Proceedings of the IEEE International Conference on Acoustic, Speech and Signal Processing (ICASSP). (pp. 4813-4817). IEEE. doi: 10.1109/ICASSP.2014.6854516
Livingstone, S. R., Peck, K., & Russo, F. A. (2013). Acoustic differences in the speaking and singing voice. Proceedings of Meetings on Acoustics. 19(1), 035080. Melville, NY: Acoustical Society of America. doi: 10.1121/1.4799460
Livingstone, S. R., Palmer, C., Wanderley, M. M., Thompson, W. F., & Lissemore, J. (2011). Facial expressions in vocal performance: Visual communication of emotion. In A. Williamon, D. Edwards & L. Bartel (Eds.), Proceedings of the Third International Symposium on Performance Science (ISPS). (pp. 545-550). Utrecht, The Netherlands: European Association of Conservatoires (AEC). doi: 10.13140/2.1.3522.1446
Livingstone, S. R., Schubert, E., Loehr, J. D., & Palmer, C. (2009). Emotional arousal and the automatic detection of musical phrase boundaries. In A. Williamon, S. Pretty & R. Buck (Eds.), Proceedings of the Second International Symposium on Performance Science (ISPS). (pp. 445-450). Utrecht, The Netherlands: European Association of Conservatoires (AEC). Retrieved from https://performancescience.org/publications/
Livingstone, S. R., Muhlberger, R., & Brown, A. R. (2005). Playing with affect: Music performance with awareness of score and audience. In T. Opie & A. R. Brown (Eds.), Proceedings of the Australasian Computer Music Conference. (pp. 92-98). Brisbane, Australia: Australasian Computer Music Association. [Full Paper]
Livingstone, S. R., & Brown, A. R. (2005). Dynamic response: Real-time adaptation for music emotion. In Y. Pisan (Ed.), Proceedings of the Second Australasian Conference on Interactive Entertainment. (pp. 105-111). Sydney, Australia: Creativity and Cognition Studios Press. [Full Paper]
Henricksen, K., Livingstone, S., & Indulska, J. (2004). Towards a hybrid approach to context modelling, reasoning and interoperation. In D. De Roure & J. Indulska (Eds.), Proceedings of the First International Workshop on Advanced Context Modelling, Reasoning and Management. Southampton, UK: University of Southampton. [Full Paper]
Conference Contribution - Published proceedings: Abstract
Livingstone, S. R., Palmer, C., Thompson, W. F., & Wanderley, M. M. (2010). Facial expressions in speech and singing. In M. M. Wanderley, J. Wild & S. X. Wei (Eds.), Proceedings of the 3rd International Conference on Music and Gesture. (pp. 9-10). Montreal, Canada: McGill University. doi: 10.13140/2.1.3030.6249
Conference Contribution - Verbal presentation and other Conference outputs
Livingstone, S. R., Brown, A. R., & Muhlberger, R. (2005, November-December). Influencing the perceived emotions of music with intent. Verbal presentation at the Third International Conference on Generative Systems in the Electronic Arts, Melbourne, Australia.
