Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality

Jung In Jung; Paul Blackham

Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality

Jung In Jung, Paul Blackham

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

Hot Summer Afternoon is a sound performance which uses VR as performance space. The new controller-free hand tracking feature of Oculus Quest allows users to monitor their hands inside of the VR world. Some hand gestures as well as the position of spawned objects in VR are mapped with different sound parameters using machine learning. The aim of this project is to explore the embodiment of the performer’s musical expression with hands inside of the immersive virtual environment.

Original language	English
Title of host publication	xCoAx 2020
Subtitle of host publication	Proceedings of the 8th Conference on Computation, Communication, Aesthetics & X
Editors	Mario Verdicchio, Miguel Carvalhais, Luísa Ribas, André Rangel
Place of Publication	Portugal
Publisher	Universidade do Porto
Pages	398-400
Number of pages	2
ISBN (Electronic)	9789897462665
Publication status	Published - 8 Jul 2020
Event	8th Conference on Computation, Communication, Aesthetics & X - Graz, Austria Duration: 8 Jul 2020 → 10 Jul 2020 http://8th Conference on Computation, Communication, Aesthetics & X

Conference

Conference	8th Conference on Computation, Communication, Aesthetics & X
Country/Territory	Austria
City	Graz
Period	8/07/20 → 10/07/20
Internet address	http://8th Conference on Computation, Communication, Aesthetics & X

Keywords

Sound
Performance
Virtual Reality
Hand Tracking
Hand Gesture
Machine Learning
Musicality
Embodiment

Cite this

@inproceedings{70393e78c7024c0b9cd8fc094f2ab56f,

title = "Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality",

abstract = "Hot Summer Afternoon is a sound performance which uses VR as performance space. The new controller-free hand tracking feature of Oculus Quest allows users to monitor their hands inside of the VR world. Some hand gestures as well as the position of spawned objects in VR are mapped with different sound parameters using machine learning. The aim of this project is to explore the embodiment of the performer{\textquoteright}s musical expression with hands inside of the immersive virtual environment.",

keywords = "Sound, Performance, Virtual Reality, Hand Tracking, Hand Gesture, Machine Learning, Musicality, Embodiment",

author = "Jung, {Jung In} and Paul Blackham",

year = "2020",

month = jul,

day = "8",

language = "English",

pages = "398--400",

editor = "Verdicchio, {Mario } and Miguel Carvalhais and Lu{\'i}sa Ribas and Rangel, {Andr{\'e} }",

booktitle = "xCoAx 2020",

publisher = "Universidade do Porto",

address = "Portugal",

note = "8th Conference on Computation, Communication, Aesthetics & X ; Conference date: 08-07-2020 Through 10-07-2020",

url = "http://8th Conference on Computation, Communication, Aesthetics & X",

}

Jung, JI & Blackham, P 2020, Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality. in M Verdicchio, M Carvalhais, L Ribas & A Rangel (eds), xCoAx 2020: Proceedings of the 8th Conference on Computation, Communication, Aesthetics & X. Universidade do Porto, Portugal, pp. 398-400, 8th Conference on Computation, Communication, Aesthetics & X, Graz, Austria, 8/07/20.

Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality. / Jung, Jung In; Blackham, Paul.
xCoAx 2020: Proceedings of the 8th Conference on Computation, Communication, Aesthetics & X. ed. / Mario Verdicchio; Miguel Carvalhais; Luísa Ribas; André Rangel. Portugal: Universidade do Porto, 2020. p. 398-400.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Hot Summer Afternoon

T2 - 8th Conference on Computation, Communication, Aesthetics & X

AU - Jung, Jung In

AU - Blackham, Paul

PY - 2020/7/8

Y1 - 2020/7/8

N2 - Hot Summer Afternoon is a sound performance which uses VR as performance space. The new controller-free hand tracking feature of Oculus Quest allows users to monitor their hands inside of the VR world. Some hand gestures as well as the position of spawned objects in VR are mapped with different sound parameters using machine learning. The aim of this project is to explore the embodiment of the performer’s musical expression with hands inside of the immersive virtual environment.

AB - Hot Summer Afternoon is a sound performance which uses VR as performance space. The new controller-free hand tracking feature of Oculus Quest allows users to monitor their hands inside of the VR world. Some hand gestures as well as the position of spawned objects in VR are mapped with different sound parameters using machine learning. The aim of this project is to explore the embodiment of the performer’s musical expression with hands inside of the immersive virtual environment.

KW - Sound

KW - Performance

KW - Virtual Reality

KW - Hand Tracking

KW - Hand Gesture

KW - Machine Learning

KW - Musicality

KW - Embodiment

UR - https://2020.xcoax.org/#proceedings

M3 - Conference contribution

SP - 398

EP - 400

BT - xCoAx 2020

A2 - Verdicchio, Mario

A2 - Carvalhais, Miguel

A2 - Ribas, Luísa

A2 - Rangel, André

PB - Universidade do Porto

CY - Portugal

Y2 - 8 July 2020 through 10 July 2020

ER -

Hot Summer Afternoon: Towards the Embodiment of Musical Expression in Virtual Reality

Abstract

Conference

Keywords

Other files and links

Fingerprint

Cite this