Mitochondria
Visual and Interaction Design| Creative Coding | Live Digital Performance
Took charge of Concept, Design and Development Year: May 2018
INTRO
How can we engage dancers with the technology and artistically express the evolution of two lives?
Mitochondria is an interactive dance piece, live performed by the dancers. It conveys the raw passion of life, exhibits changes, developments and evolution of two lives.
All the visuals are generated by code and rendered in real time according to dancers' movement using Kinect.
I collaborated with my team members to develop concept and visual style, and took charge of the actual visual production generated by code, interaction design and development.
Credits:
Coding & Production: Yiyao Nie(Me)
Visual Design: Yiyao Nie, Chengchao Zhu
Projection Mapping: Chengchao Zhu
Choreography & Dance: Nini Donglier, Razimen Sabini
Exhibitions:
SHIFT - NYU TISCH DANCE Final Concert 2018.
Tool:
Kinect V2
Processing
GLSL shader
Isadora
Ae, Ai, Ps
Hashtag #
#Creative Coding
#Shader
#Realtime Rendering
#Motion Capture
#Digital Live Performance
#Dance Choreography
Video
Photo
CONCEPT DEVELOPMENT
What are the parameters of choreography?
Choreograph the storyline.
Setup
DESIGN + PROTOTYPE
I used code as a design tool in this project to think, to imagine, to test and to develop.
I firstly created all the code in processing and created GLSL shader, and used mouse to control the movement of the visuals. Then I replaced the mouse control with Kinect skeleton tracking data. Every sketch can track two dancer's movement. According to dancer’s different movement, generating different visuals in real time.
Part 1 : Rain
Part2 : Ripple/Wave, using glsl shader
Part3: Lighting
Part4: Mitochondria
FULL PERFORMANCE SHOW
Special thanks to our great team! We are awesome :)
From audiences’ feedbacks from the show, they really want to play with the visuals.
So for future possibility, I would like to transform my visuals into an interactive installation or an immersive experience so that audiences can participate and experience by themselves.