Made in 2020 with Hicham Bendriss and Keez Duyves for the Academy's Open Day. Made in Unity, just before we received the Rokoko Motion Tracking Suite :)
Social media teaser be-connected festival.
Excerpt from an online Scenography performance where the lobby was made with Getiyo. A streaming platform with fresh tools, in this case all the audience's mouses are shown as an overlay on the screen. The presenter is filmed with an iPhone 12 and Face Cap, an app that captures your face realtime and translates it to a 3d model.
Overview of the research in IDLab of Artist and Technolist in Residence Fred Rodriguez in 2020 and 2021.
Must watch if your are in interested in real time video shaders and volumetric video.
Edda & Avan
Trailer (right) and the whole performance of (left). A lot is going on in this performance made by Katharina Wegmann in May/June 2021. Mime player Nick is pre-recorded with a Rokoko Motion Tracking Suite and placed in a virtual space in Unity, made with Cinema 4d and Blender. After that mime player Pleuni performs in the Rokoko Suite and interacts with Nick. The digital characters were made with Character Creator 3 from Reallusion. Challenges: how to make a digital avatar that has hands, fingers, eyes that look, a mouth that can talk and a whole body that can walk. How to work with realtime motion tracking in a performance. How to digitally make use of light. How can you touch another person in VR?
Edda is a young woman and can be described as a Hikikomori. This term describes someone who shut themself off from the physical world. She spends her time on her own in her room. In a chat she meets Avan, possibly also a Hikikomori. As they are physically apart they schedule to meet in a digital surrounding. Together they explore the possibilities of an online world and an online body.
with: Nick Deroo, Pleuni Veen
concept, direction & scenography: Katharina Wegmann*
producer: Willem Weemhoff
creative technologist: Keez Duyves
lighting and environment programmer: Hicham Bendriss
avatar programmer: Henk Nijman
composer: Lisa Weyrauther
production: Paula Braas
technical production: Dave Krooshof
camera: Hans de Jonge
* = graduating student
with special thanks to: Bas de Bruijn, Cecile Brommer, Frits van Driel, Niels Jansson, David Knap, Erik Lint, Jurre Pöpping, Dennis Schaffer, Charlie Smeets, Bart Visser, Tatyana van WalsumThis is a co-production with ID-labparental advisory: this content contains nudity and acts of intimacy.
Too Much in the Head
Making Of (LEFT) and Teaser (RIGHT) from Too Much in the Head by Marina Orlova: A choreographic work that involves 3 dimensions of live improvisation: from performers, AI* and sound designer.
The AI (Artificial Intelligence) in this piece is represented by a real text based neural network that was trained with the data from 35 interviews with neurodivergent people. Build by Artyom Kuznetsov, produced by Fred Rodrigues, co-produced by IDlab. The Making Of gives a nice insight what can happen in a creative proces if a lot of computer power in brought onto the stage...
What do we know about the inner life of Artificial Intelligence?
How are the thoughts moving there?
What happens in its dreams?
Can it get emotional?
What if it is emotionally unstable?
Can it have a mental disorder?
Does it need therapy?
Re-Mediate Orandakan EXPO1970-2020 | Osaka | Japan | Amsterdam | NL.
Interactive installation with a lot of video mapping made in Isadora.
Presented during Open House/Day on 25 January 11:00-17:00 making use of the original films presented in Japan in 1970. The world expo in Osaka in 1970 was dominated by the humanization of the new information and communication technology. The theme was "".
The Netherlands presented itself in Osaka to 4,646,167 Japanese visitors with visual art, music, design and, above all, a multimedia experience with 36 km of film, 23 synchronised 16mm film and slide projectors. In the pavilion, designed as a "viewing machine", the Japanese audience was immersed in a special total experience. Thanks to the pavilion by the architects Carel Weeber/Bakema, multi-screen projections by Jan Vrijman and Frans Weisz, design by Wim Crouwel, music by Louis Andriessen and the hall of mirrors by Peter Struycken, the pavilion was technologically and architecturally highly innovative and unique. The average number of visitors per day was between 25,000 and 35,000.
Poetic Raw Material (no sound) from students who are trying to touch something in VR. The Blob Particle is rigged with Obi Soft Body Software that renders certain physics depending on how much collision there is with the Rokoko Body Tracking Suite..