A multimedia performance that explores artificial intelligence and its limits.
Service:
Art Direction
Video Mapping
Animation
Cooperation:
Fura Del Baus
Barcelona, Spain
Year:
2018
Team:
Sandra Rodríguez, Tim Schnettker,
Xénia Dols, Anna Aguilera Sellas, Kira Teuber
The Script The visitors are part of a neural network of an algorithm that will get used in the future to support political decision-makers. By maximi- zing rationality, the human error rate in decision-making is to get minimized. The audience is in the training phase, in which the algorithm gets taught morality utilizing questions. They go through different stages, each with two possible answers: right or wrong. To provide the machine with appropriate feedback, they get asked to perform actions via their cell phones. In the course of the play, the AI learns more and more about human morality through the spectators. The piece‘s climax is a classic dilemma: the machine and its logic-driven system commit a fallacy. The visitors got asked whether they trusted the result of a calculator or a reference person more in a calculation task. The answer was clearly in favor of the calculator. This logical argument was used at the end to introduce a false conclusion. If people trust the calculator more than their reference person, they put faith in a machine instead of a human. That is a logically incorrect result ending up in the system degrading the human as a decision-making being. The training is over. It concludes that human morality cannot contribute to logical decision-making; in other words, humans should not make decisions. The piece questions the trust in the logic of artificial intelligence and the resulting outcomes, which may be logically correct in themselves, but disregard moral, human dimensions.
The Stage The installation consists of a walk-in room with walls made of a semi-transparent net called mesh, which gets covered with video projections from two sides. Due to the translucent fabric, the opposite sides get projected, too. That creates an immersi- ve space that is filled with video animations all around. In the centre of the room is a microphone measuring and converting the visitors‘ volume into video signals. The mesh reacts to this volume by becoming spikier and starting to move. It gives the audience direct feedback on their behaviour and allows them to shape the visuals.
The App With the help of software that visitors can install as an app on their cell phones beforehand, the visuals can get controlled remotely with restrictions. That makes it possible to play messages or sounds on the phone or to turn on the flashlight. The app, called “Kalliope”, was developed by Fura Del Baus and made available to the team as part of the performance collaboration program. The show gets directed by two people. One person mixes the live video projections, and the other sends messages and sounds to the visitors. In addition, two large sound systems transport the computer‘s voice and atmospheric sounds.
Leistung:
Art Direction
Video Mapping
Animation
Kooperation:
Fura Del Baus
Barcelona, Spanien
Jahr:
2018
Team:
Sandra Rodríguez, Tim Schnettker,
Xénia Dols, Anna Aguilera Sellas, Kira Teuber
The Script The visitors are part of a neural network of an algorithm that will get used in the future to support political decision-makers. By maximi- zing rationality, the human error rate in decision-making is to get minimized. The audience is in the training phase, in which the algorithm gets taught morality utilizing questions. They go through different stages, each with two possible answers: right or wrong. To provide the machine with appropriate feedback, they get asked to perform actions via their cell phones. In the course of the play, the AI learns more and more about human morality through the spectators. The piece‘s climax is a classic dilemma: the machine and its logic-driven system commit a fallacy. The visitors got asked whether they trusted the result of a calculator or a reference person more in a calculation task. The answer was clearly in favor of the calculator. This logical argument was used at the end to introduce a false conclusion. If people trust the calculator more than their reference person, they put faith in a machine instead of a human. That is a logically incorrect result ending up in the system degrading the human as a decision-making being. The training is over. It concludes that human morality cannot contribute to logical decision-making; in other words, humans should not make decisions. The piece questions the trust in the logic of artificial intelligence and the resulting outcomes, which may be logically correct in themselves, but disregard moral, human dimensions.
The Stage The installation consists of a walk-in room with walls made of a semi-transparent net called mesh, which gets covered with video projections from two sides. Due to the translucent fabric, the opposite sides get projected, too. That creates an immersi- ve space that is filled with video animations all around. In the centre of the room is a microphone measuring and converting the visitors‘ volume into video signals. The mesh reacts to this volume by becoming spikier and starting to move. It gives the audience direct feedback on their behaviour and allows them to shape the visuals.
The App With the help of software that visitors can install as an app on their cell phones beforehand, the visuals can get controlled remotely with restrictions. That makes it possible to play messages or sounds on the phone or to turn on the flashlight. The app, called “Kalliope”, was developed by Fura Del Baus and made available to the team as part of the performance collaboration program. The show gets directed by two people. One person mixes the live video projections, and the other sends messages and sounds to the visitors. In addition, two large sound systems transport the computer‘s voice and atmospheric sounds.
Portfolio 2024
© Tim Schnettker
Studio Schnettker
© Tim Schnettker
E: studio@tim-schnettker.de
IG: @timschnettker
Linkedin: Tim Schnettker
I studied Integrated Design in Cologne and Barcelona, with a strong focus on visual communication through analog and digital media. During my exchange semester in Barcelona, I created my first interactive play with the theatre collective Fura del Baus and explored graphic and editorial design through an internship at the design studio tinograss.
My background in visual communication showed me the power of art and design and the fruitful exchange between these disciplines. However, I wanted more than just to find the medium to convey a message; I wanted to shape the message and the process itself. This led me to co-design and the question of how to have a strategic impact while integrating the people we design for directly into the process. At the end of my studies, I therefore explored the aesthetic experience of service design processes using choreographic techniques. A central medium for applying such techniques is workshops and exchange formats in which participatory and cooperative solutions are sought. The resulting Human-Centered Design has become a design ethos for me since then.
After my studies, I worked as a video artist within the theatre collective Studio Trafique and at Theater Bonn, operating at the intersection of analog and digital design and performance. From late 2021 to 2023, I decided to shift carrer paths and became an art director for the design agency VUCX in Cologne, developing brands and unique brand experiences for clients in various industries. Since late 2023, I have been challenging myself further by starting a two-year master’s program in Service Design as an Erasmus Mundus scholarship holder in Latvia, Finnland ans Estonia.
E: studio@tim-schnettker.de
IG: @timschnettker
Linkedin: Tim Schnettker
I studied Integrated Design in Cologne and Barcelona, with a strong focus on visual communication through analog and digital media. During my exchange semester in Barcelona, I created my first interactive play with the theatre collective Fura del Baus and explored graphic and editorial design through an internship at the design studio tinograss.
My background in visual communication showed me the power of art and design and the fruitful exchange between these disciplines. However, I wanted more than just to find the medium to convey a message; I wanted to shape the message and the process itself. This led me to co-design and the question of how to have a strategic impact while integrating the people we design for directly into the process. At the end of my studies, I therefore explored the aesthetic experience of service design processes using choreographic techniques. A central medium for applying such techniques is workshops and exchange formats in which participatory and cooperative solutions are sought. The resulting Human-Centered Design has become a design ethos for me since then.
After my studies, I worked as a video artist within the theatre collective Studio Trafique and at Theater Bonn, operating at the intersection of analog and digital design and performance. From late 2021 to 2023, I decided to shift carrer paths and became an art director for the design agency VUCX in Cologne, developing brands and unique brand experiences for clients in various industries. Since late 2023, I have been challenging myself further by starting a two-year master’s program in Service Design as an Erasmus Mundus scholarship holder in Latvia, Finnland ans Estonia.