SystemFailed deals with structures of power in the "smart" age. Algorithmic governance techniques are made playfully tangible and a critical examination of digitalization is initiated. Three performers and a self-developed AI system, represented by moving light and projections, face the audience.
The project is divided into three modules:
The AI system consists of LiDAR laser motion tracking, a machine learning system that predicts motion behavior, and an evaluation system that makes automated decisions and interacts with the audience via projections, moving heads and synthesized voice.
Click the button, to follow the development
CODING - The nerds develop the machine learning system, the control software for lights and projections, and the geometric calculations to evaluate movements.
The machine learning is based on the Trajectory Forecasting Framework (TrajNet++). The algorithm attempts to predict the movement behavior of people in groups. The software development can be followed onHub.
TRACKING - The LiDAR lasers can be used to measure the exact position of each person in the room. This way, the AI knows where people are at all times, how they are moving, how fast or slow they are walking, and how close they are getting. We use six lasers distributed around the scene area so that all people are always in view of the AI and are assigned unique IDs. There's no hiding from the "laser eyes."
CALIBRATION - The laser tracking system and the ground projection are calibrated to each other. During the first tests, the X and Y position and the ID are projected.
ML TRAINING - The machine learning system for motion prediction gets trained.
PREDICTION - Real-time tracking data is processed by the ML system and future movement is predicted.
MOVING BEAMS - The light beams become the arms of the AI, with the help of which it can intervene in the action. Anyone who breaks a rule, such as getting too close to the others, will be blinded.
LIGHT NET - A mirror installation creates a network of light. Uncountable rays cross in space - a metaphor for the artificial neural network. In the test, two mirror objects are printed, glued and hung to test the angles.
The performers explore the AI system.
A first system test with more people.
is a performative workshop in which we test the use of the self-developed AI system together with the participants. Examining the power structures within our digitalised world, we will embark on a research journey that is a simulation game, a test-run and an analysis of our own beviors all at the same time. Devoting ourselves to the question of how deeply artificial intelligence intervenes in our lives, we will examine and question the effects of algorithmically controlled systems of power in a playful way. With the help of a personalised tracking system, participants will experience in real time how an artificial intelligence predicts and evaluates their movements in space. Seemingly arbitrary machine decisions will be linked to a strict system of rules that will emerge through the improvised play of participants and performers. A temporary micro-society will be formed with and through the AI - and the question of how we want to shape it.
is a participatory performance where the audience can influence the course of the action. Three hackers use the audience as a micro-society that is analyzed, evaluated and shaped by AI. The AI becomes an autonomous actor and the outcome of each performance is as uncertain as our near future.
Concept: ArtesMobiles | Performance: Kathryn Fischer, Milena Gürtler, Juliane Torhorst | Direction: Nina Maria Stemberger | Audiovisual direction: Birk Schmithüsen | Sound design: Elisa Battisutta | Light design: Hans Leser | Visuals: Caren Müller | Programming TouchDesigner: Lennart Beese | Programming machine learning (AI): Marcus Ding | Technical administration: Hendrik Fritze | Light operator: Fabian Arat | Tracking: Fabian Luepke | Assistant technical: Sophie Krause | Assistant director: Elisabeth Eichler | Production: Elisa Schulze | Video documentation: Alexander Hector | Photo dokumentation: Caroline Wimmer | Graphics: Sophie Bochert | Intern: Isabella Jahns
Click the button for more details
is a performance artist, choreographer, theater and dance educator. She cofounded the performance company ArtesMobiles. In her work, she repeatedly asks herself how art in public space can be an integral part of the development of future perspectives and how it can be shaped.
is a media artist living in Leipzig. His work is shown internationally at key media art festivals in France, Netherlands, Austria, Spain and Germany, including re:publica, Chaos Communication Congress, Ars Electronica Festival and ZKM. Birk Schmithüsen is co-founder of ArtesMobiles and FlashClash. For collaborations with the performing arts, he produces interactive audiovisual environments using generative sound design, multi-channel sound, lighting design, video projection mapping and motion tracking.
The performers can interact with the immersive sceneries and the audience is diving into.
(actor, director, theatre pedagogy) lives in Berlin and works as a theatre maker in whole Germany. She creates artistic-political formats with site specific performances. She unites performing arts with social relevant questions, guides development of plays with amateurs and pros. And she is playing in international productions on stage. Funder member of children theatre KOLONASTIX, culture association „Neu am See“, 1000Gestalten, Künstler mit Herz Brandenburg.
is an actress with a focus on dance and singing. She studied at the Bongôrt-v. Roy in Leipzig. She has worked with the Sebastian Weber Company, choreographer Gundula Peuthert and musical theatre director Anja Winkler. During her study trips to Paris, Istanbul and Israel, she deepened her knowledge of contemporary dance and performance art in various further education courses. With the desire to experience spaces outside the conventional theatre space through music, movement and language, the ensemble Soundtravelers was founded in 2017. Their performative promenade concert at the Pergamonmuseum Berlin won the prize for re-performability.
further projects: FlyingDrinks
(they/them) is an electronic producer, sound designer, performance artist and writer who began working the Berlin performance and club scene in 2004, expanding their unique identity-queering, genderfucking and sexpositive performative work throughout music, theatre and film. Their explorations of borders between/within bodies and touch as political practice have brought them to theaters, communes, technomansions, prisons, dungeons, squats and galleries around the world, often with their multimedia artist duo HYENAZ.
is a sound designer, producer and media artist based in Amsterdam.
Her works have been presented in many venues worldwide such as : Palais de Tokyo, Taiwan National Theater, Ballet National de Marseille, Kinetica Museum London, Elbphilarmonie Hamburg,…, just to name some.
After the experience of leading Violet Fall (2013), a band released under the Japanese label Progressive Form, since 2015 Elisa Batti slowly stepped actively into the techno environment as a producer and DJ. In 2018 she found together with her friend Cyb, the label Immaterial Archives.
She is currently working as a lecturer at the Anton de Kom University and also as a freelancer engineer for research projects.
is a lighting designer, lighting technician, effects artist and electronics hobbyist. In addition to freelance work as a lighting technician in the theatre and event sector, since 2006 he has worked as a lighting designer for various theatre productions at HAU (Berlin), Ballhaus Naunynstraße (Berlin), Theater am Neumarkt (Zurich), Theaterdiscounter (Berlin), Volkstheater Wien, Maxim Gorki Theater Berlin. He has worked with directors Patrick Wengenroth, Barbara Weber, Bruce LaBruce, Nurkan Erpulat, Hakan Savas Mican, Christiane Rösinger and the groups Die Skills, CHEAP and Rimini Protokoll, among others.
is a visual artist and has worked as a creative director at LiCHTPiRATEN since 2006. She lives in Berlin/Uckermark.
LiCHTPiRATEN is an artists' collective with many years of experience in designing and planning of international audio-visual events. Their performances are projection art composed with music, live and site-specific. The generative visuals arise from the sounds, orientate themselves to the space and interact with it. Mapping, tracking and sensors are connected with generative techniques.
started out as a computer science nerd and ended up as an event technician, somehow always following the red thread of a creative, creative and empowering approach to technology. In this sense, he has been involved in organising the Chaos Communication Congress and other events of the Chaos Computer Club since 2013 - which is also how he got to know ArtesMobiles.
In addition to computer gadgetry and colourful glow in all walks of life, he is also often involved in the attempt to do something for the much-vaunted better world that is rumoured to be possible and has recently joined Cadus e.V. for this purpose.
is responsible for SystemFailed's machine learning parts. He is currently studying for a master's degree in IT Systems Engineering at Hasso Plattner Institute in Potsdam with practical projects and research in machine learning and human-computer interaction. At the same time, he designs light installations, other maker projects, and programs as a freelance developer for various art projects. In 2020 he contributed to the open-source project FreeCAD as a participant in the Google Summer of Code program.
is a light pirate and projection lover since 2008. With his company Beamaround is active in many different fields of projection and projects.
For SystemFailed he is helping out as technical director and videospecialist.
is a passionate event manager and loves the coordination and processes as well as the structuring of new projects. Working with people in a team, building and expanding ideas in the digital and analogue world are what drive her work. As a freelancer, she has been working as a project and production manager for events in Germany and Europe for over five years and has founded a new perspective for freelancers in the event sector with her network Event Leadership.
studied film at the Kunsthochschule in Hamburg, lives in Berlin and has been working as a freelance filmmaker for 12 years. He works in feature films and documentaries and has shot countless films, trailers and documentaries in the beautiful world of theatre and puppet theatre. Other projects are clearly inspired by the stylised aesthetics of the stage.
born and raised in Thüringen, Caroline moved to Berlin in 2000 to study European Ethnology and Modern History. That went well and took a while. Upon finishing in 2009 she decided that she would have to become a photographer after all.
Over the years she has founded her photo studio ATP24 in Berlin at Treptower Park where she follows her passion of portrait photography. Also she works as an event photographer for several agancies.
Aside from her commercial work she engages in independent projects such as fashion editorials and experimental photography.
Wishing to combine her love for photography and techno, she applied as a festival photographer at Garbicz Festival in 2018. That was how the collaboration with ArtesMobiles started.
studied French and English literature as well as photography in Leipzig, Berlin, Gießen and Montpellier. Her photographs have been exhibited internationally in cities such as Arles, Toronto, Bratislava, Auckland, Monaco and Kuusamo. In addition to her fine art projects, the language and photo artist has been travelling the world with a self-made wooden camera since 2016. Eli captures her encounters at art and cultural events, festivals and on the street in analogue portraits that are instantly developed. The finished prints from the mobile darkroom are then sent as a travelling exhibition in all directions.
bobjones.de / @bobjones.berlin
further projects: Galeria Iluzja, CCC, Behind Walls, Lato Meio-Residenz
completed her Bachelor of Arts degree in integrated design at Anhalt University of Applied Sciences. She is employed as a graphic designer and she works in interdisciplinary exchange with other artists on independent projects in Leipzig. Her favourite colour is green.
is studying communication and media sciences at the University of Leipzig and gaining experience in the field of PR and public relations. She has always been interested in theatre and creative work, as well as in the process of developing different projects and the interaction of all participants.
With the kind support of the residency program of HELLERAU-European Center for the Arts, Dresden.