biosensors Tag

Algorithms that Matter @ IEM Graz

I’ve been selected to be a featured artist in residence at the Institut für Elektronische Musik und Akustik (IEM) in Graz, Austria, participating in the Algorithms that Matter Residency from April-June 2018.

From the ALMAT website:

“Algorithms that Matter is an artistic research project by Hanns Holger Rutz and David Pirrò.  It aims at understanding the increasing influence of algorithms, translating them into aesthetic positions in sound, building a new perspective on algorithm agency by subjecting the realm of algorithms to experimentation.

Almat is grounded in the idea that algorithms are agents that co-determine the boundary between an artistic machine or “apparatus” and the object produced through this machine. The central question is: How do algorithmic processes emerge and structure the praxis of experimental computer music? The hypothesis is that these processes, instead of being separated from the composer—as generators and transformers of infinite shapes—exhibit a specific force that retroacts and changes the very praxis of composition and performance.”

 

I will use this opportunity to extend my reach into exciting new forms of embodied algorithmicity, developing new techniques for combining physiological markers of emotion with algorithmic agencies.

Digifest Toronto

Thu, 04/26/2018 –
Sat, 04/28/2018

CORUS QUAY

25 Dockside Dr
ON M5A 1B6 Toronto


Presented by the Goethe-Institut Toronto
Curated by Tina Sauerländer (Berlin) and Erandy Vergara (Montreal)

Project H.E.A.R.T. by Erin Gee and Alex M. Lee
Enter Me Tonight by Li Alin
 
At the invitation of the Goethe-Institut curators Tina Sauerländer and Erandy Vergara have selected VR works for this year’s Toronto Digifest, including two recent pieces by Berlin-based Canadian artist Li Alin and Montreal-based artist Erin Gee in collaboration with South Korean-born, US-based artist Alex M. Lee. The artists use humor and irony to engage in controversial topics: emotions in first-person shooter video games and war in the case of Gee, and a futuristic exploration on human reproduction in technology-oriented times in the case of Alin.

The audience itself explores Gee’s H.E.A.R.T., a virtual work where you have to control your emotions to control the leading character in a war-related VR game, as well as Alin’s Enter Me Tonight, a VR environment engaged with issues on human reproduction, economy, biology, pornography and technology.

In a contextualizing event, the curators will speak about the history of VR and current trends and critical perspectives on this technology.

Digifest 2018 website

Event information courtesy of Goethe Institute

New World Notes

Project H.E.A.R.T. (2018) was written about by Wagner James Au in his New World Notes blog on virtual worlds. I’m particularly tickled about this because he is the official blogger for the virtual world Second Life, so I’m very honored that he finds the world of Project H.E.A.R.T. interesting!

Wagner James Au, consultant and author of “The Making of Second Life” (HarperCollins) and “Game Design Secrets” (Willey) reports on virtual worlds, VR and related topics — including augmented reality, virtual currency, games and game development, and their appearances in RL popular culture and politics.

Click here to see the article

Rhode Island College

“// lonely avatar”, is an exhibition which investigates the use, meaning, and expressive potential of avatars in the contemporary digital landscape. “Lucid Dreaming” ruminates on the emptiness of the virtual avatar whilst “Project H.E.A.R.T.” involves filling that empty avatar with your emotion through a specially designed biosensor. Both projects follow a trajectory of thought in regards to the metaphorical potential of avatars in the virtual space. Curated by Frank Yefeng Wang, this show features works by Alex M Lee commissioned by Trinity Square Video in Toronto, ON and a project made in collaboration with Canadian artist Erin Gee.

Opening reception: 5-8pm
Artist Lecture: 7-7:30pm

The Chazan Family Gallery
Alex & Ani Hall
Rhode Island College
600 Mt. Pleasant Ave
Providence, RI 02908

BioPUNKS residency @ UMaine

I have been invited as Research Associate to work with the department of chemical and biological engineering at the University of Maine to initiate a new electronics prototyping group as part of a residency within their department from January until April 2018.

BioPUNKS (Prototyping Ur New Knowledge of Sensors) is an extra-curricular electronics workshop that meets once a week, and is open to all chemical and biological students from freshman to senior.

Based on core values of Sharing, Learning, and Curiosity, our goals are to:

  1. Learn from each other
  2. Develop unique student-led projects at the frontier of bioengineering and electronics
  3. Develop open-source tools for the larger DIY community.

For more information, click here to access the BioPUNKS website

Future Perfect @ Hygienic Gallery

My work for VR and biosensor controller, Project H.E.A.R.T. (2017) has been selected for an exhibition at Hygienic Gallery, New London, Connecticut.

Exhibition: February 16 – March 3, 2018
Hygienic Art Gallery, 79 Bank Street, New London, Connecticut, www.hygienic.org.
Opening Reception: Friday, Feb. 16, 4:30 – 9 p.m.

Selected works from Intersections: the 16th Biennial Symposium on Arts & Technology

It is increasingly understood that our lives are pushed, pulled and interconnected by a range of intersections among multiple factors of identity and experience including: gender, culture, race, sexuality, and economic and technological contexts, among others.

Future Perfect includes a roster of artists from around the world, whose work explores the complex forces pushing and pulling our technological culture, and our own identities within it. Their work speculates on present and future fusions and intersections between our rich internal worlds, our bodies, our relationships, and the strange inner lives of artificial intelligences, data clouds and social algorithms.

Through works across mediums such as virtual reality video games, social media performance, experimental documentary, interactive sculpture, locally produced audio tours, and more, the artists in the show ask and offer their own answers to questions such as:

  • What if our machines touch and activate us just as much as we them?
  • What if they could read our emotions, respond to our bodies, and perhaps try to change us back? Are they doing it already?
  • What if we downloaded a digital version of all the objects in the world? Where would it be stored? Are we slowly converting our planet into data? At what cost?
  • How will this city look, feel, and sound, in 10, 20, 100 years?
  • What will you do if the world ends tomorrow?

Featured artists

Angela Ferraiolo
Eunsu Kang
Erin Gee and Alex Lee
Luis Mejico
Ricardo Miranda
Veronica Mockler
Shalev Moran, Mushon Zer-Aviv and Milana Gitzin-Adiram
Juan Pablo Pacheco
Mina Rafiee
Joyce Rudinsky
Laura Skocek and Christoph Gruber
Jack Stenner
Jeff Thompson
Jenny Vogel

Credits

Gallery Director, Hygienic Gallery: Sarah McKay
Curator: Nadav Assor
Installation manager: Brian Dimmock

Production support provided by the Ammerman Center for Arts and Technology, Connecticut College.  Additional support from the College’s Center for the Critical Study of Race and Ethnicity, the Office of Institutional Equity and Inclusion, and the Office of the Dean of the College.

 

Review in Canadian Art

I really appreciate this article by Tatum Dooley for Canadian Art on the Worldbuilding exhibition curated by John G Hampton and Maiko Tanaka at Trinity Square Video. My work Project H.E.A.R.T. which highlights VR and emotions made with Alex M Lee is featured, among other great works by Jeremy Bailey Kristen D Schaffer Eshrat Erfanian and Yam Lau.  Following is an excerpt from the article:

“The gamification of our bodies renders the physical form void, replaced by screens where our bodies and emotions can be morphed and manipulated. Perhaps the only way to create art with technology as advanced and recent as VR is to reckon with its potential consequences.

Gee’s project, the most realized out of the four artists in the exhibition, masters this reckoning. I spoke with Gee in the lead-up to the exhibition, and she explained the conceptual backbone of the piece. “I’m working through questions of emotional sincerity when it comes to self-help. In theory, if you can technologically master your emotions, if you can just make yourself excited, then you can make yourself a better, happier person. I don’t know how sincere that is…”

Click on the link below for the full article.

VR and the Failure of Self-Help Technology

In general, I feel very proud of this work but also very exhausted by it.  Through the project I’ve been working through the relationship between pop music and war, self help and sincerity, and ultimately I’m working through these issues of technique and technology in how life and trauma comes to us.  During the panel for the exhibition, there was a question of whether I was “pro-war”, and it’s one that I have received a few times in facebook messages from curious friends from far away.  The project is complex and difficult to read because I think it has to be.  It reflects my own mediatized understanding of international conflict, maybe my own frustration at my lack of understanding.

The best I can understand war is how it is mediated to me: through video games and news cycles, through abstract discussions on the radio. The goal of this project was never to address the terror and complexity of geopolitical conflict, but rather, to propose a psychedelic pop culture mirror, imagining a video game ruled not by characters that espouse self-righteous violence and grit, but technologically manipulated empathy and enthusiasm.  This game fails to address war in the same way that all technologically mediated attempts to do so fail to address war.  I also am also dissatisfied at the idea of an artistic protest that makes a cartoonish, morally didactic utopia where rainbows and love shoot out of guns instead of flesh-tearing bullets. I think the answer about the politics of this game lie in the end screen: an abstract screen that confronts you with statistics of death and trauma as a result of the battle itself.  I don’t think there is a way to win the game.

Ideas Lab Denmark

I will be giving a unique and in-depth workshop hosted by Emotional Data Lab (Aarhus University), Interactive Denmark and Ideas Lab in Aarhus, Denmark from November 21-23.  The workshop consists of 3 three-hour sessions where I will share my materials and experiences with incorporating physiological markers of emotion into the VR-compatible Unity environment.

Participants will be placed into “teams” in order to work together, experiment, and discuss the promises, problems and potential of using biosensors to capture a user’s emotional experience through digital tools.

Project H.E.A.R.T.

A twist on popular “militainment” shooter video games, Project H.E.A.R.T. invites the viewer to place their fingers on a custom biodata device, and summon their enthusiasm to engage their avatar, Yowane Haku, in “combat therapy.” Fans of the Vocaloid characters may recognize Haku as the “bad copy” of Japanese pop celebrity Hatsune Miku, a holographic personnage that invites her fans to pour their content and songs into her virtual voice.

The biosensing system features a pulse sensor, and a skin conductance sensor of Gee’s design. Through principles of emotional physiology and affective computing, the device gathers data relative to heart rate and blood flow from index finger, and skin conductance from middle and ring fingers of users. The biodata is read by a microcontroller and transferred to Unity VR, thus facilitating emotional interactivity: a user’s enthusiasm (spikes in signal amplitude in skin conductance, elevated heart rate, and shifts in amplitude of the pulse signal) stimulates the holographic pop star to sing in the virtual warzone, thus inspiring military fighters to continue the war, and create more enemy casualties. At the end of the experience the user is confronted with their “score” of traumatized soldiers vs enemies killed, with no information whether this means that they won or lost the “game”.

The user is thus challenged to navigate soldier’s emotional anxieties and summon their positivity to activate Haku’s singing voice as soldiers battle not only against a group of enemies, but also against their own lack of confidence in times of global economic instability.

The landscape of Project H.E.A.R.T. was built from geopolitically resonant sites found on Google Maps, creating a dreamlike background for the warzone. In-game dialogue wavers between self-righteous soldier banter typical of video games, and self-help, bringing the VR participant to an interrogation of their own emotional body in a virtual space that conflates war, pop music, drone technology, and perhaps movement-induced VR nausea.

 

 

As Kathryn Hamilton pointed out in her 2017 essay “Voyeur Realism” for New Inquiry,

“VR’s genesis and development is in the military, where it has been used to train soldiers in “battle readiness,” a euphemism for: methods to overcome the innate human resistance to firing at another human being. In the last few years, VR’s usage has shifted 180 degrees from a technology used to train soldiers for war, to one that claims to “amplify” the voices afflicted by war, and to affect “world influencers” who might be able to stop said wars.”

Photography by Toni Hafkenscheid.  Images of Worldbuilding exhibition courtesy of Trinity Square Video, 2017.

Exhibition history:
November-December 2017 Worldbuilding @ Trinity Square Video, Toronto
February-March 2018 Future Perfect @ Hygienic Gallery, New London Connecticut
April 26-28, 2018 @ Toronto Digifest, Toronto

Credits

Narrative Design: Sofian Audry, Roxanne Baril-Bédard, Erin Gee

3D Art: Alex Lee and Marlon Kroll

Animation and Rigging: Nicklas Kenyon and Alex Lee

VFX: Anthony Damiani, Erin Gee, Nicklas Kenyon

Programming: Sofian Audry, Erin Gee, Nicklas Kenyon, Jacob Morin

AI Design: Sofian Audry

Sound Design: Erin Gee, Austin Haughton, Ben Hinckley, Ben Leavitt, Nicolas Ow

BioSensor Hardware Design: Erin Gee and Martin Peach

BioSensor Case Design: Grégory Perrin

BioSensor Hardware Programming: Thomas Ouellet Fredericks, Erin Gee, Martin Peach

Featuring music by Lazerblade, Night Chaser and Austin Haughton

Yowane Haku character designed by CAFFEIN

Yowane Haku Cyber model originally created by SEGA for Hatsune Miku: Project DIVA 2nd (2010)

Project H.E.A.R.T. also features the vocal acting talents of Erin Gee, Danny Gold, Alex Lee, Ben McCarthy, Gregory Muszkie, James O’Calloghan, and Henry Adam Svec.

Thanks to the support of the Canada Council for the Arts and AMD Radeon, this project was commissioned by Trinity Square Video for the exhibition Worldbuilding, curated by John G Hampton and Maiko Tanaka.

This project would have not been possible without the logistical and technical support of the following organizations:

Technoculture Art and Games Lab (Concordia University)

Concordia University

ASAP Media Services (University of Maine)

WorldBuilding: TSV Toronto

November 3rd – December 9th 2017

Trinity Square Video, 401 Richmond, Toronto Canada.

My work made in collaboration with 3D artist Alex M. Lee for VR and emotional-biosensors, Project H.E.A.R.T. (2017) was debuted on November 5th at Trinity Square Video, Toronto.

This project was commissioned by TSV by curators John Hampton and Maiko Tanaka, thanks to the support of the Canada Council for the Arts. The exhibition also features amazing works by Canadian artists Jeremy Bailey and Kristen Schaffer, Eshrat Erfanian, and Yam Lau.

Visit the Worldbuilding website by clicking here.