Project H.E.A.R.T. Tag

Project H.E.A.R.T.

Project H.E.A.R.T. is the code name for the Holographic Empathy Attack Robotics Team, and also a biosensor-driven virtual reality artwork developed by Erin Gee in collaboration with 3D artist Alex M. Lee for use with the Oculus Rift in conjunction with a custom biosensor controller created by Gee.  The game was commissioned by Trinity Square Video for the exhibition Worldbuilding in November 2017.

A twist on popular “militainment” shooter video games, Project H.E.A.R.T. invites the viewer to place their fingers on a biodata gathering device and then summon their enthusiasm in order to direct their avatar, Yowane Haku, in “combat therapy.” Fans of the Vocaloid characters may recognize Haku as the “bad copy” of Japanese pop celebrity Hatsune Miku, a holographic personnage that invites her fans to pour their content and songs into her virtual voice.

The colorful landscape of the game was built from photogrammetric processes taken from geopolitically resonant sites found on Google Maps, creating a dreamlike background for dialogue and self-help on quotidian struggles as one manages their emotional states to continue onward.

A biosensor device developed especially for this work gathers the human player’s positivity and energy to drive Haku’s voice forward to boost morale as the soldiers battle not only against a group of enemy soldiers, but also against their own lack of confidence and rising anxieties.

As Kathryn Hamilton pointed out in her 2017 essay “Voyeur Realism” for New Inquiry,

“VR’s genesis and development is in the military, where it has been used to train soldiers in “battle readiness,” a euphemism for: methods to overcome the innate human resistance to firing at another human being. In the last few years, VR’s usage has shifted 180 degrees from a technology used to train soldiers for war, to one that claims to “amplify” the voices afflicted by war, and to affect “world influencers” who might be able to stop said wars.”

The dialogue and interactions in the work invoke the promise and the limits of technologically mediated empathy and sincerity, while simultaneously bringing the VR participant back to an interrogation of their own emotional body in a virtual space that conflates war, pop music, video games, emotional investment, and perhaps virtual-movement induced nausea.

Narrative Design: Sofian Audry, Roxanne Baril-Bédard, Erin Gee

3D Art: Alex Lee and Marlon Kroll

Animation and Rigging: Nicklas Kenyon and Alex Lee

VFX: Anthony Damiani, Erin Gee, Nicklas Kenyon

Programming: Sofian Audry, Erin Gee, Nicklas Kenyon, Jacob Morin

AI Design: Sofian Audry

Sound Design: Erin Gee, Austin Haughton, Ben Hinckley, Ben Leavitt, Nicolas Ow

BioSensor Hardware Design: Erin Gee and Martin Peach

BioSensor Case Design: Grégory Perrin

BioSensor Hardware Programming: Thomas Ouellet Fredericks, Erin Gee, Martin Peach

Featuring music by Lazerblade, Night Chaser and Austin Haughton

Yowane Haku character designed by CAFFEIN

Yowane Haku Cyber model originally created by SEGA for Hatsune Miku: Project DIVA 2nd (2010)

Project H.E.A.R.T. also features the vocal acting talents of Erin Gee, Danny Gold, Alex Lee, Ben McCarthy, Gregory Muszkie, James O’Calloghan, and Henry Adam Svec.

Thanks to the support of the Canada Council for the Arts and AMD Radeon, this project was commissioned by Trinity Square Video for the exhibition Worldbuilding, curated by John G Hampton and Maiko Tanaka.

This project would have not been possible without the logistical and technical support of the following organizations:

Technoculture Art and Games Lab (Concordia University)

Concordia University

ASAP Media Services (University of Maine)

WorldBuilding: TSV Toronto

My work made in collaboration with 3D artist Alex M. Lee for VR and emotional-biosensors, Project H.E.A.R.T. (2017) was debuted on November 5th at Trinity Square Video, Toronto.

This project was commissioned by TSV by curators John Hampton and Maiko Tanaka, thanks to the support of the Canada Council for the Arts. The exhibition also features amazing works by Canadian artists Jeremy Bailey and Kristen Schaffer, Eshrat Erfanian, and Yam Lau.

You can see Worldbuilding for yourself from November 3rd – December 9th 2017 at Trinity Square Video, 401 Richmond, Toronto Canada.

Visit the Worldbuilding website by clicking here.