vocaloid Tag

LEV festival Matadero

My interactive biodata-driven VR work Project H.E.A.R.T. made in collaboration with Alex M Lee will be on view at LEV festival  Matadero in Madrid, Spain from September 24-27, 2020.

 

project heart mousepad preview

ABOUT LEV

L.E.V. (Laboratorio de Electrónica Visual) is a platform specialized in the production and promotion of electronic sound creations, and its relationship with visual arts. It was a European pioneer in this field, and since more than 13 years ago, it tries to converge the natural synergy between image and sound, and the new artistic trends, making special emphasis on live actions.

LEV develops the L.E.V. Festival (in Gijón) and specific, delocalized shows called LEVents. Through both proceedings, the platform reaches its goal: to provide an eclectic, panoramic vision of the current state of creation and all its connections, in an ever-evolving environment. That is why LEV focalizes its work both on international artists that are leaders in audiovisual creativity and local artists, both pioneers and new talents.

 

Artist Project Toronto

?Project H.E.A.R.T. (Holographic Empathy Attack Robotics Team)? (2017) made by Erin Gee in collaboration with Alex M Lee is featured as part of the Telegenic booth at Artist Project Toronto. Our booth is just left of the entrance (can’t miss it) and is part of a sponsored exhibition with six other exciting new media artists.

Much thanks to EQ Bank, Telegenic, Radiance VR, and House of VR for sponsoring and organizing the exhibit. ☠️

 

Elektra Festival Montreal

Project H.E.A.R.T. (Holographic Empathy Attack Robotics Team) (2017), my popstar/militainment VR game mashup with an affective control interface made in collaboration with Alex M Lee, is going to be featured at the upcoming Elektra festival XX in Montreal!  Look for it this June!

 

Exhibition opening: June 7, 6pm-9pm

Exhibition Dates: June 7-15, 2019

Perte de Signal 5445 Avenue de Gaspé local #107, Montréal, QC H2T 3B2, Canada

 

Click here to check out the full programming of Elektra Festival 2019

Future Perfect @ Hygienic Gallery

My work for VR and biosensor controller, Project H.E.A.R.T. (2017) has been selected for an exhibition at Hygienic Gallery, New London, Connecticut.

Exhibition: February 16 – March 3, 2018
Hygienic Art Gallery, 79 Bank Street, New London, Connecticut, www.hygienic.org.
Opening Reception: Friday, Feb. 16, 4:30 – 9 p.m.

Selected works from Intersections: the 16th Biennial Symposium on Arts & Technology

It is increasingly understood that our lives are pushed, pulled and interconnected by a range of intersections among multiple factors of identity and experience including: gender, culture, race, sexuality, and economic and technological contexts, among others.

Future Perfect includes a roster of artists from around the world, whose work explores the complex forces pushing and pulling our technological culture, and our own identities within it. Their work speculates on present and future fusions and intersections between our rich internal worlds, our bodies, our relationships, and the strange inner lives of artificial intelligences, data clouds and social algorithms.

Through works across mediums such as virtual reality video games, social media performance, experimental documentary, interactive sculpture, locally produced audio tours, and more, the artists in the show ask and offer their own answers to questions such as:

  • What if our machines touch and activate us just as much as we them?
  • What if they could read our emotions, respond to our bodies, and perhaps try to change us back? Are they doing it already?
  • What if we downloaded a digital version of all the objects in the world? Where would it be stored? Are we slowly converting our planet into data? At what cost?
  • How will this city look, feel, and sound, in 10, 20, 100 years?
  • What will you do if the world ends tomorrow?

Featured artists

Angela Ferraiolo
Eunsu Kang
Erin Gee and Alex Lee
Luis Mejico
Ricardo Miranda
Veronica Mockler
Shalev Moran, Mushon Zer-Aviv and Milana Gitzin-Adiram
Juan Pablo Pacheco
Mina Rafiee
Joyce Rudinsky
Laura Skocek and Christoph Gruber
Jack Stenner
Jeff Thompson
Jenny Vogel

Credits

Gallery Director, Hygienic Gallery: Sarah McKay
Curator: Nadav Assor
Installation manager: Brian Dimmock

Production support provided by the Ammerman Center for Arts and Technology, Connecticut College.  Additional support from the College’s Center for the Critical Study of Race and Ethnicity, the Office of Institutional Equity and Inclusion, and the Office of the Dean of the College.

 

Review in Canadian Art

I really appreciate this article by Tatum Dooley for Canadian Art on the Worldbuilding exhibition curated by John G Hampton and Maiko Tanaka at Trinity Square Video. My work Project H.E.A.R.T. which highlights VR and emotions made with Alex M Lee is featured, among other great works by Jeremy Bailey Kristen D Schaffer Eshrat Erfanian and Yam Lau.  Following is an excerpt from the article:

“The gamification of our bodies renders the physical form void, replaced by screens where our bodies and emotions can be morphed and manipulated. Perhaps the only way to create art with technology as advanced and recent as VR is to reckon with its potential consequences.

Gee’s project, the most realized out of the four artists in the exhibition, masters this reckoning. I spoke with Gee in the lead-up to the exhibition, and she explained the conceptual backbone of the piece. “I’m working through questions of emotional sincerity when it comes to self-help. In theory, if you can technologically master your emotions, if you can just make yourself excited, then you can make yourself a better, happier person. I don’t know how sincere that is…”

Click on the link below for the full article.

VR and the Failure of Self-Help Technology

In general, I feel very proud of this work but also very exhausted by it.  Through the project I’ve been working through the relationship between pop music and war, self help and sincerity, and ultimately I’m working through these issues of technique and technology in how life and trauma comes to us.  During the panel for the exhibition, there was a question of whether I was “pro-war”, and it’s one that I have received a few times in facebook messages from curious friends from far away.  The project is complex and difficult to read because I think it has to be.  It reflects my own mediatized understanding of international conflict, maybe my own frustration at my lack of understanding.

The best I can understand war is how it is mediated to me: through video games and news cycles, through abstract discussions on the radio. The goal of this project was never to address the terror and complexity of geopolitical conflict, but rather, to propose a psychedelic pop culture mirror, imagining a video game ruled not by characters that espouse self-righteous violence and grit, but technologically manipulated empathy and enthusiasm.  This game fails to address war in the same way that all technologically mediated attempts to do so fail to address war.  I also am also dissatisfied at the idea of an artistic protest that makes a cartoonish, morally didactic utopia where rainbows and love shoot out of guns instead of flesh-tearing bullets. I think the answer about the politics of this game lie in the end screen: an abstract screen that confronts you with statistics of death and trauma as a result of the battle itself.  I don’t think there is a way to win the game.

WorldBuilding: TSV Toronto

November 3rd – December 9th 2017

Trinity Square Video, 401 Richmond, Toronto Canada.

My work made in collaboration with 3D artist Alex M. Lee for VR and emotional-biosensors, Project H.E.A.R.T. (2017) was debuted on November 5th at Trinity Square Video, Toronto.

This project was commissioned by TSV by curators John Hampton and Maiko Tanaka, thanks to the support of the Canada Council for the Arts. The exhibition also features amazing works by Canadian artists Jeremy Bailey and Kristen Schaffer, Eshrat Erfanian, and Yam Lau.

Visit the Worldbuilding website by clicking here.

 

Project H.E.A.R.T.

Project H.E.A.R.T. (2017)

2017

A biodata-driven VR game where militainment and pop music fuel a new form of emotional drone warfare.

A twist on popular “militainment” shooter video games, Project H.E.A.R.T. invites the viewer to place their fingers on a custom biodata device, and summon their enthusiasm to engage their avatar, Yowane Haku, in “combat therapy.” Fans of the Vocaloid characters may recognize Haku as the “bad copy” of Japanese pop celebrity Hatsune Miku, a holographic personnage that invites her fans to pour their content and songs into her virtual voice.

The biosensing system features a pulse sensor, and a skin conductance sensor of Gee’s design. Through principles of emotional physiology and affective computing, the device gathers data relative to heart rate and blood flow from index finger, and skin conductance from middle and ring fingers of users. The biodata is read by a microcontroller and transferred to Unity VR, thus facilitating emotional interactivity: a user’s enthusiasm (spikes in signal amplitude in skin conductance, elevated heart rate, and shifts in amplitude of the pulse signal) stimulates the holographic pop star to sing in the virtual warzone, thus inspiring military fighters to continue the war, and create more enemy casualties. At the end of the experience the user is confronted with their “score” of traumatized soldiers vs enemies killed, with no information whether this means that they won or lost the “game”.

The user is thus challenged to navigate soldier’s emotional anxieties and summon their positivity to activate Haku’s singing voice as soldiers battle not only against a group of enemies, but also against their own lack of confidence in times of global economic instability.

The landscape of Project H.E.A.R.T. was built from geopolitically resonant sites found on Google Maps, creating a dreamlike background for the warzone. In-game dialogue wavers between self-righteous soldier banter typical of video games, and self-help, bringing the VR participant to an interrogation of their own emotional body in a virtual space that conflates war, pop music, drone technology, and perhaps movement-induced VR nausea.

As Kathryn Hamilton pointed out in her 2017 essay “Voyeur Realism” for New Inquiry,

“VR’s genesis and development is in the military, where it has been used to train soldiers in “battle readiness,” a euphemism for: methods to overcome the innate human resistance to firing at another human being. In the last few years, VR’s usage has shifted 180 degrees from a technology used to train soldiers for war, to one that claims to “amplify” the voices afflicted by war, and to affect “world influencers” who might be able to stop said wars.”

Credits

Narrative Design: Sofian Audry, Roxanne Baril-Bédard, Erin Gee
3D Art: Alex Lee and Marlon Kroll
Animation and Rigging: Nicklas Kenyon and Alex Lee
VFX: Anthony Damiani, Erin Gee, Nicklas Kenyon
Programming: Sofian Audry, Erin Gee, Nicklas Kenyon, Jacob Morin
AI Design: Sofian Audry
Sound Design: Erin Gee, Austin Haughton, Ben Hinckley, Ben Leavitt, Nicolas Ow
BioSensor Hardware Design: Erin Gee and Martin Peach
BioSensor Case Design: Grégory Perrin
BioSensor Hardware Programming: Thomas Ouellet Fredericks, Erin Gee, Martin Peach
Featuring music by Lazerblade, Night Chaser and Austin Haughton
Yowane Haku character designed by CAFFEIN
Yowane Haku Cyber model originally created by SEGA for Hatsune Miku: Project DIVA 2nd (2010)
Project H.E.A.R.T. also features the vocal acting talents of Erin Gee, Danny Gold, Alex Lee, Ben McCarthy, Gregory Muszkie, James O’Calloghan, and Henry Adam Svec.

Thanks to the support of the Canada Council for the Arts and AMD Radeon, this project was commissioned by Trinity Square Video for the exhibition Worldbuilding, curated by John G Hampton and Maiko Tanaka.

This project would have not been possible without the logistical and technical support of the following organizations:

Technoculture Art and Games Lab (Concordia University)

Concordia University

ASAP Media Services (University of Maine)

Exhibition history

November-December 2017  Worldbuilding @ Trinity Square Video, Toronto

February-March 2018 Future Perfect @ Hygienic Gallery, New London Connecticut

April 26-28, 2018 @ Digifest, Toronto

June 7-17, 2019 @ Elektra Festival, Montreal

January 2020 @ The Artist Project, Toronto

October 2020 @ Festival LEV Matadero, Spain

Links

Project H.E.A.R.T. official website
Worldbuilding Exhibition Website
Review in Canadian Art
My research blog: Pop and Militainment
Featured on Radiance VR

Video

Project H.E.A.R.T (2017)
Installation and Gameplay

Gallery

VR Commission Update

Here’s a sneak peek at some of the art developed last summer in a residency at the Technoculture Art and Games lab at Concordia University with lead 3D artist Alex Lee, AI designer Sofian Audry, art assistant Marlon Kroll, and research assistant Roxanne Baril-Bédard. Among holographic popstars who may or may not have their own consciousness to begin with, the project includes rhetorical analysis of post 9/11 counterterrorist video games, reality television, startup culture, and self-help manuals for improving emotional state.

I am implementing the Biosensor control system this Winter and plan on working on finalizing the game’s art, music and sounds this summer for a launch towards the end of 2017 in an exhibition at Trinity Square Video in Toronto.


In the future, weapons of war possess advanced AI systems, systems that guarantee successful automated combat on behalf of soldiers wielding the technology.  The military still trains its soldiers in case of equipment failure, but at this point, fighters function more as passive operators. The terrorist threat has nothing similar to this technology in their ranks, and the effectiveness of our systems is swift and deadly.  Historically, our soldiers manning the machines have never witnessed violence or devastation at this scale: the largest threat to soldiers today defending our nation’s values is Post Traumatic Stress Syndrome.

To address this unfortunate state of affairs, the military developed a startup fund open to the public to resolve this issue through technological innovation.  Significant scholarships and research funding was provided for researchers interested in devoting time to creating a means towards mitigating the psychological crisis.  A risky but intriguing proof of concept was eventually presented: the creation of a revolutionary entertainment for the troops as they fought the terrorist threat.

Yowane Haku became the face of this entertainment: a mobile holographic pop star engineered specifically for psychological distraction on the battlefield.  

The world’s most talented engineers, design consultants, and pop writing teams were assembled to enshrine Haku with every aesthetic and technical element to impress not only the troops, but the world with her next-generation technology.  However, the initial test-run of this mobile holographic pop medium in combat trials was….a failure.  

On the battlefield, Haku’s perfect body glowed faintly amongst the dust and screams, bullets and explosions passing ineffectually, dance moves precise, vocalizations on point. But ultimately her pop music performance lacked resonance with the battle.  Instead of the soldiers being emboldened by this new entertainment, which was intended to distract or inspire them from their gruesome tasks, their adverse psychological symptoms…flourished.  Some of the men went mad, laughing maniacally in tune with the holographic presence smiling sweetly at them.  It was only due to the superiority of our AI weaponry and automated drone operation that the morally corrupt foreign threat, with their violent and technologically crude methods, were stopped that day. The minds of our soldiers were lost.

Months later, a young pool of startup professionals would provide another solution.  This vocal minority of engineers…though others called them crazy….had a hunch. For the hologram pop star to “work,” her systems needed access pure emotion, to link a human element with the trauma of the human soldiers.  But it was not clear who, or what, could best provide this emotional link…and what amount of embodied “disruption” this might entail…

This enthusiastically crowdfunded group of millennials completed their groundbreaking research without the strings of ethics funding or institutional control.  Human emotions and consciousness now flow direct to Haku via experimental trials in VR technology.  Haku rises again on the battlefront.

Simultaneously, a new reality television show has been borne of these first human trials. The star of this reality show could be…….you.

Could you be the next American Sweetheart?  Do you have what it takes to provide 110% Best Emotional Performance?  Join us through advanced VR technologies, Live and Direct on the battlefield, to find out if you could be fit to man the ultimate weapon of war: Our Next Holographic Idol.

This project is supported by the Canada Council for the Arts and Trinity Square Video’s AMD VR lab
Erin Gee - Vocaloid Gig At Nocturne (X + 1)

Gig Vocaloid

Gig Vocaloid (2015)
Vocaloid Gig At Nocturne (X + 1)

2015

A video-text pop band from a dystopic future where the human voice is lost and pop music reigns supreme.

Virtual voices are key for these pop stars. Dancing, costumed performers carry tablets that display the human larynx and song lyrics as they dance in sync.

The project is inspired by virtual pop stars such as Hatsune Miku, which exist equally as distributed visual media avatar (holograms, merchandise), and as digital software tools for public, fan-based synthesized vocal creation. GIG VOCALOID is also inspired by boy and girl pop bands, whereupon individual voices and musicality are often superseded by a pop “character.” This is especially true in Japanese pop group AKB48, which has 48 female members whom are voted upon by the public for the right to solo singing and “leadership” within the group.

In this pop music context, celebrity character, fashion and visual appeal is more important than the human singing voice itself, which is often replaced by synthesizers and pitch correction. GIG VOCALOID invokes a fantasy posthumanist future where the human voice is lost, subjectivity is dead, and everyone is celebrating.

Externalizing the human voice outside of the preciousness of the human body, the human larynx (typically a hidden, interior aspect of vocal performance) is displayed prominently on tablets. “Lyrics” to their song flash aleatorically through these videos, which enable humans performers to be the support for digital artwork. GIG VOCALOID re-localizates the voice beyond the borders of the flesh body in an infectious avatar-dream.

Performance history

GIG VOCALOID is a virtual pop band that had its first performance at the Musée d’art Contemporain de Montreal in February 2015 at X + 1: an evening of Internet-inspired art.

Gallery

Gig Vocaloid (2015)
Vocaloid Gig At Nocturne (X + 1)