LISTEN TO THE VOICES OF VR PODCAST
“First, many models tend to focus heavily on perceptual issues while focusing less attention other facets of virtual experiences, such as cognition and emotion,” he says. Second, “these models fail to provide an interpretable, extensible framework with which to understand and apply the theoretical principles to practical applications.”
Chertoff finished his Ph.D. thesis titled Exploring Additional Factors of Presence in 2009, and then published his Virtual Experience Test questionnaire in the 2010 proceedings of the IEEE Virtual Reality Conference. Presence researcher Richard Skarbez first alerted me to Chertoff’s work after I asked him if he’d seen any prior research into Presence looking at the different dimensions of my elemental theory of presence, which breaks down the subjective quality of an experience of VR into different combinations of Embodied Presence, Emotional Presence, Active Presence, and Social & Mental Presence. I was encouraged to see that Chertoff had independently come to an identical framework through his survey that was designed to holistically “measure virtual environment experiences based upon the five dimensions of experiential design: sensory, affective, active, relational, and cognitive.”
I had a chance to catch up with Chertoff in San Francisco during GDC this year, and we each concluded that our experiential design frameworks are functionally equivalent. We talked about his FearlessVR company that he co-founded where they design VR exposure therapy experiences for different phobias, but we spend the bulk of our discussion exploring how he came to looking to looking at the field of experiential design to inform Presence theory. We also compare and contrast how each of our experiential design frameworks create tradeoffs and amplify different qualitative dimensions of an experience.
Chertoff’s Ph.D. thesis “Exploring Additional Factors of Presence” has a great survey of Presence research (see his summary graphic down below), as well as inspiration he’s drawn from flow theory and video game design frameworks like GameFlow. He summarizes Forlizzi and Battarbee’s definition of “experience” by saying it’s “something that can be articulated, named, and schematized within a person’s memory. Experiences of this type have beginnings and ends, but anticipation of, and reflection on, the experience may take place before or after the event.”
The idea of experiential design is that deeply immersive experiences form stronger memories, and that it’s easier for us to store new information along when we’ve had related experiences. Chertoff says, “Experiential designs are successful when they encourage people to create meaningful emotional and social connections—personal narratives that involve episodic memories, and positive associations with the artifacts of that experience.”
Chertoff cites Joseph Pine & James Gilmore’s book The Experience Economy as his source of inspiration for the five dimensions of his experiential design framework that make for a memorable and immersive experience, which map nicely over to my elemental theory of Presence.
Embodied Presence corresponds to Chertoff’s sensory dimension which he says “includes all sensory input—visual, aural, haptic, and so forth — as well as perception of those stimuli.” I’d also include different virtual body representations, as well as the virtual environmental components which help transport you into another world and trick your perceptual system into believing that you’re in another world. Most Presence researchers research embodied Presence as virtual reality uniquely stimulates our sensorimotor aspects of perception beyond what any other communications medium can do.
Emotional Presence corresponds to the affective dimension which “refers to a participant’s emotional state. For simulation, this dimension can be linked to the degree to which a person’s emotions in the simulated environment accurately mimic his or her emotional state in the same real-world situation.” For me, this includes the storytelling and narrative components as well as music, colors, symbols, and deeper myths that all engage the emotions. Emotional Presence can also come into the experience through social engagement with other people.
Mental Presence corresponds to the cognitive dimension, which “encompasses all mental engagement with an experience, such as anticipating outcomes and solving mysteries. For simulation, much of the cognitive dimension can be interpreted as task engagement, [which] is related to the intrinsic motivation, meaningfulness, and continuity (actions yielding expected responses) of an activity.” Game designers often talk about mental friction, and if there isn’t something in an experience to stimulate your mind then you’ll risk getting bored.
Social Presence corresponds to the relational dimension, which is “composed of the social aspects of an experience. For simulation, this can be operationalized as co-experience — creating and reinforcing meaning through collaborative experiences… Experiences that are created or reinforced socially are usually stronger than individual experiences and they further enable individuals to develop personal and memorable narratives.” I combine mental & social Presence into the air element, because they both deal with the abstractions of thought and communication. But it also emphasizes the fact that not every experience has to have a social dimension to it, and that solitary experiences can be just as immersive and engaging to your mind.
Finally, Active Presence corresponds to the active dimension, which Chertoff described in the interview the degree to which you can express your agency, and physical engagement through taking action within the experience. He also sees it as a form of subjective engagement by saying “Does he or she incorporate the experience into his or her personal narrative; does he or she form meaningful associations via the experience?”
Chertoff assigns a few things to the active dimension that I would categorize elsewhere. For example, I think empathy is more of a function of emotional engagement, and that connection to the environment, avatars, and identity are more related to embodied Presence. I tend to think of active Presence being primarily as an expression of agency and will that includes exploration, curiosity, creativity, physical or virtual locomotion, and any type of interactivity.
There are qualitative dimensions of an experience that are sometimes hard to clearly schematize into a single category, and I believe that all of these different dimensions are happening at the same time all the time. But I do see that there are tradeoffs between active Presence and emotional Presence that I explore in much more detail in this introductory essay about elemental theory of Presence.