Designing Mixed Reality for Human Perception: A Practical Guide

At Input Output, we make art for humans using technology — a line that steers every project in our creative media lab. Mixed reality is potent, yet it succeeds only when it honors how people truly see, move, and feel. This guide lays out the practical principles behind how we research, design, and develop mixed reality experiences.

Begin with the body, not the headset

Before we launch a game engine or prototype even one interaction, we consider how the experience will feel physically. Where will people stand? Will they walk, reach, or turn? How long will they stay in the space? Mixed reality demands a great deal of attention and balance, so comfort comes first in our design.

In practice, this means:

• Charting the physical space and its limits before designing any virtual content.
• Placing core interactions within easy reach and a comfortable field of view.
• Testing early with real people in the actual space, not only at a desk.
• Adding rest points and natural exits so participants never feel stuck.

Aim for perceptual plausibility, not photorealism

Viewers will accept stylized visuals far more easily than they will accept physics that feels wrong. A floating object with no shadow, or a hand that slips through a wall, shatters presence faster than a simple art style ever could. We favor perceptual cues — steady lighting, grounded shadows, believable scale, and responsive sound — over raw polygon counts.

When virtual and physical elements share a space, we align them with care. A virtual object sitting on a real table should feel as though it belongs there. Sound should originate where the eye expects it. These small consistencies build immersion more than any single high-fidelity asset.

Treat the physical space as a collaborator

Mixed reality is a dialogue between the real and the virtual. The room is not an obstacle to dodge; it is material. We scan and study each space, then let its architecture, light, and objects shape the design. A pillar can become a landmark. A window can become a light source for a virtual scene. A quiet corner can become a moment of pause.

This approach also makes experiences safer and more accessible. Designing with the room rather than against it reduces collisions, disorientation, and the need for elaborate setup.

Prototype in the medium, early and often

Mixed reality cannot be fully judged on a screen. We build rough, testable prototypes as early as possible and place them before people in the target environment. Paper sketches and 3D mockups help, but they cannot show how a space feels once virtual content is layered over it.

Our prototyping loop is straightforward: build a small slice, test it in context, watch where attention and comfort break down, then revise. We keep prototypes lightweight so we can iterate quickly and avoid over-investing in ideas that do not hold up with real bodies in real rooms.

Make the invisible visible

One of mixed reality's greatest rewards is its power to reveal what is normally hidden: airflow, sound fields, data, memory, or the history of a place. As artists and researchers, we seek out these invisible layers and ask how technology can make them perceptible without overwhelming the viewer.

Restraint matters here. One well-placed reveal often lands harder than a crowded scene. We design moments of discovery rather than constant stimulation, leaving people room to notice, interpret, and feel.

Build for humans first, then optimize

Performance matters, but it should serve the human experience rather than dictate it. We first set a bar for comfort and clarity, then optimize rendering, tracking, and interaction to meet it. If a technical shortcut compromises how the experience feels, we find another route.

This human-first discipline is what we mean by making art for humans using technology. The technology is extraordinary, but it is only as good as the experience it gives the person inside it.

If you are exploring a mixed reality project and want to design it around real human perception, we would love to hear from you. Input Output is a creative media lab that researches, designs, and develops mixed reality experiences — and we are always open to new collaborations.