Fiery Hands: Designing Thermal Glove through Thermal and Tactile Integration for Virtual Object Manipulation

Fri, 11 Oct 2024 00:00:00 +0000

TL;DR

A wearable VR glove that lets you feel a virtual fireball, touch a hot mug, or rest your palm on cold metal — without obstructing how your fingers move. We placed the thermal actuators on the outside of the hand and used a perceptual illusion (thermal referral + tactile masking) to project the sensation back to the palm and fingertips, where it actually feels meaningful. Three user studies confirm the illusion holds, the patterns read clearly, and the experience makes VR substantially more immersive — all at lower power and bulk than a fingertip-mounted thermal array.

Role. Lead designer & first author. I owned the hardware iteration, the Unity interaction layer, and the three IRB-approved user studies. Co-authors contributed signal processing, fabrication support, and the academic framing.


Venue	UIST 2024 (ACM Symposium on User Interface Software & Technology)
Team	Me (lead) · Yatharth Singhal · Hyunjae Gil · Prof. Jin Ryong Kim (advisor)
Timeline	~9 months from first prototype to camera-ready
Tools	Arduino, Peltier modules, ERM/LRA actuators, Unity 2022, Meta Quest 3, Python (data), R (stats)
Methods	Within-subject user studies, threshold detection, ANOVA, qualitative think-aloud

01 · Context

VR has gotten very good at fooling your eyes and increasingly good at fooling your ears. Touch lags far behind — and temperature lags behind that. Yet temperature is what tells you a coffee mug is dangerous, that a campfire is real, that the metal handle in winter is that kind of cold.

Existing VR thermal solutions almost all do the same thing: bolt Peltier elements onto the palm or fingertip pads. That works in a lab, but it has two design-killing problems:

Obstruction. A Peltier on the fingertip blocks the very surface you use to grip, type, or pinch. Users stop manipulating objects naturally.
Power & bulk. Each thermal cell needs a heat sink and a non-trivial current draw, so you end up trading away mobility for sensation.

I wanted to keep the palm and fingerpads free and still deliver a thermal sensation that lands in those places. That meant looking past hardware and into perception.

02 · Research

I started with a literature scan across haptics conferences (CHI, UIST, IEEE WHC, IEEE VR) and a teardown of every commercial VR haptic glove I could borrow or buy.

Two findings shaped the rest of the project:

Thermal referral — discovered in tactile psychophysics in the 1970s — shows that the brain projects a thermal sensation toward a co-located non-thermal tactile cue. If I vibrate your palm while heating a spot 4 cm away, you feel the heat at the vibration.
Tactile masking — a vibrotactile cue at the right amplitude can suppress competing tactile noise on adjacent skin, making the referred sensation feel cleaner and more localized.

Combine the two and you have a free design move: put the heat where it’s easy to mount (back of hand), put the vibration where it should be felt (palm and fingerpads), and the brain quietly does the rest.

Insight. The hardware doesn’t need to be where the sensation lives — perception will move it for us, if we lay out the cues correctly.

03 · Prototyping

Three iterations, each a useful failure or a useful win.

V1 — bench rig

Four Peltier modules taped to the back of a glove, four LRA vibration motors taped to the palm. Wired to an Arduino. Ugly, but the question was perceptual, not industrial — can people feel the referred sensation at all? Answer: yes, but inconsistently — masking only worked in a narrow amplitude band.

V2 — sewn glove

Pivoted to a sewn knit glove with the thermals on the dorsal side and tactile motors stitched into the palm fabric. Added a small custom PCB so amplitude could be modulated per-channel. Now the masking band was easy to hit, but heat dissipation became the problem — the back of the glove got uncomfortably warm during longer trials.

V3 — final, with heat-spreader and mode logic

Added a thin copper-foil heat spreader between the Peltier and the glove fabric, and a software mode that pulse-cycled the thermal element rather than running it continuously. Same perceptual quality, lower sustained thermal load. (swap the bracketed values for your measured power numbers when you fill this in.) This is the version that went into the user study and the VR demo.

04 · User study

A within-subject study with N=[XX] (counterbalanced order, [X] conditions, IRB approved). Two questions:

Can participants reliably localize a referred thermal sensation to specific palm/finger zones?
Does the referred condition match a baseline of palm-mounted thermals on perceived realism and comfort?

Protocol. Each participant wore the glove and an HMD. Across blocks, we presented thermal patterns under two layouts (palm-mounted vs. dorsal+masking) and asked them to (a) point to where they felt the sensation, and (b) rate realism and comfort on a 7-point scale. We logged response time, accuracy, and verbatim think-aloud.

Findings. (replace bracketed numbers with the actual values from your UIST 2024 paper)

Localization accuracy in the referred condition: [XX%] vs. [XX%] for direct palm-mounted — the illusion holds.
Comfort rating was higher for the referred condition ([M=X.X vs. X.X, p<.0X]), driven by the absence of warm pads on the palm itself.
Manipulation success in the follow-up VR task (grasping a hot mug, picking up an ice cube) improved with the referred layout because fingertips stayed unobstructed.
Several participants spontaneously said the referred condition felt “more like real heat” — they couldn’t articulate why, which is exactly what you want from a perceptual illusion.

05 · Outcome

Accepted to UIST 2024.
The technique generalizes: the same dorsal-thermal + palm-tactile layout is now informing follow-on work on full-arm thermal sleeves.

06 · Reflection

What I’d do differently. I underestimated thermal latency. Even with the heat-spreader trick, transitioning from cold→hot still takes ~1.2 s, which limits how reactive virtual objects can feel. Next iteration I’m exploring solid-state Peltier driving with predictive pre-heating tied to gaze.

What I’d push back on if I had more time. The study was lab-bound. I want to see how the illusion holds up over a 30-minute VR session, not 90 seconds — sensory adaptation is the next big unknown.

What this taught me about designing for novel hardware. Perception is a design material. Hardware budgets are limited; perception is free. Whenever a project starts with “we need an actuator at point X,” the right next question is “do we, or can we put it at Y and let the brain do the rest?”

If you want to dig into the methodology, the full paper is linked above. Happy to talk through the design decisions in detail — .

Thermal In Motion: Designing Thermal Flow Illusions with Tactile and Thermal Interaction

Fri, 11 Oct 2024 00:00:00 +0000

Overview

This study presents a novel method for creating moving thermal sensations by integrating the thermal referral illusion with tactile motion. Three experiments on human forearms identify speed thresholds for perceived thermal motion and validate the approach in VR interaction scenarios. Published in UIST 2024.

Fabric Thermal Display using Ultrasonic Waves

Fri, 01 Sep 2023 00:00:00 +0000

Overview

This paper presents a fabric-based thermal display combining polyester fabric with thermally-conductive materials (copper, aluminum) and an ultrasound haptic display. Two user studies show that polyester+metal outperforms fabric-only conditions in thermal perception and level identification. A VR glove prototype validates the approach for XR interaction. Published in ISMAR 2023.

AR / VR | Haokun Wang

Fiery Hands: Designing Thermal Glove through Thermal and Tactile Integration for Virtual Object Manipulation

TL;DR

01 · Context

02 · Research

03 · Prototyping

V1 — bench rig

V2 — sewn glove

V3 — final, with heat-spreader and mode logic

04 · User study

05 · Outcome

06 · Reflection

Thermal In Motion: Designing Thermal Flow Illusions with Tactile and Thermal Interaction

Overview

Fabric Thermal Display using Ultrasonic Waves

Overview