THUAS

Human Computer Interaction

Client

The Hague Uni of Applied Sciences

platform

Arduino, Node.js, Python, Spline, MadMapper, Figma

my role

UX Design, Researcher

The Project

Project Overview:
For a Human-Computer Interaction course, our group designed Unspoken Symbols - an interactive installation exploring the theme of the extended body.

Challenge


How might we design a tangible interaction that transforms the body into a playful, nonverbal communication tool?We aimed to go beyond screens and build a prototype where users discover meaning together through touch, sound, and projection.

Approach

1. Research & Understanding the User:

  • Explored the theme extended body by brainstorming around wearables, sound, and communication.
  • Tested early hardware in a soldering workshop, experimenting with wiring basics
  • Used HMW-methods and quick iterations to narrow down concepts.
  • Wrote first simple code snippets to test connections: Experimented with Bluetooth setup (HC-05) → pivoted to stable USB solution

2. Design Direction:‍

  • Sketched jacket concepts to map LED placement, sensors, and touch patches
  • Defined core interaction loop: touch → light/sound → projection
  • Tools used:
    ‍Arduino for sensors and wiring
    ‍Node.js & Python for connecting interactions
    ‍MadMapper & Spline for projection visuals
  • Balanced technical ambition with clear, intuitive user flow

3. Prototyping and Testing:

  • Built and rewired jackets with LEDs, capacitive touch tape, and Arduino boards
  • Created storyline (“decode the hieroglyphs”) to guide user interactions
  • Tools used:
    ‍Arduino for sensors and wiring
    ‍Node.js & Python for connecting interactions
    ‍MadMapper & Spline for projection visuals
  • Balanced technical ambition with clear, intuitive user flow

Outcome


The final prototype was an interactive installation where two users communicated through jackets, touch, and projected hieroglyphs. Despite technical limitations, users described it as mysterious, playful, and engaging. Visitors enjoyed experimenting together and felt immersed once they understood the task.On a personal level, I contributed to brainstorming, projection testing, rewiring jackets, coding interactions, and group leadership. This project taught me how to lead under pressure, scope technical ambitions realistically, and keep the team motivated. Most importantly, it showed me how tangible prototyping can transform abstract ideas into memorable user experiences.

Continue to next project

Omnimedia

All ProjectsOmnimediaabout me

Made by Amaris H. Rousse

Powered by Webflow