Medium: Interactive audiovisual installation
System: Real-time drawing-to-sound translation using Arduino, Max for Live, and Ableton Live
Dimensions: 25 × 27 × 11 cm

TOOLS

Description

Blueprint of Memory is an interactive audiovisual installation in which drawing is translated into structured sound in real time. Color data captured by Arduino sensors is processed through generative systems in Max for Live and Ableton, turning each mark into part of a live sonic composition.

Drawing here is not image-making, but input. A participant’s color choices shape what they hear.

The piece approaches memory not as something fixed, but as something formed through repeated action. Each gesture leaves a trace, and differences in color choice point to something personal: preference, tendency, habit. At the same time, the shared act of drawing suggests that perception may rest on a common ground beneath those differences.

Blueprint of Memory is the second iteration of VinelTone. Where the first version established a relation between visual input and sound output, this version develops that system further by asking what happens when participation itself becomes compositional material.

Building on the experience from Vine!Tone, the first step was to confirm all Arduino components and sensors required for the project.

Custom holders for each module were designed and 3D printed to ensure precise dimensions and stable physical integration.

All sensors were connected and tested to ensure stable operation.

During this stage, the complete circuit was assembled and verified, while the Arduino code was developed in parallel to support real-time data transmission.

The Arduino programming was refined through continuous testing, allowing the system to reliably respond to sensor input and control movement and lighting behavior.

The external form of the installation was developed in Cinema 4D.

The design considered both the internal electronic structure and the overall visual presence of the object.

Multiple rounds of 3D printing were carried out to test structural strength, assembly order, and spatial tolerance.

Each iteration refined how the components fit together.

All sensors and circuits were permanently fixed inside the structure.

Cable management and component placement were finalized to prepare the installation for long-term operation.

LED lighting was integrated into the installation, followed by final debugging of the system code to synchronize light, movement, and sensor input.

In the final stage, the system was connected to Ableton Live using Max for Live.
Sensor data was mapped to sound parameters, completing the project as an interactive audio-visual system.

The working process was documented through time-lapse recording.

感谢观看

Thanks for watching