Interactive Installation · Gyeonggi Provincial Museum, 2022

AI Gang
Se-hwang
Docent

Year 2022
Type Interactive AI Installation
Venue Gyeonggi Provincial Museum
Role Technical Director

Gang Se-hwang AI Docent is an interactive media installation that digitally revives Gang Se-hwang — renowned painter and mentor to Kim Hong-do — as a real-time AI human. Through 3D reconstruction, motion capture, and speech interaction, visitors can converse, pose, and take photographs with a historically reimagined figure.

Traditional heritage preservation has long focused on static representation. Yet memory is performative — it survives through gestures, voice, and behavior. This project investigates how digital embodiment can revive historical identity not as a frozen artifact but as a living, interactive presence.

By letting museum visitors encounter a responsive digital scholar, the installation reframes preservation as participation — turning heritage into dialogue and memory into empathy.

Archival Reference
Gang Se-hwang Historical Reference

Historical portraits and materials were provided by the Gyeonggi Provincial Museum, serving as primary references for digital reconstruction. The team studied original ink paintings, written records, and academic research on Gang Se-hwang's physical characteristics and mannerisms.

Digital Reconstruction
3D Modeling 3D Modeling 3D Modeling 3D Modeling

3D facial and body modeling using ZBrush and Maya. Texture mapping, UV unwrapping, and normal map generation. Hair cards and fabric shaders for physically accurate rendering.

Motion Capture
Motion Capture Motion Capture

Body motion recorded using the OptiTrack system. Facial motion captured through Apple ARKit, synchronizing expression and dialogue in real time.

Costume Simulation
Costume Simulation Costume Result

Traditional Korean attire — hanbok, gat hat, and layered robes — modeled and simulated in Blender and Maya, achieving physically accurate fabric movement and draping.

Real-Time Integration in Unity
Unity Integration Unity Integration

All assets imported into Unity 3D, where interactive animation triggers — buttons, speech recognition, and audience proximity detection — were implemented for real-time responsiveness.

Installation Deployment
Museum Installation Museum Installation

The final AI docent was deployed at the Gyeonggi Provincial Museum, operating in real time as a responsive digital guide. Visitors could engage in conversation, request demonstrations, and pose for commemorative photographs with the digital Gang Se-hwang.

The project explores how historical identity and cultural heritage can persist through technological translation. By reanimating a historical figure within a real-time digital human framework, it demonstrates how AI can serve as a medium of cultural empathy rather than mere replication.

It proposes a new form of Cyborg Museology — a museum paradigm where memory becomes interactive and heritage evolves through human–machine coexistence.

← Previous All Work Next →