Projects

Projects In Progress

You-Jin Kim & Tobias Höllerer [names of other team members were redacted for the double-blind peer review]
Project description: This study investigates how users classify and identify objects in an augmented reality environment while exploring a wide-area and accurately identifying both virtual and physical gems in the space. [details redacted for review] 

You-Jin Kim & Tobias Höllerer [names of other team members were redacted for the double-blind peer review]
Project description: We created virtual audiences for AR spectator, designed to mimic the behaviors of a real audience. Leveraging imitation learning from human audience data, these virtual audiences aim to enhance the live performance experience for users experiencing AR theater play. [details redacted for review] 

You-Jin Kim, Myungin Lee, JoAnn Kuchera-Morin, and Tobias Höllerer: Spatial Orchestra: Locomotion Music Instruments through Spatial Exploration. Submitted to: ACM Conference on Human Factors in Computing Systems, Honolulu, Hawaiʻi, May 2024, ACM CHI 2024

Ngoc Dinh, You-Jin Kim, Myungin Lee: FractalBrain: A Neuro-interactive Virtual Reality Experience using Electroencephalogram (EEG) for Mindfulness. Submitted to: ACM Conference on Human Factors in Computing Systems, Honolulu, Hawaiʻi, May 2024, ACM CHI 2024

Presented Projects

You-Jin Kim, Andrew D Wilson, Jennifer Jacobs, and Tobias Höllerer: Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects. In: IEEE International Symposium on Mixed and Augmented Reality, Sydney, Australia, October 2023, IEEE ISMAR 2023
Presented: IEEE ISMAR 2023 - [Navigation and Locomotion] Session, October 18, 2023, 10:30 to 12:00 in Sydney, Australia 

• DOI: 10.1109/ISMAR59233.2023.00137

You-Jin Kim, Joshua Lu, and Tobias Höllerer: Dynamic Theater: Location-Based Immersive Dance Theater, Investigating User Guidance and Experience. In: ACM Symposium on Virtual Reality Software and Technology, Christchurch, New Zealand, October 2023, ACM VRST 2023
Presented: ACM VRST 2023 - [Technologies in the Wild] Session, October 10, 2023, 15:30 to 17:00 in Christchurch, New Zealand

• DOI: 10.1145/3611659.3615705

Radha Kumaran, You-Jin Kim, A Milner, Tom Bullock, Barry Giesbrecht, and Tobias Höllerer: The Impact of Navigation Aids on Search Performance and Object Recall in Wide-Area Augmented Reality. In: ACM Conference on Human Factors in Computing Systems, Hamburg, Germany, April 2023, ACM CHI 2023
Presented: ACM CHI 2023 - [Supporting users in AR and VR] Session, April 26, 2023, 09:00 to 10:30 in Hamburg, Germany

• DOI: 10.1145/3544548.3581413

You-Jin Kim, Radha Kumaran, Ehsan Sayyad, A Milner, Tom Bullock, Barry Giesbrecht, and Tobias Höllerer: Investigating Search Among Physical and Virtual Objects Under Different Lighting Conditions. In: IEEE Transactions on Visualization and Computer Graphics, Singapore, October 2022, IEEE TVCG 2022
Presented: IEEE ISMAR 2022 - [Evaluation] Session, October 19, 2022, 08:00 to 09:30 in Singapore

• DOI: 10.1109/TVCG.2022.3203093

Zhaozhong Wang and You-Jin Kim: Exploring Immersive Mixed Reality Simulations and Its Impact on Climate Change Awareness. In: Asian Journal of Applied Science and Engineering, Volume 12, ISSN: 2307-9584, September 2022, AJASE 2022
Presented: ACM SIGGRAPH SPARKS 2023 - [Spatiality in Virtual Reality] Session, January 27, 2023, 12:30 to 15:30 in Virtual Session

• DOI: 10.18034/AJASE.v11i1.3

Video Presentation

Open-source Projects

Kim, Y., & Kumaran, R. (2021). UCSB_3D Campus (Version 1.0.1) [Computer software]. available at: https://github.com/yujnkm/UCSB_3D (accessed 19 May 2022). https://github.com/yujnkm/UCSB_3D

• DOI: 10.5281/zenodo.6565136

• World Tracer from Bell Labs

• Upload Makey Makey Video + ATLAS, Google Challange
  
  List takeaway + Figures + BibTex

• 
  

• Magic Leap game - ATLAS

Spatial Orchestra (2023)

By leveraging spatial awareness while moving around the environment, one can play an AR musical instrument by walking. HoloLens 2

The Spatial Orchestra project reimagines musical instruments by making them as accessible as walking. Unlike traditional instruments, this innovative work allows individuals of all skill levels to effortlessly create music through movement. The experience involves an ever-shifting sound bubble that participants engage with by stepping into colored virtual bubbles within the designated area. Each bubble corresponds to a cello note, effectively transforming participants into musicians. The project seamlessly integrates this spatial instrument with an interactive element, enabling users to explore the fascinating intersection of spatial awareness, motion, and musical expression. Through playful movements and dance-like gestures within the bubble-filled environment, participants delve into a captivating realm where the dimensions of space and music harmonize. By combining the interactive nature of the bubbles with the exploration of motion and musicality, the project unlocks new dimensions of creative expression. Ultimately, this unique experience illuminates the intricate relationship between spatial awareness and the art of musical performance.

Direct quote from one of the user:
While experiencing the Spatial Orchestra, I learned the way of engaging with the space and the bubbles floating around the space. I got pretty good at deciding the precise moment and time to dive into these bubbles to create the sound I wanted. I timed the moment jump into a cluster of bubbles to maintain the rhythm, as well as how to dodge certain bubbles to lead up to the musical peak. This gave me a feeling of control over the rhythm. I can do this all day. 

Kinetic Art

Digital Design

I enjoy researching in my office space at Four Eyes Lab, overlooking the beautiful Santa Barbara coastline. 

© You-Jin Kim

Santa Barbara

@inproceedings{kim2023reality,
  author={Kim, You-Jin and Wilson, Andrew D. and Jacobs, Jennifer and Höllerer, Tobias},
  booktitle={2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)},
  title={Reality Distortion Room: A Study of User Locomotion Responses to Spatial Augmented Reality Effects}, year={2023}, volume={}, number={}, pages={1201-1210}, keywords={Navigation;Deformation;Spatial augmented reality;Transforms;Distortion;Visual effects;Standards;Human-centered computing;Empirical studies in RCI;Computing methodologies;Mixed / augmented reality Computing methodologies;Virtual reality Computing methodologies;Perception}, doi={10.1109/ISMAR59233.2023.00137}}