Anthroposense
Link to the research paper about the project ↗
"Anthroposense" explores climate change challenges in the Anthropocene. It is a framework that combines LLMs, digital twins, and VR gamification to transform awareness into action.
It presents an interactive app for spatial reconfiguration, enabling users to digitally arrange furniture based on optimal climate scenarios, fostering climate awareness through immersive experiences.
Project details
Role
Software Prototyper, Researcher
Year
2023
Tags
LLM Virtual Reality HCI 3D Reconstruction
Team
Kenny Kim
Vishal Vaidhyanathan
User Journey:
Users scan their room with a 3D scanning app to create a digital twin in VR. Wearing a VR headset, they receive a carbon score and recommendations for energy-efficient furniture placement. Using pinch-and-release actions, users adjust furniture, and the system calculates and shares climate scores via social media.
The app integrates space and climate data with LLMs to determine optimal furniture positions, leveraging technologies in Oculus, Microsoft MRTK, Unity, and social media APIs. Gamified tasks enhance engagement, encouraging users to optimize their space and share results.
