Skills applied:
C#, Unity, AR Foundation, Mirror Networking, Computer Graphics techniques
Timeline
Ongoing
Challenge:
Given the rising demand for multi-user AR environments in fields like education, neuroscience, healthcare, and remote collaboration, there is a notable lack of research and open-source technologies that support spatial collaboration across users. This gap exists due to challenges such as platform incompatibility and the difficulty of managing spatial location information across different systems.
Solution:
"ARClassroom" is an open-source AR application designed to address the challenge of spatial collaboration across platforms. By leveraging the Iterative Closest Point (ICP) technique from computer graphics, ARClassroom enables users to join a shared AR environment seamlessly, regardless of the platform they are using. The application is developed using ARFoundation for augmented reality experiences and Mirror for networking, ensuring smooth communication between users. At its core, ARClassroom employs the ICP technique to align and integrate users' spatial data in real-time. We use KD-Trees to enhance the app’s ability to collect and manage users' location data, making spatial collaboration in multi-user AR environments both more feasible and effective.
What I learned:
ARFoundation and AR Development
I learned how to create an AR application from scratch, including setting up the wireframe and developing the app infrastructure.
Experimentation with Computer Graphics techniques
Through this project, I gained hands-on research experience with computer graphics techniques, particularly the Iterative Closest Point (ICP) algorithm and KD-Trees. These techniques were crucial for aligning and managing spatial data within the AR environment.
With support from an NSF grant, I am currently conducting user research to explore how the AR app can be effectively applied in classroom settings. This research aims to understand user needs and refine the app's features to enhance its educational impact.