Interactive climbing wall using computer vision and real-time projection mapping

Panadès i Closes, Oriol

Interactive climbing wall using computer vision and real-time projection mapping

License

Citation

Panadès i Closes, O. Interactive climbing wall using computer vision and real-time projection mapping. 2024. handle: http://hdl.handle.net/10230/61499

This citation was generated automatically.

Abstract

Interactive climbing walls are a technology that has gained popularity in recent years along with the rise of indoor climbing. The current limitations in the existing systems have motivated this project to investigate if a general, simple, and robust solution can be achieved using widely available tools. The developed system uses a regular projector, an uncalibrated camera (such as the one in a mobile phone), and a custom-built application to create an interactive climbing wall experience with real-time projection mapping. The implemented solution incorporates computer vision techniques such as image pre-processing, object detection and segmentation, feature matching, au- tomatic homography computation and ranking, as well as deep learning models for human pose estimation. For the application, a custom GUI has been created to facilitate easy operation by the user. The result is an interactive climbing wall that can be setup with minimal equipment, configured in less than 10 minutes, and compatible with existing walls of any shape. Finally, a simple demo of an interactive experience has been created to illustrate what can be achieved with the system and the available data structures.