Climbuddy: From Phone Photos to Interactive 3D Climbing Walls in the Browser

Snap photos of a bouldering wall, get back a textured 3D model with routes and holds auto-detected. Climbuddy chains COLMAP, SAM, and YOLO into a WebGL viewer that actually makes sense to use.

0:00
/0:52

A 3D-reconstructed bouldering wall rendered in a WebGL viewer, with individually detected climbing holds highlighted along color-coded routes.