Show HN: AI climbing coach – visualize how to climb any route based on your body

Re:Show HN: AI climbing coach – visualize how to climb any r... by smandava on Monday May 06, 2024 @09:34PM (#40281349)

Note:

Will attach more example outputs and make a detailed document about how the model was built and the research behind it. If this is interesting to you, feel free to sign up to the waitlist on www.climbing.ai (and make sure to sign up for our Discord!)

I originally planned on open sourcing the model, data, weights, and code. Only a few people (me and a couple friends) have access to the hosted model on the web app.

If enough people are on the waitlist, I will consider releasing access. This is very expensive to run so was only considering open sourcing it.

Note: the model works well sometimes, but most of the times it does not. This is an early research preview. Please tamper any expectations. A really good general model requires millions of videos and much more training time so it is really prohibitively expensive. As mentioned before, if someone has the compute, all they have to do is scale the existing dataset and training pipeline (which I will publish open-source in the coming weeks).

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by ethbr1 on Wednesday May 08, 2024 @02:52PM (#40301632)

High-level details about how you tackled the various sub-problems would be useful.

I assume, at minimum, there's:

   - Segmentation of moving elements
   - 3d reconstruction from 2d video
   - Reverse kinematics
   - Identification of holds
   - Search for potential climbing path
   - Generation of kinematics for path

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by hirako2000 on Wednesday May 08, 2024 @02:59PM (#40301704)

Likely looking to see a 100k emails list before really thinking about all these problems to solve and well.

Worst case able to build this, scenario, author builds something else entirely.

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by ethbr1 on Wednesday May 08, 2024 @04:13PM (#40302358)

Afaict, author already built a proof of concept.

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by icpmacdo on Wednesday May 08, 2024 @05:09PM (#40302735)

I've been working on the same thing, there is an interesting quote from back in the day and its either make your program faster or wait 6 months for the computers to get faster. I look at it the same way now with Key Point Analysis and Pose Estimation libraries.

I think OSS is best for this category right now.

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by crabmusket on Wednesday May 08, 2024 @10:09PM (#40304600)

*temper expectations!

[ Parent | on HN ]

Re:Show HN: AI climbing coach – visualize how to climb any r... by smandava on Wednesday May 08, 2024 @10:42PM (#40304772)

typo :) thanks

[ Parent | on HN ]