getToTheChopin

https://old.reddit.com/r/webdev/comments/1o9tend/im_building_a_webgame_using_hand_head_movement/

https://twitter.com/measure_plan/status/1956364113065455740

I'm experimenting with a musical instrument design, using hand rotation to change tempo and note cycles.Created with javascript, mediapipe computer vision, tonejs, threejs.This runs in real-time in the browser.Live demo here (requires webcam access): https://www.funwithcomputervision.com/radial/

https://old.reddit.com/r/webdev/comments/1mlnfvn/i_made_3_cursed_captchas/

* level 1: show a banana* level 2: slice 20 fruits* level 3: play snake with your headbuilt with tensorflow, mediapipe computer vision, threejs, vanilla javascriptthis project will continue until I have found the most cursed captchaif you have ideas, please let me know :)

https://twitter.com/measure_plan/status/1948435017559949764

I made a hands-free HN reader using speech and face recognitionSpeak to navigate the feed; eat doritos to scroll an articleLive demo (please use Desktop Chrome): https://funwithcomputervision.com/snacker-news/This works in real-time in the browser using a regular laptop webcamAll speech / face recognition is done locally (none of your data is stored)Tech stack: HN API, mediapipe face landmarks,...

https://twitter.com/measure_plan/status/1944127683241078937

This uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low)Also using threejs for visuals and tonejs for audioIt runs in real-time in the browser, using a regular laptop + webcamLive demo: https://www.funwithcomputervision.com/chinup/You can track chin-ups, push-ups, or planks. I will continue to add more exercises into...

https://old.reddit.com/r/webdev/comments/1lxwx73/do_a_chinup_save_a_cat_im_building_a_workout_game/

I'm creating a fitness game on the web, where you do exercises to save petsHere's a live demo (camera access required): https://www.funwithcomputervision.com/chinup/I've added push-up mode as well, and you can choose whether you want to rescue cats or dogs :)Tech stack: mediapipe computer vision (body pose tracking model), threejs, tonejsI'm actively working on this, so please let me know your...

https://old.reddit.com/r/creativecoding/comments/1lvfra7/do_a_chinup_save_a_cat_mediapipe_threejs_realtime/

I made a game that forces me to work outDo a chin-up, save a cat!Created with mediapipe AI vision (for body tracking) and threejs (for visuals and animations)It runs in real-time in the browserAs next steps I want to:* improve layout on mobile* add a global scoreboard* allow people to upload their own cat pictures to use in the game for extra motivation :)please let me know of any feedback or...

https://twitter.com/measure_plan/status/1937149543751049453

I made a body movement game. You jump around your living room to dodge lava.Created with threejs and mediapipe computer vision.You can play the game here, it runs on the web without any installs or downloads: https://www.funwithcomputervision.com/demo7/

https://twitter.com/measure_plan/status/1935497060956189155

https://github.com/collidingScopes/arpeggiator

Hand-controlled arpeggiator, drum machine, and audio reactive visualizer.Runs in real-time in the browser. Built with threejs, mediapipe computer vision, and tone.js.Video demo: https://x.com/measure_plan/status/1934618478524199126

https://twitter.com/measure_plan/status/1933544128287228123

This is a demo video showing a hand-controlled arpeggiator, drum machine, and audio reactive visualizerRuns in real-time on the web, using a laptop webcamCreated with threejs, rosebud AI, mediapipe computer vision, and tone.jsWork in progress live demo: https://rosebud.ai/p/f8f8cd80-1f68-466a-9da2-09cc0c354f45Next I want to add new synth sounds and find an easy gesture to change the drum...

https://twitter.com/measure_plan/status/1931699154494906746

Created using threejs, mediapipe computer vision, and rosebud AI.Runs in real-time in the browser.Live demo: https://rosebud.ai/p/3683087f-5fed-4e2c-9db2-d31831a5cf46I'm planning to add more sound samples, tempo / bpm control, and other quality of life improvements.Any feedback would be appreciated!

https://github.com/collidingScopes/3d-model-playground

I'm sharing my project to control 3D models with voice commands and hand gestures:- use voice commands to change interaction mode (drag, rotate, scale, animate)- use hand gestures to control the 3D model- drag/drop to import other models (only GLTF format supported for now)Created using threejs, mediapipe, web speech API, rosebud AI, and Quaternius 3D modelsGithhub repo:...

https://twitter.com/measure_plan/status/1929557612191768623

I'm working on a hobby project to control 3D models with hand gestures and voice commands.It runs in real-time in the browser. Built with threejs, mediapipe computer vision, and web speech API.As of now you can move / rotate / scale / animate the 3D model. You can also import new 3D models into the program.I'm continuing to work on it and may open source it as well.If you have any suggestions...

https://twitter.com/measure_plan/status/1928449603390587265