Sorry for the dumb question as I'm not in the field, but is this meant for actual midi/audio in? I tried clicking the keys on the midi to no avail, so I would assume I would use this with an actual midi (or midi file)?

Audio in is supported - it just uses your computer's audio in. Just press on the "Line In" checkbox on the left to allow your browser to access your audio. Alternatively, you can send a pre-set sample to the worklet by selecting it from the dropdown menu and pressing "Play"

Midi in is not supported yet, i.e. you can't press a key on your connected MIDI keyboard to send a MIDI message to the worklet yet. You can simulate it with the keyboard on the left. Quoting the Help page (accessible with the "?" button on the top right):

"The MIDI IN keyboard will send MIDI messages to the worklet's MessagePort. Messages are objects of the form {type: ['noteon' | 'noteoff'], value: { note, octave, midi, frequency } }"

Using physical MIDI controls will be supported in future releases, though.

Have you considered using Open Sound Control[0]? There is a nice JS package for it. I've put together a couple demo web apps using OSC as both client and server. Bonuses include that you get midi with it, it creates RESTful 2 way interfaces for your endpoints, can be shared over the internet (WebRTC), and it's universally easy to hook to other stuff! Also there is a FANTASTIC customizable interface app for iOS and Android called TouchOSC[1] that only costs $5. I use it for music and robotics.

[0] https://github.com/colinbdclark/osc.js/

[1] https://hexler.net/software/touchosc

BONUS OSC STUFF:

* https://github.com/sebpiq/rhizome

* https://github.com/attwad/python-osc

* https://github.com/thomasfredericks/UnityOSC

* https://github.com/automata/osc-web

* https://github.com/mhroth/tinyosc

shameless self-promotion: I work on a free software OSC sequencer: https://ossia.io

I have been looking for this for years. Awesome self promotion.

That's really cool and I'll surely consider it for future releases. I'm trying to sort out the priorities for this project and the feedback on HN is amazing. Thanks.

No problem. Your app is really cool! I really have to compliment you on the design/ux too. Clean, easy to look at, and minimal futuristic. I look forward to seeing more!

Do you have a github or a blog I can follow? I didn't see anything in the info on your site.

Thanks! The UI is something I came up with, and that normally I use in my side projects. I'm separating it from my business logic code and maybe I will share the components sooner or later. I just don't know if the world needs another set of React components, and if I have time to maintain them :)

The blog is a WIP, I would like to blog about Audio DSP with maybe code examples hosted on the worklet editor. I just need to find the time.

My GitHub repo is cristiano.belloni, but I don't really use it - I normally use GitLab these days, and most of my repos are private for one reason or another. I'll probably open some of them, but only if I know there is interest and I can maintain them properly.

This is a good introduction to worklets: https://developers.google.com/web/updates/2017/12/audio-work...

These are a bunch of demos: https://googlechromelabs.github.io/web-audio-samples/audio-w...