News for hackers. Stuff that matters.
Re:WASM SYNTH, or, how music taught me the beauty of math by errozero on Tuesday May 25, 2021 @12:34PM (#27278976)
I made a synth with web audio a few years ago using the built-in oscillator and filter nodes which are actually quite capable when combined.

Synth: http://www.errozero.co.uk/stuff/poly/ Source: https://github.com/errozero/poly-synth

Works best in chrome

Re:WASM SYNTH, or, how music taught me the beauty of math by delineator on Tuesday May 25, 2021 @04:00PM (#27281848)
@errozero: I made a synth with web audio/midi based on your synth engine a few years ago:

https://web-audio-midi.herokuapp.com/

Adding a keyboard, scale selection, oscilloscope, score note viewer, sound font player, bluetooth/web midi controller detection, etc :)

Did you decide on a license for your synth code?

Re:WASM SYNTH, or, how music taught me the beauty of math by errozero on Tuesday May 25, 2021 @04:25PM (#27282131)
Cool, I like the split keyboard feature. I've not really thought about a license tbh, I'll look into which one would be best and add a note about that. I don't really mind what anyone does with it so maybe MIT would be the one.
Re:WASM SYNTH, or, how music taught me the beauty of math by delineator on Tuesday May 25, 2021 @06:10PM (#27283376)
Cool. Great to meet you virtually, btw. Your web audio synth is awesome. Adding the oscilloscope made me appreciate how your different patches generate their unique sounds. And I added a few preset patches I liked too.
Re:WASM SYNTH, or, how music taught me the beauty of math by moron4hire on Tuesday May 25, 2021 @04:35PM (#27282280)
Umh, why don't the F or H keys work?
Re:WASM SYNTH, or, how music taught me the beauty of math by errozero on Tuesday May 25, 2021 @04:49PM (#27282443)
Because of the mapping of the typing keyboard to musical notes. F would represent E# which doesn't exist on a piano. H should work though. I found a pic that explains the keyboard layout better than I could:

https://sourceforge.net/p/vmpk/shared-keymaps-and-instrument...

Re:WASM SYNTH, or, how music taught me the beauty of math by moron4hire on Tuesday May 25, 2021 @09:13PM (#27284936)
Okay, that makes a lot more sense. I wasn't able to figure that out by just hitting the keys.
Re:WASM SYNTH, or, how music taught me the beauty of math by Ameo on Tuesday May 25, 2021 @07:49PM (#27284337)
Nice stuff! I love your selection of presets.

Since it looks like we're all sharing our web-based synthesizers, here's a FM synthesizer I built with Rust + Wasm with SIMD earlier this year: https://notes.ameo.design/fm.html

Blog post: https://notes.ameo.design/blog/fm-synth-rust-wasm-simd/

I figured what I was working on was pretty niche; it's cool to see so many other people experimenting in this space too

Re:WASM SYNTH, or, how music taught me the beauty of math by chrismorgan on Tuesday May 25, 2021 @10:17PM (#27285391)
Gets a bit crazy with an n-key rollover keyboard, hitting 31 notes simultaneously! But what happened to the F♯ that I expected on the = key, between [’s F and ]’s G?

(Also since I’m writing something already, you’re serving your site on both HTTP and HTTPS and only some URLs are doing the appropriate 301 HTTP → HTTPS redirect, presumably because it’s being done at the Wordpress/PHP level, so any direct file references handled directly by Apache don’t get done. You should make it do all URLs, and ideally add an HSTS header.)

Re:WASM SYNTH, or, how music taught me the beauty of math by capableweb on Tuesday May 25, 2021 @02:37PM (#27280545)
Not sure what went wrong and I'm not sure about the exact measurements but your synth has huge input or output latency, maybe around 100ms or something like that? Other WASM/web synths I've tried doesn't suffer from the same problem.

Otherwise it's a nifty little toy, thanks for sharing :) Lots of fun.

Re:WASM SYNTH, or, how music taught me the beauty of math by Ameo on Tuesday May 25, 2021 @07:53PM (#27284375)
Yeah some browsers/operating systems have worse latency issues than others with Web Audio. However, it's possible to tune the `latencyHint` a bit when constructing the `AudioContext` to specify a custom value. You have to find a balance between too low where have buffer underruns and miss samples and too high where it adds noticeable delay.

After a good bit of trial and error, I came up with a setup that works well on all platforms I could test: https://github.com/Ameobea/web-synth/blob/master/src/index.h...

Re:WASM SYNTH, or, how music taught me the beauty of math by apanloco on Tuesday May 25, 2021 @03:00PM (#27280911)
i don't have this issue! awesome synth! and i really like the tracker-style keys ;D
Re:WASM SYNTH, or, how music taught me the beauty of math by errozero on Tuesday May 25, 2021 @03:06PM (#27281014)
Thanks! :) Yeah the keyboard layout is based on the tracker style. I spent a lot of time with FastTracker 2.
Re:WASM SYNTH, or, how music taught me the beauty of math by skybrian on Tuesday May 25, 2021 @12:28PM (#27278898)
This is doing it the hard way if you just want to generate a sine wave, because WebAudio’s OscillatorNode [1] will do it for you, no WebAssembly required. It likely works in more browsers too.

You can also use setPeriodicWave() to have it iterate over any sampled waveform you like. There is enough in the JavaScript API to fool around with basic subtractive synthesis where you connect an oscillator to a filter.

I also recommend Syntorial [2] for understanding what subtractive synthesis is capable of. It won’t help you synthesize real instruments, but you learn what the various knobs on synthesizers do by trying to reproduce increasingly sophisticated synthesizer sounds.

Learning the basic math is useful too though.

[1] https://developer.mozilla.org/en-US/docs/Web/API/OscillatorN... [2] https://www.syntorial.com/

Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @12:39PM (#27279067)
100%, I looked past APIs as I wanted to learn myself audio programming audio autodidactically.
Re:WASM SYNTH, or, how music taught me the beauty of math by Weebs on Tuesday May 25, 2021 @02:42PM (#27280606)
I think you provided a great guide for people looking to do the same, I appreciate the write up! Real time audio is a tricky thing to get into and even moreso in the browser, starting with a sine wave here is a great launch point for more experiments.
Re:WASM SYNTH, or, how music taught me the beauty of math by Weebs on Tuesday May 25, 2021 @02:37PM (#27280543)
Is there a way to supply a PeriodicWave a specific wavetable or series of floating points to represent the wave form? It appears from the docs that PeriodicWave is a way to generate waveforms by shaping sinewaves

One problem I've had in the past trying to do audio on the web is I struggled to find any reference material on how to generate my own waveforms and rely on the browser APIs only for playback. This tutorial, with the AudioWorklet, is the first piece I've seen on how to easily do this.

Re:WASM SYNTH, or, how music taught me the beauty of math by skybrian on Tuesday May 25, 2021 @10:18PM (#27285399)
Oops, I misremembered. For looping a wavetable, you'd want to use AudioBufferSourceNode [1].

If it's a static waveform, you could also do a Fast Fourier Transform and hard-code the resulting table into your program as a Periodic Wave. Apparently, this is how the prefined waveforms of OscillatorNode work. [2]

Generally speaking, you need to read about all the different kinds of nodes that WebAudio gives you and wire them together, sort of like you would with a modular synthesizer. For experimenting with audio synthesis, I'd recommend trying out Rack [3] to figure out what kinds of sounds you want to make, then coding it in JavaScript if you can find equivalent nodes. (Rack is going to have much more capable modules, though.)

[1] https://developer.mozilla.org/en-US/docs/Web/API/AudioBuffer... [2] https://webaudio.github.io/web-audio-api/#oscillator-coeffic... [3] https://vcvrack.com/

Re:WASM SYNTH, or, how music taught me the beauty of math by javajosh on Tuesday May 25, 2021 @05:05PM (#27282649)
This probably isn't much help, but if you've got an arbitrary waveform you can do a Fourier transform on it to decompose it into a list of additive sine waves (each wave parameterized by amplitude and frequency, ignoring phase), and then play all those sine waves together to make your sound. I have no idea about the implementation details here (I can imagine that this might get computationally intensive!) but in theory this should work.
Re:WASM SYNTH, or, how music taught me the beauty of math by Weebs on Wednesday May 26, 2021 @02:51PM (#27294548)
If there's a will there's a way :) even if unpractical it's definitely a fun thought!
Re:WASM SYNTH, or, how music taught me the beauty of math by Jyaif on Wednesday May 26, 2021 @07:48AM (#27289257)
> It likely works in more browsers too

Never underestimate Safari. Its support of WebAudio is pathetic.

Re:WASM SYNTH, or, how music taught me the beauty of math by jacquesm on Tuesday May 25, 2021 @11:37AM (#27278237)
If this stuff interests you have a look at Pianoteq. They take this to a whole new level, through physical modelling they get extremely close to being able to generate realistically sounding pianos.
Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @11:45AM (#27278335)
Interesting one! For the time I played piano, I ended up buying myself 2 ADAM A7X monitors and played with Ableton's Grand Piano. I also downloaded a supposedly other library that allowed me to use sampled grand piano sounds which was supposed to improve sound quality.

It, however, never ended up sounding quite as good as my brothers's simple 300€ Yamaha keyboard.

Even after having trained my ears for many months, I still don't know why the piano sounds from my speakers just weren't as pleasing as what by bro's Yamaha produced.

Re:WASM SYNTH, or, how music taught me the beauty of math by jacquesm on Tuesday May 25, 2021 @11:49AM (#27278382)
The modern Yamaha keyboards use samples from real pianos. In mine there is both a Yamaha and a Bosendorfer and both sound quite good. But being sample based they are essentially just playing back recorded sounds.

Pianoteq generates the sounds using nothing but a bit of software and it is really most impressive.

Re:WASM SYNTH, or, how music taught me the beauty of math by TheOtherHobbes on Tuesday May 25, 2021 @02:51PM (#27280761)
I've never been able to work out if Pianoteq uses physical modelling - modelling the strings and soundboard as the solutions of differential equations - or spectral modelling - overtone resynthesis, which is rooted in sampling but reassembles the harmonics in samples dynamically instead of playing back a fixed sample series at different rates.

I suspect it's the latter, because there's a hint of detail missing in the way the overtones move.

Re:WASM SYNTH, or, how music taught me the beauty of math by matheist on Tuesday May 25, 2021 @03:41PM (#27281559)
The wikipedia article[1] says it's "Fourier construction" but without reference (that I can find) and without elaboration. At their website[2] they list some of their staff; I looked up research by one of their researchers and found a paper "Modeling and simulation of a grand piano"[3] which looks quite heavy on the physical modeling of strings and soundboard. I'd expect that to work better than spectral modeling because I think the latter would introduce (too much?) latency via needing to collect an entire spectral window (plus extra computation to compute the phases, and even then I don't think it could sound good enough?). Whereas physical modeling works directly in the time domain and there's a wealth of literature around it. See e.g. J. O. Smith III's waveguide synthesis work[4].

[1] https://en.wikipedia.org/wiki/Pianoteq

[2] https://www.modartt.com/modartt

[3] https://hal.inria.fr/file/index/docid/768234/filename/RR-818...

[4] https://ccrma.stanford.edu/~jos/swgt/

Re:WASM SYNTH, or, how music taught me the beauty of math by javajosh on Tuesday May 25, 2021 @12:09PM (#27278636)
This problem is similar to the one faced by photographers. Why do in-camera shots look so much better in one camera vs another? A big reason these days is the camera's default software post-processing matches your taste. I bet with a little fiddling (particular with things like eq, compression, reverb, maybe resonance - all of which Live has in abundance!) you could find a great sound. It's just easier because Yamaha has great taste in sound. (One day I swear I will get a C5!)

The other thing that affects your experience, and that doesn't have anything to do with timbre, is latency. Ableton through a USB audio interface into monitors is going to take (much) longer than the onboard sound generation + speakers on a digital piano. It's going to add at least 20ms plus whatever time is required to compute the sound. Meanwhile any cheap digital piano is going to do better than that.

Re:WASM SYNTH, or, how music taught me the beauty of math by Slow_Hand on Tuesday May 25, 2021 @06:51PM (#27283789)
I agree that unchecked latency (no matter how imperceptible) can sour or perception of an instrument's playability. That said, latency of 3ms is very attainable so long as your interface isn't a decade old. That's a very usable speed.

Software instruments are usually about as quick as you'd ever need them to be (no latency). So just make sure your audio buffer is set low (32 - 128 samples) and that you're not doing any heavy DSP processing that's going to add extra latency.

It takes some vigilance to do and it can be a pain in the ass to manage when you're trying to play the instrument in a CPU intensive session, but if you do it right you'll only get latency at the output stage (3ms).

Re:WASM SYNTH, or, how music taught me the beauty of math by javajosh on Wednesday May 26, 2021 @03:45PM (#27295159)
I have Live 11 on macOS 11.2.3 on an Intel 2.3GHz MBP and Live states output latency as 13ms for a 64 sample buffer at 44.1KHz sample rate. Apparently latency is reported by the audio interface driver itself, rather then measured, because live has a parameter to override that latency, including with negative values (using time travel?) It's something I should fiddle with, for sure. It would be nice to have playable virtual instruments!
Re:WASM SYNTH, or, how music taught me the beauty of math by jacquesm on Wednesday May 26, 2021 @06:06PM (#27296708)
Negative values typically offset for instance midi output to a point prior to the point where they normally would be output. So this only works for items that have a timestamp. But a soft-synth for instance could be driven that way to anticipate a longer delay further down the chain to end up with a more neutral delay once the whole chain has been traversed.
Re:WASM SYNTH, or, how music taught me the beauty of math by Dfiesl on Tuesday May 25, 2021 @01:56PM (#27280038)
I guess the yamaha has dedicated DSP, it might also have some analog circuitry as part of the signal path. Both of these will change the quality of the sound coming out, potentially for the better. Also for some reason sometimes downsampling to 12bit gives a pleasing character as can be heard on some of the hardware samplers from the 90s. As for the sounds actually on the keyboard, its possible they were recorded from a different piano, with different mic placement and a different mic pre amp to the ableton sounds, all of which could potentially lead to a nicer sound being heard.
Re:WASM SYNTH, or, how music taught me the beauty of math by psd1 on Tuesday May 25, 2021 @06:58PM (#27283854)
Simple: good monitors aren't kind. Try hi-fi speakers that are more warm than detailed
Re:WASM SYNTH, or, how music taught me the beauty of math by weinzierl on Tuesday May 25, 2021 @12:36PM (#27279004)
I haven't used their product, but the examples of all the effects they model impressed me quite a bit.

Unfortunately it is not possible to link to the examples page directly. To see what I mean, click on the Fine details of sound tab here: https://www.modartt.com/pianoteq#acoustic

Re:WASM SYNTH, or, how music taught me the beauty of math by spankalee on Tuesday May 25, 2021 @03:14PM (#27281136)
Pianoteq is great, and they have some really classic keyboards in their collection.

I really wish there were more open source physical modeling synths out there. I'd love to play with physical modeling code, but it's just not that common.

Re:WASM SYNTH, or, how music taught me the beauty of math by gregsadetsky on Tuesday May 25, 2021 @09:59AM (#27276823)
@dang, I think that the link should be changed to not go to the footnotes. Thanks!
Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @10:31AM (#27277266)
op here: Ah damn, I just noticed it too. I tried editing but I can't change the link.
Re:WASM SYNTH, or, how music taught me the beauty of math by tessierashpool on Tuesday May 25, 2021 @11:56AM (#27278463)
endorse. following the link through is quite jarring.

non-footnote version: https://timdaub.github.io/2020/02/19/wasm-synth/

Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @09:17AM (#27276413)
OP here. As I received some attention with my WASM SYNTH project in another thread [1], I thought I may post it as full post to HN again.

- 1: https://news.ycombinator.com/item?id=27276180

Re:WASM SYNTH, or, how music taught me the beauty of math by red_trumpet on Tuesday May 25, 2021 @10:44AM (#27277451)
A small note on your LaTeX use: If you use \sin, the sin will be upright (instead of italics), which is considered standard use for math operators (other operators of the top of my had that also use this: tan, cos, log, dim, deg).

If you encounter an operator, where the corresponding command with \ does not exist, you can create it with

    \DeclareMathOperator{\operator}{operator}
Re:WASM SYNTH, or, how music taught me the beauty of math by worldmerge on Tuesday May 25, 2021 @12:58PM (#27279310)
That is so cool! Also your website is really nice! Is that an available theme or did you make it yourself? I ask because I'm remaking my website.
Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @03:59PM (#27281830)
Re:WASM SYNTH, or, how music taught me the beauty of math by javajosh on Tuesday May 25, 2021 @05:08PM (#27282678)
I didn't know about hexo - it's Jekyll for node.

https://hexo.io/

Re:WASM SYNTH, or, how music taught me the beauty of math by worldmerge on Wednesday May 26, 2021 @07:16PM (#27297325)
Thank you!
Re:WASM SYNTH, or, how music taught me the beauty of math by Anktionaer on Tuesday May 25, 2021 @10:01AM (#27276845)
I had the opposite experience (based on the title): I read Goedel, Escher Bach because I thought programming and math were really interesting and it ended up getting me into music.
Re:WASM SYNTH, or, how music taught me the beauty of math by alfl on Tuesday May 25, 2021 @11:05AM (#27277761)
To answer the question in footnote 1, off the top of my head: setTimeout and setInterval have no timing guarantees because in the browser window/tab context there's no guarantee that they're active/visible. It doesn't make sense for a UI event to fire (their intended use) if the UI is hidden/inactive, and timing guarantees are therefore deferred to specific implementations.

requestAnimationFrame does make those timing guarantees.

Re:WASM SYNTH, or, how music taught me the beauty of math by mdtusz on Tuesday May 25, 2021 @11:35AM (#27278218)
RAF is still imprecise for audio use. For audio in the browser, you usually want to defer all timing events that must be precise to a scheduler that uses either the webAudio context time or even more ideally, use a lookahead scheduler to schedule events by audio frame using an internal counter and the sample rate.

A great programming exercise that forces you to wrap your head around JavaScript timing events is writing a small step sequencer that can be used while it is running with minimal latency.

Re:WASM SYNTH, or, how music taught me the beauty of math by alfl on Thursday May 27, 2021 @01:33PM (#27305735)
Interesting point, thank you. I was reading the docs today and encountered the following (presented fyi):

It turns out that this is currently true [0] because the base audio context (BAC) time is accurate to within 20us whereas RAF is accurate to within 1ms [1]. However in future browser versions the default sensitivity for BAC is going to drop to 2ms. This is done to help improve user privacy by hampering browser fingerprinting.

This is all configurable and its materiality depends on use case, but interesting read: thank you.

[0] https://developer.mozilla.org/en-US/docs/Web/API/BaseAudioCo...

[1] https://developer.mozilla.org/en-US/docs/Web/API/window/requ...

Re:WASM SYNTH, or, how music taught me the beauty of math by lioeters on Tuesday May 25, 2021 @02:59PM (#27280880)
I found some reasons for the inaccuracy of setTimeout:

From https://developer.mozilla.org/en-US/docs/Web/API/WindowOrWor...

- Nested timeouts

> As specified in the HTML standard, browsers will enforce a minimum timeout of 4 milliseconds once a nested call to setTimeout has been scheduled 5 times.

- Timeouts in inactive tabs

> To reduce the load (and associated battery usage) from background tabs, browsers will enforce a minimum timeout delay in inactive tabs. It may also be waived if a page is playing sound using a Web Audio API AudioContext.

> The specifics of this are browser-dependent.

- Throttling of tracking scripts

> Firefox enforces additional throttling for scripts that it recognises as tracking scripts. When running in the foreground, the throttling minimum delay is still 4ms. In background tabs, however, the throttling minimum delay is 10,000 ms, or 10 seconds..

- Late timeouts

> The timeout can also fire later than expected if the page (or the OS/browser) is busy with other tasks.

- Deferral of timeouts during pageload

> Firefox will defer firing setTimeout() timers while the current tab is loading.

Re:WASM SYNTH, or, how music taught me the beauty of math by PUSH_AX on Tuesday May 25, 2021 @01:13PM (#27279490)
I thought they weren't accurate because the callback is only added to the stack once the timer expires, this means you may need to wait for the stack to clear before execution happens.
Re:WASM SYNTH, or, how music taught me the beauty of math by LegionMammal978 on Tuesday May 25, 2021 @11:18AM (#27277954)
In a default installation, as far as I am aware, Emscripten uses Clang as its compiler, while the code at the bottom implies it uses GCC. (To support existing build pipelines, it attempts to recognize arguments for either compiler.) Is this in error, or can Emscripten be configured to use GCC?
Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @11:37AM (#27278236)
OP here. Hey, if you have a source on your statement I'm happy to change the blog post towards what is correct.

It may be that I assumed emscripten to use gcc but since its been over a year I wrote about it, I'm not sure anymore and so I default to trusting what I wrote. Happy to change with a source.

Re:WASM SYNTH, or, how music taught me the beauty of math by inamiyar on Tuesday May 25, 2021 @11:47AM (#27278350)
https://emscripten.org/docs/tools_reference/emcc.html

> To see the full list of Clang options supported on the version of Clang used by Emscripten, run clang --help.

Could probably find a more authoritative statement but just a quick search.

Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @12:07PM (#27278608)
Thanks. Should be updated soon.
Re:WASM SYNTH, or, how music taught me the beauty of math by LegionMammal978 on Tuesday May 25, 2021 @11:52AM (#27278426)
It appears to be noted in the readme for the repo [0]: "Emscripten compiles C and C++ to WebAssembly using LLVM and Binaryen." A 32-bit Clang is present in my own emsdk installation.

[0] https://github.com/emscripten-core/emscripten/

Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @12:07PM (#27278603)
Thanks. Should be updated soon.
Re:WASM SYNTH, or, how music taught me the beauty of math by _han on Tuesday May 25, 2021 @02:43PM (#27280621)
The link points to a footnote in the page. Can it be changed to the page itself? (Remove the tailing 3 characters from the URL.)

EDIT: I don't think it was intended to refer to the footnote, because the title of the discussion refers to the title of the page itself.

Re:WASM SYNTH, or, how music taught me the beauty of math by timdaub on Tuesday May 25, 2021 @03:07PM (#27281027)
I think it was finally changed :)