na--

Talk by Mike Olson from Monktoberfest 2023. Article version of the talk: https://www.olsons.net/entrepreneurship/what-is-a-board-for

FWIW, it works on QubesOS, which is Xen based. Though it works only in my Fedora and Debian VMs, but not on my Archlinux-based one.

I think that's because I have WINE installed in the Archlinux VMs, since that's what gets started when I run ./redbean.com. But even after I remove WINE, it still doesn't work, I probably have to restart (i.e. remove WINE from the TemplateVM, not the AppVM) for it to work.

In any case, incredible work, I am in awe!

Unfortunately not... At some point in the far future, we might release support for Go "scripting" [1] or we might extend xk6 [2] so it allows different script types, but those things are far from certain.

[1] https://github.com/loadimpact/k6/issues/751

[2] https://github.com/k6io/xk6

This used to be an issue with older k6 versions, but since v0.27.0 we have arrival-rate executors [1] that should address the biggest issue of coordinated omission. And we've always measured the max value of all metrics, even when they are not exported to some external output and we just show the end-of-test summary.

It has been a while since I watched these Gil Tene talks, so I might be missing something, but I think the only remaining task we have is to adopt something like his HDR histogram library [2]. And that's mostly for performance reasons, though we'll probably play around with the correction logic as well.

[1] https://k6.io/docs/using-k6/scenarios/arrival-rate

[2] https://github.com/loadimpact/k6/issues/763

I was skimming your "extensive" article again, and I saw this little gem I'd forgotten about: https://github.com/ragnarlonn/curl-basher ^^

The canonical way to record web traffic are HAR files: https://en.wikipedia.org/wiki/HAR_(file_format)

You can export HAR files from all web browsers and a lot of proxies and other tools. Then you can convert that recording to a k6 script with our HAR converter: https://k6.io/docs/test-authoring/recording-a-session/har-co...

We also have browser plugins to directly record browser traffic and import it as a k6 script in our cloud service: https://k6.io/docs/test-authoring/recording-a-session/browse...

However, you don't need a cloud subscription to run the tests, you can copy-paste the generated script code and `k6 run` it locally, without paying us anything.

I am one of the k6 developers. I've commented in a bunch of threads here, but if you have any questions, feel free to AMA :) I'll be around for the next ~1h and then probably later in the day as well.

This very much depends on your available hardware and the complexity of the load test. Following the advice in https://k6.io/docs/testing-guides/running-large-tests, and having a beefy load generation machine and network, you should be able to run many thousands of VUs on a single instance pretty comfortably. How many thousands precisely depends on a lot of factors... :)

That's one of the main uses, yes. Although k6 gives you a lot of flexibility to decide what your pass/fail criteria are with its custom metrics ( https://k6.io/docs/using-k6/metrics#custom-metrics ), checks (https://k6.io/docs/using-k6/checks) and thresholds ( https://k6.io/docs/using-k6/thresholds ).

See the example in https://github.com/loadimpact/k6/#checks-and-thresholds. If, at the end of the test run, some of these rules (encoded as `thresholds`) were unsatisfied, k6 will exit with a non-zero exit code (and thus fail your CI check): - The 95th percentile of all HTTP request durations should be be less than 500ms - The 99th percentile of all HTTP request durations that were tagged with `staticAsset:yes` should be less than 250ms - The failure rate of the checks should be less than 1%, although if it's more than 5% the test will abort immediately.

That's more or less it. Source: I am one of the k6 developers, and here's also an answer from our CEO on the topic: https://community.k6.io/t/k6-licensing-agplv3/395/2

I might be missing something, but k6 should be able to completely cover all of your use cases? I am one of the k6 developers, can you share exactly what the missing piece was?

> tests that would run much much more often (like every seconds or couple of seconds), in a continuous manner.

You can do that, just use an arrival-rate executor that runs an iteration every second, with a test duration of 365 days or something like that :) See https://k6.io/docs/using-k6/scenarios/arrival-rate

> Tue goal was to have something at the same time like a healtcheck (is it still working), like a performance test (does it answer in a timely manner) and like a validation test (does it answer the right result - the endpoints we wanted to test do "complex calculations"). Our best answer so far was to wrap K6 in an infinite loop, but I wonder if there could be something smarter.

You can certainly wrap k6 in an infinite loop. Nothing wrong with that, though you can probably use the `scenarios` feature (with long `duration` values) to achieve it without wrapping k6: https://k6.io/docs/using-k6/scenarios

There is auto-completion, see https://k6.io/docs/misc/intellisense

Regarding debugging, that's unfortunately unlikely to come any time soon... We'd need support for that in the JS runtime we're using (https://godoc.org/github.com/dop251/goja) and then we'd need to figure out how to expose in in k6, while dealing with potentially hundreds of concurrent JS runtimes (VUs). Not impossible, just unlikely to land anytime soon...

Yes, that's it. If the C++ application exposes some service, then k6 might be the tool to test how it behaves under load now (or in the future). The only protocols we currently support are HTTP(S), WebSockets and gRPC, though we plan to add a lot of others (raw TCP/UDP, various DBs, queues, messaging, DNS, etc.) in the future, and we've recently added a way to extend the k6 functionality by writing external Go modules: - https://github.com/loadimpact/k6/blob/master/release%20notes... - https://github.com/k6io/xk6

I am not completely sure why the Go stdlib's HTTP client (which k6 uses) is faster than the NodeJS one. I think part of it is the fact that k6 spins up a separate JS runtime for each VU. goja is a much, _much_, slower JS interpreter than V8, but load tests are IO-bound, so that's usually not an issue. And you can spin up thousands of VUs in k6 (especially with --compatibility-mode=base), making full use of the load generator machine.

You can find some basic performance and other comparisons between load testing tools in this very long article of ours: https://k6.io/blog/comparing-best-open-source-load-testing-t...

And some advice for squeezing the maximum performance out of k6 in here: https://k6.io/docs/testing-guides/running-large-tests

There's a very interesting and long 6-year old discussion in the comments of the YouTube video you posted. In it, Marcinmd1 makes a lot of very good points, against the premise of the video...

> He writes utter shit, sub-mediocre literature.

I'm someone who has read that story, at least the public parts of it, and I object slightly to your quality assessment... ;) I don't argue it's great literature or anything, more like the literary equivalent of popcorn - a fun and interesting story with not a lot of depth. So, entertainment, not life-changing prose...

And while I'm surprised he gets $13k a month, I'm not _very_ surprised. I'm one of his $1/month patrons, and I also give $1-$3 a month to a lot of other writers, YouTubers, and other creators. For another internet serial writer, see https://www.patreon.com/Wildbow

One of my criteria for supporting such creators is for them to make their creations public, even if some do it after a time delay. My rationale is that, this way, I both support the creators, and the creation of "culture", for a certain definition of that word, that other people would be able to enjoy for free. And while this might never replace traditional publishing and isn't suitable for everything, you've demonstrated that some people can certainly make a living this way.

Location: Sofia, Bulgaria (EU, UTC+2)

Remote: Yes

Willing to relocate: Unlikely

Technologies and skills: Go, Linux, DevOps, Rust (currently learning), Bash, JavaScript, PHP, Data Wrangling and others (see CV timeline)

Résumé/CV: https://cv.andreev.sh/ (print to PDF for a concise normal-looking CV)

Email: [email protected]

Highly skilled generalist developer with more than 12 years of diverse work experience. Interested in security, DevOps, and data wrangling. Currently striving to master Rust and machine learning with Python. Seeking professional opportunities, especially to work on intriguing open source projects.

Location: Sofia, Bulgaria (EU, UTC+2)

Remote: Yes

Willing to relocate: Unlikely

Technologies and skills: Go, Linux, DevOps, Rust (currently learning), Bash, JavaScript, PHP, Data Wrangling and others (see CV timeline)

Résumé/CV: https://cv.andreev.sh/ (print to PDF for a concise normal-looking CV)

Email: [email protected]

Highly skilled generalist developer with more than 12 years of diverse work experience. Interested in security, DevOps, and data wrangling. Currently striving to master Rust and machine learning with Python. Seeking professional opportunities, especially to work on intriguing open source projects.