News for hackers. Stuff that matters.

WilliamBerglund

Only tangentially related, but this documentary is quite good https://www.imdb.com/title/tt2475454/
My favourite demo of all time https://www.pouet.net/prod.php?which=56112

It features programming in multiple languages: cobol, fortran, lua, pascal, ruby, vala, ada, d, java, objc, scheme, visualbasic, asm, javascript, ocaml, python, shell

Big shame no videos of it are up on the internet anymore, I've looked quite hard, but nothing. The code is available here however: https://launchpad.net/binaryofbabel/+download

Re:Show HN: LLaMA tokenizer that runs in browser on Wednesday June 14, 2023 @04:08AM (#36322937)
Yes, tiktoken, here's a client side visualizer for it

https://github.com/functorism/gpt4-tokenizer-visualizer

Re: on Sunday May 21, 2023 @02:07PM (#36023333)
Hello (author here), I found the OpenAI tool (https://platform.openai.com/tokenizer ) for visualising tokens really useful when working on token optimisation strategies (and other token related tasks). But unfortunately that site doesn't support the tokeniser that GPT4 uses (currently).

So I threw together a stackblitz that uses the js-tiktoken to do the same thing.

Hopefully it will be useful for someone else too!

Re:Arbitrary code execution during compilation – rust on Saturday March 18, 2023 @07:15PM (#35214197)
D does this "the right way", which is to say free of side-effects.

https://tour.dlang.org/tour/en/gems/compile-time-function-ev...

https://wiki.dlang.org/Compile-time_vs._compile-time

You're supposed to be able to trust the compiler, you can't trust people. (https://forum.dlang.org/post/[email protected])