News for hackers. Stuff that matters.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by LightMachine on Friday May 17, 2024 @02:08PM (#40392629)
Bend has no tail-call optimization yet. It is allocating a 1-billion long stack, while C is just looping. If you compare against a C program that does actual allocations, Bend will most likely be faster with a few threads.

Bend's codegen is still abysmal, but these are all low-hanging fruits. Most of the work went into making the parallel evaluator correct (which is extremely hard!). I know that sounds "trust me", but the single-thread performance will get much better once we start compiling procedures, generating loops, etc. It just hasn't been done.

(I wonder if I should have waited a little bit more before actually posting it)

Re:Bend: a high-level language that runs on GPUs (via HVM2) by nneonneo on Friday May 17, 2024 @02:23PM (#40392789)
If they’re low-hanging fruit, why not do that before posting about it publicly? All that happens is that you push yourself into a nasty situation: people get a poor first impression of the system and are less likely to trust you the second time around, and in the (possibly unlikely) event that the problems turn out to be harder than you expect, you wind up in the really nasty situation of having to deal with failed expectations and pressure to fix them quickly.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by LightMachine on Friday May 17, 2024 @02:42PM (#40392988)
I agree with you. But then there's the entire "release fast, don't wait before it is perfect". And, then, there's the case that people using it will guide us to iteratively building what is needed. I'm still trying to find that balance, it isn't so easy. This release comes right after we finally managed to compile it to GPUs, which is a huge milestone people could care about - but there are almost no micro-optimizations.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by naasking on Friday May 17, 2024 @02:27PM (#40392863)
That's how development under open source works. You can't please everyone.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by nneonneo on Friday May 17, 2024 @02:37PM (#40392953)
There’s a big difference between developing something and announcing loudly that you have something cool; the developers have done the latter here.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by vrmiguel on Friday May 17, 2024 @03:36PM (#40393468)
I think it's clearly pretty cool even if not as fast as people expect it to be
Re:Bend: a high-level language that runs on GPUs (via HVM2) by trenchgun on Friday May 17, 2024 @04:09PM (#40393738)
It is pretty cool milestone achieved, just not production ready.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by adw on Friday May 17, 2024 @06:56PM (#40394921)
This is very cool and it's being treated unfairly, though it's also obviously not ready for prime time; it's an existence proof.

To illustrate that, many people on here have been losing their mind over Kolomogorov-Arnold Networks, which are almost identically positioned; interesting idea, kind of cool, does what the paper claims, potentially useful in the future, definitely not any use at all for any real use-case right now.

(In part that's probably because the average understanding of ML here is _not_ strong, so there's more deference and credulousness around those claims.)

Re:Bend: a high-level language that runs on GPUs (via HVM2) by Ar-Curunir on Friday May 17, 2024 @03:29PM (#40393410)
Thats completely unfair. They have developed something cool, just with not all the holes plugged.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by LightMachine on Friday May 17, 2024 @05:31PM (#40394388)
Dude we're running unrestricted recursion and closures on GPUs! If that's not cool to you, I apologize, but that mind-blowingly cool to me, and I wanted to share it, even though the codegen is still initial. Hell I was actually going to publish it with the interpreters only, but I still coded an initial compiler because I thought people would like to see where it could go :(
Re:Bend: a high-level language that runs on GPUs (via HVM2) by mst on Sunday May 19, 2024 @07:55AM (#40406317)
The closure part was when I had to stop for a moment and go "wait, really?! ... COOL!" and I'm definitely going to try and remember to check back every so often (emphasis on 'try' given I have a brain like a sieve but still ;).
Re:Bend: a high-level language that runs on GPUs (via HVM2) by jay-barronville on Friday May 17, 2024 @08:36PM (#40395546)
> (I wonder if I should have waited a little bit more before actually posting it)

No. You built something that’s pretty cool. It’s not done yet, but you’ve accomplished a lot! I’m glad you posted it. Thank you. Ignore the noise and keep cooking!

Re:Bend: a high-level language that runs on GPUs (via HVM2) by phkahler on Friday May 17, 2024 @10:51PM (#40396160)
>> Bend has no tail-call optimization yet.

I've never understood the fascination with tail calls and recursion among computer science folks. Just write a loop, it's what it optimises to anyway.

Re:Bend: a high-level language that runs on GPUs (via HVM2) by fulafel on Saturday May 18, 2024 @02:03AM (#40396773)
Computer science traditionally focuses on algorithms. Divide-and-conquer algorithms are frequently much more clearly expressed as recursion. Quicksort is the classic example, also various tree operations.
Re:Bend: a high-level language that runs on GPUs (via HVM2) by runeks on Sunday May 19, 2024 @12:57PM (#40408194)
I've never understood the fascination with programming languages among computer science folks. Just write machine code directly, it's what it compiles to anyway.