News for hackers. Stuff that matters.
Re:Web LLM – WebGPU Powered Inference of Large Language Models by xyproto on Monday April 17, 2023 @04:23AM (#35598086)
I gave WebLLM a spin. This is a promising start, but it's struggling with code (using vicuna-7b-v0):

  Write a Turbo Pascal program that says hello world.
 
  ```sql
  program helloWorld;
  
  begin
  write('H');
  write('e');
  write('l');
  write('l');
  writeln;
  end.
  ```

There are no comments on this comment yet.