News for hackers. Stuff that matters.
Re:RWKV RNN: Better than ChatGPT? by pffft8888 on Thursday March 23, 2023 @06:58PM (#35282660)
Imagine having ChatGPT level AI running in an ASIC inside earphones. This could be like an always-on buddy, available offline and able to access resources when you're connected.

Or in Google Glasses. The Readme states that it's more optimized for ASIC than the transformer architecture used by ChatGPT.

Re:RWKV RNN: Better than ChatGPT? by RobotToaster on Thursday March 23, 2023 @07:41PM (#35283107)
I wonder if we will see LLMs on FPGAs or FPGA like devices.

Crypto went from graphics cards to ASICs, we may see something similar with LLMs given the hype.

Re:RWKV RNN: Better than ChatGPT? by pffft8888 on Thursday March 23, 2023 @08:01PM (#35283268)
I always think of FGPAs for things you want to update without having to repurchase the hardware. If the FPGA inside a gadget can be reprogrammed over the Internet then I think it's more suited than an ASIC for LLMs.
Re:RWKV RNN: Better than ChatGPT? by int_19h on Friday March 24, 2023 @06:54PM (#35296775)
It could go even further, in theory. The kind of ops that the current crop of LLMs needs is very simple, and at the same time there's no hard requirement for precision (which is why 4-bit quantization works so well). This means that unconventional approaches such as analog computing are potentially in the play again - it's easy to do addition and multiplication in an analog circuit, if you don't care about the answer being precise, and in theory one could pack a lot more of those circuits in the same space.
Re:RWKV RNN: Better than ChatGPT? by smaddox on Saturday March 25, 2023 @03:58PM (#35306625)
There's already at least one company with a product: Mythic AMP https://mythic.ai/products/m1076-analog-matrix-processor/

And there's several research papers about other architectures. For example: https://arxiv.org/abs/2205.05853

Re:RWKV RNN: Better than ChatGPT? by IIAOPSW on Thursday March 23, 2023 @07:14PM (#35282842)
How will you know which voice in your head is yours? Maybe you are both.
Re:RWKV RNN: Better than ChatGPT? by LoganDark on Thursday March 23, 2023 @08:24PM (#35283447)
> How will you know which voice in your head is yours? Maybe you are both.

As someone with DID I wonder this every single day.

Re:RWKV RNN: Better than ChatGPT? by wruza on Friday March 24, 2023 @06:55AM (#35287408)
Maybe that will teach us about fragility of our definition of consciousness and agency. For some reason many people think that they are insulated from outside effects unless they’re right in their brain. Which is not true.
Re:RWKV RNN: Better than ChatGPT? by coolspot on Thursday March 23, 2023 @08:21PM (#35283425)
Have you watched the movie “Her”?
Re:RWKV RNN: Better than ChatGPT? by pffft8888 on Friday March 24, 2023 @12:30AM (#35285099)
No, but I think an AI is going to be Them, by default, not Her. for a while, until we figure out if there is a neurological basis for gender, and if so, how to mimic it.
Re:RWKV RNN: Better than ChatGPT? by witheld on Friday March 24, 2023 @02:03AM (#35285576)
Don’t…read a book by its cover, my friend. Her is not particularly about the gender expression of the robot.
Re:RWKV RNN: Better than ChatGPT? by flangola7 on Friday March 24, 2023 @09:45AM (#35288993)
What is Them?
Re:RWKV RNN: Better than ChatGPT? by lahwran on Friday March 24, 2023 @06:51PM (#35296756)
like Her, but there could be many or there could be one
Re:RWKV RNN: Better than ChatGPT? by textninja on Friday March 24, 2023 @12:27AM (#35285088)
> Imagine having ChatGPT level AI running in an ASIC inside earphones.

Oh, it’s going in brains. And no, don’t sign me up.

Re:RWKV RNN: Better than ChatGPT? by eldenring on Friday March 24, 2023 @01:18AM (#35285338)
Would an ASIC really be better than GPUs? I'm not 100% sure but aren't low power GPUs essentially ASICs for matrix multiplication.
Re:RWKV RNN: Better than ChatGPT? by jossclimb on Friday March 24, 2023 @02:47AM (#35285820)
People will use this to create their perfect self. AI will give them witty, charismatic answers to help them get a job, find a mate, entertain others. Eventually they will become AI zombie husks.
Re:RWKV RNN: Better than ChatGPT? by danielbln on Friday March 24, 2023 @02:59AM (#35285894)
Until this tech moves into our brains. AI wetware ushering in transcendence.
Re:RWKV RNN: Better than ChatGPT? by dreamcompiler on Friday March 24, 2023 @04:46AM (#35286590)
Did the name "Dixie Flatline" just pop into anybody's head?

https://williamgibson.fandom.com/wiki/Construct