Non-determinism in GPT-4 is caused by Sparse MoE

Re:Non-determinism in GPT-4 is caused by Sparse MoE by mschuster91 on Saturday August 05, 2023 @08:04AM (#37011197)

> I would generally refrain from insulting other people's code if you don't know much about the system it's written on.

Well, the general state of how utterly shoddy most of the code in the AI/ML ecosystem is is observable to anyone trying to follow a guide on how to set up Stable Diffusion on AWS. It's a fucking mess of trying various combinations of driver versions, Ubuntu kernel versions, Python versions, and the fact that Python requirements.txt (similar to NodeJS) doesn't pin versions of transitive dependencies doesn't make it easier because it makes for very brittle and not reproducible builds/guides. Oh, and at least some of that stuff won't work without root.

Yeah I'll keep AI shit cordoned off in its own subnet.

[ Parent | on HN ]

Re:Non-determinism in GPT-4 is caused by Sparse MoE by earthboundkid on Saturday August 05, 2023 @10:50AM (#37012570)

Years before ChatGPT I made the joke that AI would want to take over the world like a computer virus, but it’s written in Python, so it can’t figure out how to install itself on other computers.

I think the joke was on Twitter, RIP.

[ Parent | on HN ]

Re:Non-determinism in GPT-4 is caused by Sparse MoE by mschuster91 on Saturday August 05, 2023 @08:26PM (#37017663)

I 'member that joke. Think it must have gone around while OpenStack transitioned from Python 2 to 3. What a fucking mess.

[ Parent | on HN ]