News for hackers. Stuff that matters.
Re:Facebook LLAMA is being openly distributed via torrents by londons_explore on Friday March 03, 2023 @07:12AM (#35008497)
If you were to steal a chunk of source code or a binary from meta/Google, you could probably get it running inside a few weeks effort.

Sure, the binary probably depends on a lot of internal proprietary infrastructure, but also most of that infrastructure is easy to write a mock implementation of, as long as you are happy for it to be in-ram, not multi-homed and don't need it to scale to billions of users.

Most of the binaries have a standalone mode for running on a developers PC with few/no dependencies anyway.

Re:Facebook LLAMA is being openly distributed via torrents by taldo on Friday March 03, 2023 @07:26AM (#35008623)
Good luck even getting a google3-based Hello World to compile. I don't remember the exact numbers, but just #including the most basic libs resulted in a O(100M) binary.

And anything more complex than that would probably have dependencies on so many fat client libs, so much infrastructure, and so many external services, that you'll need months-years to even make sense of them, let alone mock them up.

Re:Facebook LLAMA is being openly distributed via torrents by asah on Friday March 03, 2023 @07:24AM (#35008593)
-1: as an ex-googler, I can say it was hard enough for Google itself to get its code to run, given gonzo infrastructure assumptions, proprietary libraries/languages, etc.
Re:Facebook LLAMA is being openly distributed via torrents by rowanG077 on Friday March 03, 2023 @07:27AM (#35008626)
That speaks volumes of the code quality @ Google.
Re:Facebook LLAMA is being openly distributed via torrents by asah on Friday March 03, 2023 @07:52AM (#35008901)
sorry, but that's not how code works. It's true that code quality could be terrible but in fact Google is famous/notorious for extreme code review at the line-by-line granularity, plus comments, design docs and more.

The real issues are (again) in dependencies and complex tooling. You can have beautiful code and then in the middle of it, an ML inference call that assumes a crazy ML model and set of hardware to run it on.

Re:Facebook LLAMA is being openly distributed via torrents by rowanG077 on Friday March 03, 2023 @08:05AM (#35009034)
If your core logic is so dependent on environment state that it's impossible to get subsets running within multiple weeks of fulltime work then it's bad quality code.

Even just decent quality code keeps side effects isolated to the application fringe as much as possible.

Re:Facebook LLAMA is being openly distributed via torrents by ithkuil on Friday March 03, 2023 @08:38AM (#35009418)
It's a tradeoff.

Google has no incentives to allow an arbitrary component run standalone. Quite the contrary.

What they do get in return for the coupling is that they can evolve the common libraries and code patterns across the board (there are even automated code refactoring tools that help you do massive code changes, automating code review sessions across hundreds and hundreds of teams, with all changes tested against all reverse dependencies etc etc). All this allows for a level of internal code quality that is hard to see elsewhere.

Unless you really care a lot about that one requirement you seem to care about. In that case, yeah, you'd choose a different tradeoff.

Re:Facebook LLAMA is being openly distributed via torrents by owkman on Friday March 03, 2023 @08:26AM (#35009272)
Assume you got source for a game written in a proprietary game engine. If you don't have access to the game engine itself, nor the API documentation, etc, how long will it take to get this game running in your manner of choosing?

The infrastructure in these companies is a huge amount of scaffolding that's non-trivial to replicate.

Re:Facebook LLAMA is being openly distributed via torrents by fluoridation on Friday March 03, 2023 @08:46AM (#35009539)
Arguably it's not low quality code, but low quality system. Code can be correct, clear, and documented, and still be fragile and sensitive to platform configuration changes. E.g. "how many switches do I have to change in the build system before the code no longer builds?", "how many network jacks can I move this server over before I lobotomize the system?"
Re:Facebook LLAMA is being openly distributed via torrents by ibejoeb on Friday March 03, 2023 @08:22AM (#35009220)
You ought to be able to arrive at the same conclusion, then, with these LLMs. Without arrays of GPUs, it would take thousands of years to train one. Without a corpus of billions or trillions of words, one would produce output of very limited utility.

I think you have to consider that some things are systems, and it is the assembly of their components that imparts the true quality.

Re:Facebook LLAMA is being openly distributed via torrents by delecti on Friday March 03, 2023 @05:00PM (#35015627)
It's not poor code quality to depend upon available dependencies.
Re:Facebook LLAMA is being openly distributed via torrents by dgacmu on Friday March 03, 2023 @09:03AM (#35009764)
The effort to open source tensorflow was at least a person year worth of work to extract it from google3. Required reimplementing a bunch of stuff.
Re:Facebook LLAMA is being openly distributed via torrents by hiddencost on Friday March 03, 2023 @07:25AM (#35008610)
This is just wrong.