News for hackers. Stuff that matters.
Re:MLow: Meta's low bitrate audio codec by hubraumhugo on Thursday June 13, 2024 @01:31PM (#40672304)
Is it just my perception or has Meta become cool again by sharing a ton of research and open source (or open weights) work?

Facebook's reputation was at the bottom, but now it seems like they made up for it.

Re:MLow: Meta's low bitrate audio codec by nine_k on Thursday June 13, 2024 @01:45PM (#40672474)
I have the same impression.

Facebook the social network reputation may be not shiny, but Meta the engineering company reputation is pretty high, to my mind.

It's somehow similar to IBM, who may look not stellar as a hardware or software solutions provider, but still have quite cool research and microelectronics branches.

Re:MLow: Meta's low bitrate audio codec by danuker on Thursday June 13, 2024 @02:00PM (#40672644)
I don't think they made up for it. They are training AIs off of personal data. The open stuff are a desperate red herring.

https://www.theregister.com/2024/06/10/meta_ai_training/

Re:MLow: Meta's low bitrate audio codec by jhallenworld on Thursday June 13, 2024 @03:50PM (#40673850)
So this is one argument- another is that I'm impressed that they got their own LLM running and integrated into facebook messenger.

I ran across this interesting graphic recently:

https://www.theverge.com/2023/12/4/23987953/the-gpu-haves-an...

Suddenly facebook is useful as a search engine..

Also interesting is that Meta AI is much faster than ChatGPT from end-user's point of view, but results not quite as good. Here is a comparison:

https://www.youtube.com/watch?v=1vLvLN5wxS0

Re:MLow: Meta's low bitrate audio codec by jen729w on Thursday June 13, 2024 @05:46PM (#40675191)
> a desperate red herring.

Or you can recognise that ‘Meta’ isn’t a conscious entity, and that it’s perfectly likely that there are some people over there doing amazing open-source work, and different people over there making ethically dubious decisions when building their LLMs.

Re:MLow: Meta's low bitrate audio codec by account42 on Friday June 14, 2024 @04:13AM (#40678739)
The people doing amazing open-source work are also making the ethically dubious decision of supporting the other group by working for FB.
Re:MLow: Meta's low bitrate audio codec by jen729w on Friday June 14, 2024 @07:11AM (#40679653)
Ah I think this is bullshit to be honest.

I’ve worked for dozens of organisations in my career. Large and small, competent and not. Usually not.

In that time did I make some ‘ethically correct’ choice to leave an enormous organisation because some other part of that organisation did something that wasn’t ethically perfect?

Never. Not one time.

And I’m an ethical person. I consider this stuff deeply. Here I am bothering to have this conversation with you.

But, what, every person who has an interesting job doing good things — remember, we’re talking about engineers developing a new audio codec — so those people who have interesting jobs doing good things with a great team are expected to look over there to some distant part of the org, to teams they’re barely aware of, let alone have spoken to, and they’re expected to quit their jobs because of the ‘ethically dubious’ stuff going on over there?

Sorry. Unrealistic, idealistic bullshit. I’ve never done it and neither have you.

Re:MLow: Meta's low bitrate audio codec by bishbosh on Friday June 14, 2024 @01:05PM (#40682562)
Not the person you're responding to, but I guess I would just have to flip that back around and say really this is bullshit to be honest.

I guess I don't really feel that you can just say you're an ethical person and have it absolve yourself of impact of your work.

It doesn't seem a stretch to say that the goals of meta are propagated by the things meta focuses work on, and even if one isn't on the forefront of stealing data, intruding on privacy, or maximizing engagement at all costs, doesn't mean nothing they do will play a part in those teams.

At the end of the day, even accounting at the orphan crushing factory plays a part in the orphan crushing machine.

Re:MLow: Meta's low bitrate audio codec by RIMR on Thursday June 13, 2024 @03:50PM (#40673849)
I would say that I have a very favorable opinion of Meta in terms of how they share their research and open source their software.

I would say that I have a very unfavorable opinion of Meta in terms of their commitment to privacy, security, and social responsibility.

Re:MLow: Meta's low bitrate audio codec by mrguyorama on Thursday June 13, 2024 @01:40PM (#40672414)
How the hell does releasing one audio codec undo years and years of privacy nightmare, being a willing bystander in an actual genocide, experimenting with the emotions of depressed kids, and collusion to depress wages?
Re:MLow: Meta's low bitrate audio codec by risho on Thursday June 13, 2024 @01:46PM (#40672495)
it isn't just one audio codec. they also released and continue to release the best self hostable large language model weights, they have authored many open source projects that are staples today such as zstandard, react, pytorch
Re:MLow: Meta's low bitrate audio codec by stuxnet79 on Thursday June 13, 2024 @02:17PM (#40672800)
You will need to provide citations on the last point as Facebook are widely known to have broken the gentleman's agreement between Apple and Google that was suppressing tech pay in the early 2010s.
Re:MLow: Meta's low bitrate audio codec by giraffe_lady on Thursday June 13, 2024 @02:34PM (#40673013)
OK sure even if they didn't do that we're still left with "knowingly abetted a genocide" which no amount of open source work can ever balance out.
Re:MLow: Meta's low bitrate audio codec by rylittle on Thursday June 13, 2024 @02:57PM (#40673241)
context?
Re:MLow: Meta's low bitrate audio codec by _whiteCaps_ on Thursday June 13, 2024 @03:00PM (#40673278)
Re:MLow: Meta's low bitrate audio codec by robertlagrant on Thursday June 13, 2024 @04:01PM (#40673999)
This article seems to not really mention the "knowingly" or the "abetted". If there are people killing other people, I wouldn't say that a communication method was to blame. In Scream, Sidney didn't sue the phone company who let the killer call her from inside the house. The idea that some news feed posts whipped people up into a killing frenzy just sounds absurd.

I wish the author could see that, and if the case is valid, to provide it, instead of some pretty tenuous claims of connection strung together to lead up to a demand for money.

I did try to go to the link that evidenced the "multiple" times Facebook was contacted in a 5 year period, but I couldn't get through. How many times was it, for anyone who can?

Re:MLow: Meta's low bitrate audio codec by giraffe_lady on Thursday June 13, 2024 @05:07PM (#40674792)
The full report is linked to in the first paragraph. These points are all addressed in detail there.
Re:MLow: Meta's low bitrate audio codec by upwardbound on Thursday June 13, 2024 @07:37PM (#40676058)
Re:MLow: Meta's low bitrate audio codec by zorked on Friday June 14, 2024 @06:11AM (#40679338)
This is a very low-quality comment. Amnesty International published a substantial, well-researched, well-sourced study. Your comment is low-effort Internet skepticism based on ignorance and a straw-man argument.

Read the report, gather data, then criticize it.

Re:MLow: Meta's low bitrate audio codec by robertlagrant on Friday June 14, 2024 @07:16AM (#40679688)
I'm talking about the article, not the report, and I tried to make clear where I didn't know things. Not sure what else would be appropriate.
Re:MLow: Meta's low bitrate audio codec by bishbosh on Friday June 14, 2024 @01:11PM (#40682631)
> If there are people killing other people, I wouldn't say that a communication method was to blame. In Scream, Sidney didn't sue the phone company who let the killer call her from inside the house. The idea that some news feed posts whipped people up into a killing frenzy just sounds absurd.

This is the core of your point and a comment on the idea itself, not the way the article portrayed it. I think it's fare to characterize your dismissal as glib.

Re:MLow: Meta's low bitrate audio codec by pt_PT_guy on Thursday June 13, 2024 @01:42PM (#40672437)
they also did release LLM models, and zstd, and mold, and and and... a lot of stuff
Re:MLow: Meta's low bitrate audio codec by cheema33 on Thursday June 13, 2024 @01:50PM (#40672545)
Don't forget React. The most popular frontend stack at the moment. Been that way for some time.

And GraphQL, Relay, Stylex...

Re:MLow: Meta's low bitrate audio codec by XlA5vEKsMISoIln on Thursday June 13, 2024 @03:45PM (#40673774)
>React

Ah yes, the <body id="app"></body> websites.

Re:MLow: Meta's low bitrate audio codec by cztomsik on Thursday June 13, 2024 @05:56PM (#40675292)
How is that specific to React? And who would use webapp technology for a website?
Re:MLow: Meta's low bitrate audio codec by XlA5vEKsMISoIln on Friday June 14, 2024 @04:32PM (#40684816)
According to cheema33 React is most "popular frontend stack", but I'm not allowed ask questions of why websites demand JS to display basic content... I suppose my reply could have been more _constructive_ as to ask "by whose count" or "how does popularity correspond to quality" but that's like playing chess by one step in front of you.

Look, I'm seeing an increase of blogs made with an implication that _infinity_ amount of visits requires less resources than one and I don't just find it true.

Re:MLow: Meta's low bitrate audio codec by account42 on Friday June 14, 2024 @04:07AM (#40678699)
Yeah, feels more like another reason to hate them for contributing to the enshittification of the web.
Re:MLow: Meta's low bitrate audio codec by visarga on Thursday June 13, 2024 @01:49PM (#40672526)
React and Pytorch

compare that to Angular and TensorFlow, such a difference in culture

Re:MLow: Meta's low bitrate audio codec by hot_gril on Thursday June 13, 2024 @04:03PM (#40674023)
Easy vs tons-o-boilerplate.
Re:MLow: Meta's low bitrate audio codec by ComputerGuru on Thursday June 13, 2024 @03:01PM (#40673291)
zstd and mold are personal projects regardless of employer. That said, I didn’t know mold was written by a meta guy.
Re:MLow: Meta's low bitrate audio codec by lucb1e on Thursday June 13, 2024 @04:26PM (#40674324)
Zstd is a personal project? Surely it's not by accident in the Facebook GitHub organization? And that you need to sign a contract on code.facebook.com before they'll consider merging any contributions? That seems like an odd claim, unless it used to be a personal project and Facebook took it over

(https://github.com/facebook/zstd/blob/dev/CONTRIBUTING.md#co...)

Re:MLow: Meta's low bitrate audio codec by ComputerGuru on Thursday June 13, 2024 @09:13PM (#40676610)
All Google dev’s personal projects are under the Google account on GH for legal reasons. I assume the same for Facebook. I believe fb championed zstd and lets the dev work on it at work but it was a personal project iirc.
Re:MLow: Meta's low bitrate audio codec by account42 on Friday June 14, 2024 @04:06AM (#40678695)
> mold

The linker? How is facebook involved in that?

Re:MLow: Meta's low bitrate audio codec by yard2010 on Thursday June 13, 2024 @05:34PM (#40675059)
You forgot selling the 2016 US elections to Putin for 100k[0]

Good luck undoing that releasing codecs haha

[0] https://time.com/4930532/facebook-russian-accounts-2016-elec...

Re:MLow: Meta's low bitrate audio codec by lovecg on Thursday June 13, 2024 @10:36PM (#40677048)
If $100k worth of internet ads can really sway an election boy are we in trouble.
Re:MLow: Meta's low bitrate audio codec by lucb1e on Thursday June 13, 2024 @04:20PM (#40674243)
research department != product department

Microsoft Research also puts out some really cool stuff, but that does not mean the "same" Microsoft can't show ads in their OS' start menu for people's constant enjoyment. I noticed this interesting discrepancy in Microsoft some years ago as a teenager; it does not surprise me at all that Facebook has a division doing cool things (zstandard, etc.) and a completely separate set of people working towards completely different goals simultaneously. Probably most companies larger than a couple hundred people have such departmental discrepancies

Re:MLow: Meta's low bitrate audio codec by callalex on Thursday June 13, 2024 @09:56PM (#40676821)
I racked my brain and couldn’t think of a single example of something released by Microsoft Research offhand, so I proceeded to visit their website. It can be found at https://www.microsoft.com/en-us/research/

I found exactly zero things that they have provided to the world. Literally none, and I really came in with an open mind. All I found was marketer drivel telling me how I should feel about the impact of the marketing copy I was currently reading. No concrete examples after fanning out 3 links deep into every article posted on that site. I must be missing something so can you point me to at least one example of work that’s come out of Microsoft Research on the same scale as Meta’s LLM models or ReactJS?

Re:MLow: Meta's low bitrate audio codec by throwaway91239 on Thursday June 13, 2024 @10:31PM (#40677029)
This is a surprisingly negative take, you should look a little further. Microsoft Research has done an incredible amount of high quality research. I've mostly read papers from them on programming languages, they have or did employ leading researchers behind C#, F#, Typescript (of course), as well as Haskell (Simon Peyton Jones and Simon Marlow spent a long time there), F*, and Lean (built by Leonardo de Moura while at MSR). MSR's scope has been much broader than just languages, of course.

You could look at their blog: https://www.microsoft.com/en-us/research/blog/

Or their list of publications: https://www.microsoft.com/en-us/research/publications/

Here's a (no longer updated, apparently) list of awards given to researchers at Microsoft: https://www.microsoft.com/en-us/research/awards-archive/

I've heard in interviews that MSR's culture is not what it used to be (like Bell Labs, maybe), but over time they've funded a ton of highly influential research.

Re:MLow: Meta's low bitrate audio codec by runeblaze on Friday June 14, 2024 @01:37AM (#40677815)
That page is written for marketing. My experience with industry research labs is that just like many places with somewhat misplaced incentive structures, a lot of the good research does not get marketed properly. e.g., the research marketing people will likely extoll more of the recent GenAI advances given that's more eyeball catching.

(Also on top of my head DeepSpeed is by MSR, which is used a lot in large scale ML training.)

Re:MLow: Meta's low bitrate audio codec by amenghra on Friday June 14, 2024 @05:55AM (#40679263)
Leslie Lamport's TLA+ comes from MSR. You have likely directly benefited from this project, since it's been used to prove the correctness of many distributed systems, including pieces of AWS.

Z3 is a very popular open source SMT solver, also originating from MSR.

There's probably dozens of similar examples. You might not know about some of the work coming out of MSR, but it's probably impacting you indirectly.

It's similar to how we indirectly benefit from fundamental nuclear physics. Places like CERN have to solve engineering issues and those solutions trickle down to everyone.

Re:MLow: Meta's low bitrate audio codec by yard2010 on Thursday June 13, 2024 @05:26PM (#40674976)
Don't fall for it. They will find a way to let some powerful actors exploit the users for dimes.
Re:MLow: Meta's low bitrate audio codec by chefandy on Thursday June 13, 2024 @05:45PM (#40675170)
The marketing is def working. I'm sure we'd be pretty depressed by some of the projects that didn't make the blog cut.
Re:MLow: Meta's low bitrate audio codec by rldjbpin on Thursday June 13, 2024 @10:49PM (#40677103)
they've had a proven history of open-sourcing systems they engineered to power their services. cassandradb and (py)torch comes to mind.
Re:MLow: Meta's low bitrate audio codec by thenoblesunfish on Friday June 14, 2024 @03:09AM (#40678313)
Is there a peer reviewed paper associated with this, or just a blog post?