News for hackers. Stuff that matters.
Re:Pyro: The Universal, Probablistic Programming Language by abeppu on Friday July 28, 2023 @01:43PM (#36910452)
Re your comment on CS PhDs not having probability background -- do you find that's true of ML researchers? I would understand that in a bunch of CS specialties, probability may not be a requirement, but in ML I would have expected otherwise.
Re:Pyro: The Universal, Probablistic Programming Language by gh02t on Friday July 28, 2023 @02:30PM (#36911155)
Not OP but I deal with this a lot. In my experience a lot of folks working in mainstream ML haven't been exposed to it unless they specifically focused on it. It might just be a course load thing... getting the most out of these probabilistic PLs requires fairly deep expertise in both probability theory/Bayesian stats as well as in CS and you have a finite amount of courses you can take in school. Plus, a lot of the work in this area pre-dates the modern focus on deep learning or machine learning in general, so a lot of the knowledge tends to be held by professors/researchers that may not be as involved with the "new" ML courses. And of course, Math/Stats/CS departments don't always play nicely with each other and like to fight turf wars, though I've noticed cross-disciplinary research among the three becoming more accepted at the universities/institutes I work with.

As a case study, I did most of my grad work on solving Bayesian inverse problems using probabilistic programming for applications in engineering, which is pretty cross-disciplinary. I now work mostly in ML, but I didn't really even touch anything in the ML domain until after I finished school. I could have, the courses were available, but they just weren't relevant to me at the time.

Re:Pyro: The Universal, Probablistic Programming Language by seanmcdirmid on Friday July 28, 2023 @07:08PM (#36914608)
One of the best ML researcher I know has a background in signal processing (and degrees in EE to go with). Not probability per se, but heavily uses probability and statistics.
Re:Pyro: The Universal, Probablistic Programming Language by antegamisou on Friday July 28, 2023 @08:16PM (#36915236)
> has a background in signal processing

Which largely counts as strong Linear Algebra and Probability Theory background.

Re:Pyro: The Universal, Probablistic Programming Language by junipertea on Friday July 28, 2023 @02:30PM (#36911163)
While there are some exception, majority of published deep learning research barely mentions statistics at all, it's optimization all the way down
Re:Pyro: The Universal, Probablistic Programming Language by uoaei on Friday July 28, 2023 @03:22PM (#36911922)
ML is fundamentally not a CS specialty. It is a statistics/optimization (thus applied math) specialty.

CS only comes into the picture at runtime. ML theory is divorced from computability until then.

Re:Pyro: The Universal, Probablistic Programming Language by ke88y on Friday July 28, 2023 @03:32PM (#36912082)
That's a weird game to play with those words.
Re:Pyro: The Universal, Probablistic Programming Language by uoaei on Friday July 28, 2023 @06:49PM (#36914424)
Can you elaborate? The unreasonable effectiveness of approximate methods on discretized spaces doesn't change the fact that the theory underlying it is exact and continuous.
Re:Pyro: The Universal, Probablistic Programming Language by ke88y on Saturday July 29, 2023 @02:10PM (#36922905)
ML is a sub field of CS, in practice.

You don’t need a professional license to do math. Lots of computer scientists to harder and more interesting mathematics than their peers in the math dept. In that respect at least, the main substantive difference between the fields is about $40k/yr.

Re:Pyro: The Universal, Probablistic Programming Language by uoaei on Saturday July 29, 2023 @05:40PM (#36924950)
> ML is a sub field of CS, in practice.

You're just stating things without justifying them.

Re:Pyro: The Universal, Probablistic Programming Language by ke88y on Tuesday August 01, 2023 @09:18PM (#36965711)
Again, this is such a weird game to play with words. I'm not sure what else to say.
Re:Pyro: The Universal, Probablistic Programming Language by latenightcoding on Friday July 28, 2023 @10:32PM (#36916230)
ML people nowadays barely know basic stats.
Re:Pyro: The Universal, Probablistic Programming Language by Given_47 on Friday July 28, 2023 @11:03PM (#36916428)
Disappointed black guy meme upon realizing a lot of “data science” is just calling some scikit learn module lol
Re:Pyro: The Universal, Probablistic Programming Language by sloozbug on Saturday July 29, 2023 @02:15AM (#36917436)
lmao please link disappointed black guy meme appropriate for the times haha
Re:Pyro: The Universal, Probablistic Programming Language by Given_47 on Sunday July 30, 2023 @02:41PM (#36934527)
Re:Pyro: The Universal, Probablistic Programming Language by esafak on Saturday July 29, 2023 @12:26AM (#36916913)
ML is going mainstream. Most programmers don't know algorithms and data structures, I bet, if you consider all programmers around the world.
Re:Pyro: The Universal, Probablistic Programming Language by uoaei on Saturday July 29, 2023 @02:29AM (#36917495)
Normalcy is not a substitute for correctness.
Re:Pyro: The Universal, Probablistic Programming Language by ur-whale on Saturday July 29, 2023 @10:38AM (#36920749)
> ML people nowadays barely know basic stats.

The same can unfortunately be said of many "statisticians", who use statistics as a big recipe book without understanding the first thing about the mathematical underpinnings of the topic.

Don't believe me?

Go ask the first statistician you run into to give you a half decent of how the Chi-squared distribution and the Chi-squared test works, see what happens.