News for hackers. Stuff that matters.

laughingman2

Research done by Prof. Subbarao on reasoning & planning with LLM seems to point in the negative.

https://www.youtube.com/watch?v=uTXXYi75QCU

He has lots of good threads distilling his research. https://twitter.com/rao2z

Re:Ask HN: Any interesting books you have read lately? on Thursday August 17, 2023 @10:13AM (#37161903)
Ways of Being: Animals, Plants, Machines: The Search for a Planetary Intelligence

by James Bridle. James pulls an brilliant move of using various examples in technology as a tool to help us rethink our place in nature & reconnect with the (beyond human) world.

He weaves a fascinating tale with myriads of threads such as Cybernetics, Neural Nets, Internet, Random Numbers, Analog computers, Slime molds, Sortition vs Voting, Mycelium, Mysticism in animals, Turing machines, Personhood of non-humans etc.

A nice summary to whet your appetite, https://pluralistic.net/2022/06/07/more-than-human/#umwelt

Re:The Bitter Lesson [pdf] on Wednesday August 16, 2023 @03:15PM (#37152174)
Search/Reasoning/Inference time compute, however you phrase it is still essential. You need search to improve upon learning to work in novel situations.
Re:The TikTok ban is a betrayal of the open internet on Tuesday March 28, 2023 @05:43AM (#35338053)
Can't unseen the amount of double negatives in this article.
I am working on RL and robotics. I came across Levin in Lex's podcast. And then went on a binge of his other podcast appearences. I agree totally with you, I would very much like to build agents that adapt to different circumstances like "simple organisms". I am not familiar with biology, but I plan to build competence here to follow Levin's work to a point that I could potentially collabrate with biologists or learn from their work. Any suggestions (books etc) that would be salient towards this goal is much appreciated!
Have you checked RSSM approach in DreamerV1,V2,V3,PlaNet? It uses deterministic (GRU hidden state) and discrete stochastic latent states. The deterministic and stochastic (sampled) latent state are used to predict the next state. I think the stochastic state might help with your problem a bit.
Re:Will We Know Alien Life When We See It? on Sunday January 08, 2023 @01:09AM (#34296542)
One interesting research group tackling this question is ex-computer engineer, currently biologist Prof. Micahel Levine's group.

They built xenobots (biological robots) from frog cells which are not evolutionarily programmed to do tasks which they accomplished. Their research in part deals with emergence of agency at multi-cellular level. And they want to get at the fundamental signatures of what makes some collection of agents into a new single agent at an higher level.

Checkout, https://youtu.be/XheAMrS8Q1c

And a new research paper (inhavent had the time to read yet) on this question of how coherent higher order agents emerge from underlying sub-agents.

https://www.frontiersin.org/articles/10.3389/fpsyg.2019.0268...

Re:Tim Bray · Private and Public Mastodon on Tuesday January 03, 2023 @04:32AM (#34229583)
Worth checking out farcaster (farcaster.xyz). They are working towards a solution where things are "sufficiently decentralised". The server admins can't prevent users from following one another etc.

https://www.varunsrinivasan.com/2022/01/11/sufficient-decent...

Re:Tim Bray · Private and Public Mastodon on Tuesday January 03, 2023 @04:30AM (#34229564)
Farcaster(farcaster.xyz) is working towards sufficiently decentralised social network (https://www.varunsrinivasan.com/2022/01/11/sufficient-decent...). It aims to have a model where server admins don't get the power to prevent users from following one another.
Re:Convert Apple NeuralHash model for CSAM Detection to ONNX on Wednesday August 18, 2021 @11:41AM (#28222813)
Does apple even encrypt the actual image data on device? Their system document says "payload = visual derivative + neural hash" and only that is encrypted with a secondary level encryption. And they didn't go through with e2ee for icloud last I heard. This elaborate system makes no sense if they very well could have done it in cloud.

It feels like elaborate privacy theatre trojan horse to introduce in device surveillance.

Re:A Sober Look at SPACs (2020) on Friday February 05, 2021 @12:24PM (#26038715)
His narrative pushing feels nefarious to me. I think he is using his new tech podcast (all-in) as a new platform to build a image of a pragmatic do-gooder billionare (to whomever who would buy that shtick), spin a new narrative and test out few ideas like (remove capital gains tax, he running for governorship) for approval.

If GME debacle taught us (again?) anything, it's that markets are moved by narratives. And those raccoons who control the narrative can move the market towards their favour.

Great post on epsilon theory on this https://www.epsilontheory.com/hunger-games/

I have experience in deep learning research/engineering in NLP and am getting into ml for robotics.

Really excited for this course + hardware. I think one top value for me personally is that more time could be spent on hacking the ml algorithms, replicating and comparing with real research work (https://www.duckietown.org/archives/63665).

I live in India and find the shipping costs of MOOC Founder's Edition Kit (369 USD + 49 USD) a bit expensive. Just the Duckiebot MOOC Founder's Edition costs 14 USD to ship.idk what custom duty would the govt put on it :(.

1. Is there any alternative to shipping it? 2. Is there anyway to build similar bot from parts for the course? 3. I guess, since you're non-profit it's made such that it's cost effective rather than for profit. It would be great if you describe why you chose each of the component for the current bot.

If uber/lyft doesn't allow their drivers to price themselves and not treat them as employers, they are more or less a cartel rather than a marketplace connecting buyers and sellers of a service.

Maybe they can show a optimal price and allow drivers to change that and charge drivers for the customers they get from the platform.

Re:Org-roam: Rudimentary Roam replica with Org-mode on Monday April 06, 2020 @01:23AM (#22791096)
Same thing happened to me. I was using org-mode for GTD and note-taking for the past six months. I shifted all my notes to org-roam with links between them. But then I tried roam, it's UX really won over me.

One thing was accessing my notes with all roam features in all the devices. I don't have to setup dropbox/syncthing/whatever in every machine I own and install emacs with my settings every time. And mainly mobile, If I use orgzly, I don't get any benefit of org-roam in it. So I gave up and embraced roam cloud.

I think there is a huge gap to be filled for a device agnostic emacs that works well on mobile (touch), browser, native and is programmable.

Re:The origin story of the N95 mask on Monday March 30, 2020 @05:16AM (#22726372)
Masks can protect other people primarily. If you're sick and don't know (asymtomatic), developing symptoms only now, if you're sick and don't have any option but to go out etc.

And your point on masks not protecting incoming droplets is wrong. When people sneeze, droplets can go more than 5 feet. Masks reduce exposure to such droplets.

https://medium.com/@Cancerwarrior/covid-19-why-we-should-all...

Research is on going on how immunity responds to decreased exposure to viral loads.

And masks can remind people to not touch faces and remind others that we're in a pandemic.

Wouldn't Land Value Tax solve the housing problem?
Re:Thinking Fast and Slow, Deep Learning, and AI [video] on Tuesday January 14, 2020 @11:12PM (#22051703)
Would you consider using neural nets to solve integration and differential equations as it doing system 2 reasoning?

https://ai.facebook.com/blog/using-neural-networks-to-solve-...

Or what tasks are in the domain of system 2?

Re:Thinking Fast and Slow, Deep Learning, and AI [video] on Tuesday January 14, 2020 @09:53PM (#22051390)
Lex, you're doing an amazing job. The level of commitment and hard work you put in to make this podcast is incredible.

On the technical depth side criticism you're getting, I would say the one with Ian Goodfellow had optimal balance.

And don't take destructive criticism about bad attitude or tone etc by some commentors . For someone introverted it's already draining to put yourself in front of a camera ...

But why is microsoft experimenting with the toy language then?

https://www.infoq.com/news/2019/11/microsoft-exploring-rust-...

70% of microsoft errors would be gone in future if they start using what you demean as "toy" language.

https://www.zdnet.com/article/microsoft-70-percent-of-all-se...

Re:Worker-Owned Apps Are Trying to Fix the Gig Economy on Monday November 25, 2019 @11:30PM (#21635652)
This one isn't a Cartel as its like a taxi company but co-owned by workers. But Uber could be considered a cartel because they don't consider the car drivers as workers, so they are effectively setting prices for the market of drivers.
Re:Interfaces Generally Belong with Users on Saturday November 23, 2019 @10:23PM (#21618139)
I think allowing extensions on existing classes/structs can also solve this problem without having structural typing.

ie the client can create a new interface and explicitly implement it for existing classes/structs.

I think Swift and rust allows this.

Re:Beating C with Futhark Running on GPU on Friday October 25, 2019 @01:15PM (#21357076)
Rust.
Re:Leonardo Da Vinci’s To-Do List on Friday May 17, 2019 @11:43AM (#19940660)
Feynman and Einstein comes to mind.
Re:Strategies, Tips, and Tricks for Anki on Sunday May 05, 2019 @05:40AM (#19831964)
This post by Micheal Nielsen explores his strategies to convert stuff into Anki in detail.

http://augmentingcognition.com/ltm.html

Also this on math into Anki.

http://cognitivemedium.com/srs-mathematics

Older »