News for hackers. Stuff that matters.
Re:Clip: Connecting Text and Images by gravy on Tuesday January 05, 2021 @04:00PM (#25650968)
Sometimes I look at stuff like this and sit in despair that I'm not learning anything that will let me work these kinds of problems while I work at a defense contractor maintaining 20+ year old code.
Re:Clip: Connecting Text and Images by panabee on Tuesday January 05, 2021 @04:35PM (#25651457)
you can catch up very quickly.

great resource on transformers, which underpin the openai breakthroughs (the "T" in GPT-3 stands for transformer): http://peterbloem.nl/blog/transformers

great reddit sub for tracking ml research and trends: https://www.reddit.com/r/machinelearning

great email newsletter on ml from andrew ng: https://www.deeplearning.ai/thebatch/

also, someone must maintain old code or things break. thanks for your contributions.

Re:Clip: Connecting Text and Images by modeless on Tuesday January 05, 2021 @04:42PM (#25651534)
The field is young and unlike mature fields such as physics or mathematics it doesn't take a lifetime of study to master, yet. Neural nets are actually pretty simple at their core; seemingly too simple to work as well as they do.

It's entirely possible to learn this stuff to near state-of-the-art level with a year or two of self-directed study outside of work. All the research is published open access, the software is open source, there are many high quality datasets available, hardware access is simple and free through Colab, and there are dozens of online courses and lectures at every level from beginner all the way to the cutting edge, again all free.

Re:Clip: Connecting Text and Images by gravy on Wednesday January 06, 2021 @09:57AM (#25658280)
Do you recommend any beginner courses?
Re:Clip: Connecting Text and Images by panabee on Wednesday January 06, 2021 @02:11PM (#25661048)
stanford offers free machine learning courses.

reddit.com/r/learnmachinelearning is also helpful for beginners.

Re:Clip: Connecting Text and Images by android2222 on Tuesday January 05, 2021 @04:05PM (#25651039)
Haha you are not alone as I do the same on an old CRM for non-profits. I'm thinking about going back to school to gain the missing math and science I need to get myself to a more challenging job. Boring business software just ain't fun. But it pays :)