News for hackers. Stuff that matters.

vincentschen

Show HN: Open Benchmarks Grants– a $3M commitment to close the AI eval gap

https://benchmarks.snorkel.ai/closing-the-evaluation-gap-in-agentic-ai/

Today, we're launching the Open Benchmarks Grants: a $3M commitment to fund open-source and academic teams building benchmarks for AI agents. In partnership with HuggingFace, PrimeIntellect, FactoryHQ, Together, Harbor, and PyTorch, the grants provide funding, data development support, and research collaboration.Our ability to measure AI has been outpaced by our ability to develop it, and we...

( Read More... | no comments | 6 points | on HN )
Re:Learning Math for Machine Learning on Wednesday August 01, 2018 @02:32PM (#17665504)
I love 3blue1brown! Will add to resources. :)
Re:Learning Math for Machine Learning on Wednesday August 01, 2018 @02:29PM (#17665451)
Looks interesting! Have you gone through it yourself? And how does it compare to other resources?
Re:Learning Math for Machine Learning on Wednesday August 01, 2018 @02:28PM (#17665442)
Thanks for the reference... will give it a read.
Re:Learning Math for Machine Learning on Wednesday August 01, 2018 @02:24PM (#17665380)
Thanks for the heads up!
Re:Building for the Blockchain on Tuesday January 09, 2018 @03:39PM (#16109820)
thanks for the resource!
Re:Building for the Blockchain on Tuesday January 09, 2018 @01:22PM (#16108398)
Yes, the lack of outside access isn't necessarily a bug, but it can be a development hurdle!
Re:Show HN: VR Teacher Studio on Friday May 05, 2017 @03:51PM (#14276323)
teaching tool; create lessons in VR and export as 2D content (videos/gifs)

would love feedback about the idea/potential next steps!

Re:How to Get into VR on Friday May 05, 2017 @03:30PM (#14276170)
Super interesting... I definitely wonder how VR/AR might change the way we think about architecting spaces in general.
Re:How to Get into VR on Friday May 05, 2017 @03:25PM (#14276134)
Yes, perhaps I could have been more clear here. As I mentioned in the post, while technology is certainly not new, it's more accessible, such that creators have access to it as a new medium.
Re:How to Get into VR on Friday May 05, 2017 @03:18PM (#14276092)
This looks awesome! What are some of the engineering/hci challenges you've come across?
Re:How to Get into VR on Wednesday May 03, 2017 @03:52PM (#14259390)
This is still a big problem that could hold the technology back... VR devs have the responsibility of creating experiences that don't cause simulator sickness. Ideally, with more powerful systems in the coming years, we'll have the ability to increase performance so our visual and vestibular cues don't get mixed up in VR.
Re:How to Get into VR on Wednesday May 03, 2017 @03:50PM (#14259376)
No! To get started, there are many opportunities for VR dev on smartphones. You can even start working with hand-tracking with the new Samsung Gear/Google Daydream!

However, you do need a PC with a pretty good GPU if you want to get serious about playing with more advanced systems like the Vive and the Rift. (This was a great resource for me when I built my PC! http://www.logicalincrements.com/articles/vrguide)

Re:How to Get into VR on Wednesday May 03, 2017 @03:38PM (#14259273)
I agree that there are much fewer applications of VR "now", but let's consider its timeline: the first mainstream HMD (Oculus Rift) was released in 2012. Last year (2016) was the first time that hand-tracking was introduced by Oculus and HTC. If anything is holding back the industry right now, it's the lack of content, but keep in mind that we are still incredibly early!
Re:How to Get into Natural Language Processing on Saturday January 21, 2017 @02:27AM (#13449261)
Perhaps the distinction between "analysts" and "builders" would be better context for discussing math background in startups than PhDs.
Re:How to Get into Natural Language Processing on Saturday January 21, 2017 @02:01AM (#13449208)
That's a great point. I wonder if there would be a better way to introduce meaningful, actionable topics of study to an introductory-level audience of people who may have never heard of NLP.
Re:How to Get into Natural Language Processing on Friday January 20, 2017 @03:05PM (#13446583)
So glad that you enjoyed the post! What are other topics that you've wanted to hear about?