News for hackers. Stuff that matters.

ebetica0

Show HN: ESM C, setting a new state of the art for protein language models

https://www.evolutionaryscale.ai/blog/esm-cambrian

Hey HN! We're releasing ESM C, a series of protein language models that set a new state of the art. By training on metagenomics and fine-tuning on UniRef, we're able to match ESM2 650M with ESM C 300M, and ESM C 6B has incredible unsupervised contact precision performance. These models are meant to be used as base models and representation learning models for protein sequences, and we'll...

( Read More... | 1 comment | 6 points | on HN )
Show HN:

We trained a bidirectional masked generative model on protein sequence, structure and function. ESM3 work over tokenized representations of multiple modalities and can generate proteins with high fidelity and controllability. ESM3 further improves with feedback using alignment methods similar to Reinforcement Learning from Human Feedback (RLHF) applied in LLMs.

We have prompted ESM3 to generate fluorescent proteins with a chain of thought. Among the generations that we synthe- sized, we found a bright fluorescent protein at far distance (58% identity) from known fluorescent proteins. Similarly distant natural fluorescent proteins are separated by over five hundred million years of evolution.

- Check out our github repository: https://github.com/evolutionaryscale/esm

- Read the paper: https://www.evolutionaryscale.ai/papers/esm3-simulating-500-...

- And make your own proteins on Colab: https://colab.research.google.com/github/evolutionaryscale/e...

But Facebook never sells the data itself, it only sells targeting capabilities. The government can only say "display this ad to people who fit these categories", but they can never see those identities.
I'm not quite sure what the innovation was for Apple pay - just that they put it on a phone?
"So for example, if you look at the U.S., productivity growth mid-century or say between, you know, 1920, 1970, was maybe about 1.9% a year. Now most economists think it’s much lower, maybe around sort of .4% a year, something like that."

Isn't this just because the US was riding off of the coattails of two world wars and being _the_ global superpower? I wonder what the data says about the rest of the world in that period, probably not so good?

Re:The SpaceX Starship is a big deal on Wednesday October 30, 2019 @01:28PM (#21400217)
According to the ITC, only 11.9% of the world has "Fixed broadband" aka wired internet. 30.1% in developed nations. There's a big gap, especially when the world catches up in a few years.
Believe it or not, cooling is almost never the bottleneck, aircooled datacenters can be built in relatively warm places like virginia. The infrastructure for datacenters is often the bottleneck - each one takes up the electricity of a small town and many out-of-the-way places don't have the infrastructure set up to support such things, nor do the local renewables provide enough energy to run the datacenters.
One of the smaller Asian grocers in New York City has made the best fake meat I've had by far, and I wouldn't be surprised if it sources for many of the vegetarian Asian restaurants in the city. http://www.maywahnyc.com/ I wonder how many other places exist in the world like it, and how much a little bit of marketing would do for them.
I wonder how much statistical independence has to play in this. e.g. the large crowd can be biased when they influence each other in a way that the small debates cannot. What happens when you have small independent debates versus large independent crowds?
Re:TorchCraft – StarCraft: Brood War AI on Wednesday May 02, 2018 @04:17PM (#16980784)
The other side of the coin is that the game engine for StarCraft II is signifcantly smoother, and so its dynamics are easier for models to learn. Brood war has all kinds of weird quirks and dynamics, and some "bugs" are part of the game system, so it's much harder for computers to reason about some of these kinds of things.