For example, my latest module (I am putting the finishing touches on this as we speak) uses LLMs to review catalysis literature and then summarize that and control another coding LLM that has been trained to run the simulation tools I created to try and reproduce the works in the papers. Yes, it works, the first catalyst discoveries were made just a few days ago.
What specifically have you trained your coding LLM on? Is it lora or something more advanced? Have you created a corpus by hand specifically for training?
This space is moving so quick I run many experiments every day.
I would love to work on this full time, I applied to y-combinator but I didn't get in :(
Personally I had to level up my math game a lot, when I started I had to keep pausing looking up terms, then write tiny prototypes, then keep learning. At the start it took me a month to read and understand a paper, now I can skim read them in minutes, without a passion for chemistry and the self discipline to keep at it I would have given up.
Take extensive notes, actually review them frequently, and refractor them as you learn.
Find mentors in the space, while reading papers I took names and reached out, I offered free programming to anyone who I found inspiring, and this built relationships with some pretty amazing professors and students around the world.
Hope that helps! <3
https://signal.nfx.com/investor-lists/top-material-science-s...
https://www.businesswire.com/news/home/20210412005180/en/TDK...
https://www.wsj.com/articles/bill-gates-backs-new-vc-fund-fo...
Is interpreting the other papers and translating them into simulation parameters a rate limiting step in catalysis research? Or is this like, fitting your simulation package’s parameters to get the same output as someone else’s?
I remember, e.g, Italy and Brazil had projects more than ten years ago where they used some sort of machine learning to find hidden historical buildings under terrain or jungle by looking at patterns in satellite/aerial image and it was successful in finding archeological sites in both countries.
A lot of the revolution is coming from material scientists doing the work of creating data sets that encode their knowledge, better computational techniques in the field (e.g. DFT[0]), and democratization of petabyte scale data pipelines.
Edit: here they are:
Energy:
- https://www.ycombinator.com/companies/elyos-energy
- https://www.ycombinator.com/companies/line-build
- https://www.ycombinator.com/companies/helios-climate-industr...
- https://www.ycombinator.com/companies/orbio-earth
Materials: https://www.ycombinator.com/companies/osium-ai
Security:
- https://www.ycombinator.com/companies/kobalt-labs
- https://www.ycombinator.com/companies/corgea
- https://www.ycombinator.com/companies/remy-security