News for hackers. Stuff that matters.

netwrt

netwrt on Hacker News

Show HN: Deep learning framework from scratch, trains GPT-2 in 3 days

Posted by netwrt on Wednesday July 17, 2024 @08:15AM
from the show-hn dept.

https://github.com/bclarkson-code/Tricycle

I wanted to share Tricycle (https://github.com/bclarkson-code/Tricycle), a deep learning framework I built completely from scratch from Autograd to a GPT.I wanted a library that is fast and feature rich enough to train actual models while being simple enough that anyone with a bit of python experience can understand what is going on.The biggest milestone so far is training GPT-2 (124M) on 2.3B...

( Read More... | no comments | on HN )
Re:Ask HN: Who wants to be hired? (July 2024) on Monday July 01, 2024 @11:29AM (#40846750)
Location: London

Remote: Happy to work fully in person although hybrid is preferred.

Willing to relocate: For the right role

Technologies: Machine Learning (Language modelling, Computer Vision etc), Data Science, Python, Kubernetes

Resume: https://raw.githubusercontent.com/bclarkson-code/bclarkson-c...

Linkedin: https://www.linkedin.com/in/benedict-clarkson-779b43154/

Email: [email protected]

I'm a Senior Machine Learning Engineer looking for my next challenge. I have a strong background in Deep Learning: I built a state of the art CV model for cancer detection and I'm the author of the Tricycle (https://github.com/bclarkson-code/Tricycle) deep learning framework. I built it from scratch (nothing but python, numpy and a bit of cuda) and recently used it to successfully train a GPT-2 small model from scratch.

I'm looking for an AI Engineer role in london, preferably an AI research engineer role.

Re:Ask HN: Who wants to be hired? (May 2024) on Thursday May 02, 2024 @12:06PM (#40237823)
Location: London

Remote: Happy to work fully in person although hybrid is preferred.

Willing to relocate: For the right role

Technologies: Machine Learning (Computer Vision, NLP etc), Data Science, Python, Kubernetes

Resume: https://raw.githubusercontent.com/bclarkson-code/bclarkson-c...

Linkedin: https://www.linkedin.com/in/benedict-clarkson-779b43154/

Email: [email protected]

I'm a Senior Machine Learning Engineer looking for my next challenge. I have a strong background in Deep Learning: I built a state of the art CV model for cancer detection and I'm the author of the Tricycle (https://github.com/bclarkson-code/Tricycle) deep learning framework. I built it from scratch (nothing but python, numpy and a bit of cuda) and recently used it to successfully build and train a small language model.

I'm looking for an AI Engineer role in london

Re:Faer-rs: Linear algebra foundation for the Rust programming language on Wednesday April 24, 2024 @10:23AM (#40144738)
Does this include an einsum function? I find that it makes complex operations easier to work with
Re:Ask HN: Who wants to be hired? (January 2023) on Monday January 02, 2023 @02:08PM (#34222234)
Location: London, UK

Remote: No, but I’m happy to work hybrid

Willing to relocate: No

Technologies: Python, Pytorch, Tensorflow, Flask, AWS, GCP, Docker, kubernetes, SQL, Deep Learning, Computer Vision, Scientific Python Stack

Resume/CV: Available on request

Email: [email protected]

I am a Data Scientist/ML engineer with 4 years of experience with the full ML lifecycle, from raw data to models deployed to production. In my most recent role, I built a computer vision model for cancer detection that was proven to be state of the art in a clinical trial.

I love working with people to solve problems and I’m looking to join a great team!