wfalcon
Build your own AI model inference engines
Agent sandbox: safe, persistent cloud environments for agents
- persistent storage (setup env and data persists across restarts)
- free ssh and connect your local IDE
- CPU setup, GPU run (do setup work on CPUs and switch to run on a GPU when ready)
- no credit card
- pay-as-you-go if you need more GPU hours
- A100s, H100s, and more GPUs available
Lightning AI hub: Production AI in your cloud in minutes
Deploy dedicated DeepSeek 32B on L40 GPUs ($8/hour)
I'm crazy: I deployed DeepSeek in my company VPC in <24 hours without Kubernetes
Deploy a custom Llama 3 API in 15 lines of code
Thunder – A new compiler for PyTorch that can use many device executors at once
Remote GPU development with VSCode [video]
Interview with Facebook AI SWAV first author, (SOTA in Self-supervised learning)
5-Minute deep dive into multi-GPU training
We want people to build on Lightning and we want companies to deliver value and products for their users.
We place no limitations on how Lightning is use or what products people will build.
Our in-process patent portfolio is not to limit the use of lightning in any way but for defensibility purposes only.
If you have any other inquiries please email [email protected] for more details.
We want people to build on Lightning and we want companies to deliver value and products for their users.
We place no limitations on how Lightning is use or what products people will build.
Our in-process patent portfolio is not to limit the use of lightning in any way but for defensibility purposes only.
If you have any other inquiries please email [email protected] for more details.
Just that if you use lightning you'll have zero friction. Well as with the others... you might run into issues inherent in the other framework's hard to work with designs.
Not a nice move for the opensource spirit. Also, pretty sure it's a violation of our patent and 100% copyright infringement.
https://pytorch-lightning.readthedocs.io/en/latest/tpu.html#...
We just need to be a part of the effort to help bridge the big gap and barriers keeping users from TPU adoption.
https://pytorch-lightning.readthedocs.io/en/latest/tpu.html#...
One of the professors at my lab at NYU CILVR (Kyle Cranmer) i believed was super involved with this. Will definitely sync up with him!
Thanks for the heads up!
Second, electricity was a great new technology (ie: AI), but you needed the power grid to make it usable - that's grid AI.
For us is basically integrating clouds directly into your code so the barrier disappears and the cloud providers become an extension of your laptop.
TPU support is VERY real... but yes, sometimes it breaks but PyTorch and Google are working very hard to bridge that gap.
But we have dedicated partners at Google on the TPU team working to get Lightning working seamlessly on pods.
Check out the discussions here: https://github.com/PyTorchLightning/pytorch-lightning/issues...
100% agree with you that going the other way is likely not the best approach.
Lightning + Grid elevates and turns non experts closer to researchers... ie: focus on building the products and doing science and not the engineering.
That's what lightning excels at today. That's the experience Grid will 10x.
But calling Grid an ML Ops startup is like calling Lightning Keras... maybe at a quick blink it looks like that, but that's where the similarities end.
For what it's worth, a lot of what we're building comes from my experience at FAIR.
Not just a marginal improvement on that experience but a 10x completely different approach.