News for hackers. Stuff that matters.

wfalcon

Re: on Friday February 21, 2025 @09:58AM (#43128163)
Studios are a great google colab alternative with:

- persistent storage (setup env and data persists across restarts)

- free ssh and connect your local IDE

- CPU setup, GPU run (do setup work on CPUs and switch to run on a GPU when ready)

- no credit card

- pay-as-you-go if you need more GPU hours

- A100s, H100s, and more GPUs available

Re:LoRA from Scratch implementation for LLM finetuning on Monday January 22, 2024 @05:32PM (#39096466)
this is also what our (Lightning AI) lit-gpt library does. https://github.com/Lightning-AI/lit-gpt
welcome to Lightning AI! Mike, super excited to drive the future of ML together.
Re:Grid: AI platform from the makers of PyTorch Lightning on Friday October 09, 2020 @01:51PM (#24732483)
Just to be 100% clear.

We want people to build on Lightning and we want companies to deliver value and products for their users.

We place no limitations on how Lightning is use or what products people will build.

Our in-process patent portfolio is not to limit the use of lightning in any way but for defensibility purposes only.

If you have any other inquiries please email [email protected] for more details.

Re:Grid: AI platform from the makers of PyTorch Lightning on Friday October 09, 2020 @01:51PM (#24732479)
Just to be 100% clear.

We want people to build on Lightning and we want companies to deliver value and products for their users.

We place no limitations on how Lightning is use or what products people will build.

Our in-process patent portfolio is not to limit the use of lightning in any way but for defensibility purposes only.

If you have any other inquiries please email [email protected] for more details.

Re:Grid: AI platform from the makers of PyTorch Lightning on Friday October 09, 2020 @11:01AM (#24730521)
No! we want people to build on Lightning and we want companies to deliver value and products for their users.
Re:Grid: AI platform from the makers of PyTorch Lightning on Friday October 09, 2020 @10:50AM (#24730435)
No! we want people to build on Lightning and we want companies to deliver value and products for their users.
Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @05:34PM (#24724178)
No, we support other frameworks too!

Just that if you use lightning you'll have zero friction. Well as with the others... you might run into issues inherent in the other framework's hard to work with designs.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @05:32PM (#24724152)
maybe determined should come up with its own API instead of copying Lightning's :)

Not a nice move for the opensource spirit. Also, pretty sure it's a violation of our patent and 100% copyright infringement.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @05:30PM (#24724140)
we highlight these issues in our docs explicitly.

https://pytorch-lightning.readthedocs.io/en/latest/tpu.html#...

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @05:29PM (#24724131)
I 100% agree. We don't want to misrepresent TPU support. In fact, we explicitly warn users in our docs. Open to suggestions about how we can communicate this much better to our users.

We just need to be a part of the effort to help bridge the big gap and barriers keeping users from TPU adoption.

https://pytorch-lightning.readthedocs.io/en/latest/tpu.html#...

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @02:15PM (#24722020)
super cool!

One of the professors at my lab at NYU CILVR (Kyle Cranmer) i believed was super involved with this. Will definitely sync up with him!

Thanks for the heads up!

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:25PM (#24721464)
Like I said... pytorch and tensorflow team are working very hard to make this work. And yes, it's not a 1:1 with tensorflow, but we're making progress very aggressively.
Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:13PM (#24721328)
The grid is how you harness and distribute power and electricity.... like that coming from lightning :)

Second, electricity was a great new technology (ie: AI), but you needed the power grid to make it usable - that's grid AI.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:12PM (#24721308)
it's honestly just a different approach. ML ops is adjusting your code to work with the cloud and managing all that.

For us is basically integrating clouds directly into your code so the barrier disappears and the cloud providers become an extension of your laptop.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:07PM (#24721238)
We currently have google engineers training on TPU pods with PyTorch Lightning.

TPU support is VERY real... but yes, sometimes it breaks but PyTorch and Google are working very hard to bridge that gap.

But we have dedicated partners at Google on the TPU team working to get Lightning working seamlessly on pods.

Check out the discussions here: https://github.com/PyTorchLightning/pytorch-lightning/issues...

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:03PM (#24721203)
Lightning is built for researchers by researchers... we've already taken a much different approach.

100% agree with you that going the other way is likely not the best approach.

Lightning + Grid elevates and turns non experts closer to researchers... ie: focus on building the products and doing science and not the engineering.

That's what lightning excels at today. That's the experience Grid will 10x.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @01:00PM (#24721161)
Well... we're not really an ML ops startup haha. I am ALSO pessimistic about ML Ops startups.

But calling Grid an ML Ops startup is like calling Lightning Keras... maybe at a quick blink it looks like that, but that's where the similarities end.

For what it's worth, a lot of what we're building comes from my experience at FAIR.

Re:Grid: AI platform from the makers of PyTorch Lightning on Thursday October 08, 2020 @12:51PM (#24721005)
yes! our goal is to completely remove any engineering from the AI research -> production lifecycle.

Not just a marginal improvement on that experience but a 10x completely different approach.

Older »