pancakeguy
With the right scheduler I think we could get that above 90%. Would love to hear any feedback / thoughts. Here's a blog explaining: https://docs.burla.dev/blog/dynamic-hardware
Show HN: Burla – Scale any Python program using one simple function
Burla is an open-source python package with one function: `remote_parallel_map`Given: a function, and a list of inputs; `remote_parallel_map` runs that function on every input in the list in parallel, each in a separate vm in the cloud, then returns a list of results. It can run any Python function on 1,000 vm's in less than 1 second, works with any hardware, and any custom container. Remote...
Show HN: Cloud platform with the learning curve of a toaster.
Hi I'm Jake a co-founder at Burla.dev. We're building a cloud platform with the learning curve of a toaster! (yes, a normal toaster you'd find in your kitchen)I'm not kidding. Our Python package only has one function, and it only requires two arguments. Using this function even total beginners can run Python on thousands of computers at once, in a way that feels no different from coding on your...
Show HN: cluster-compute software for python beginners
Hi HN, I'm a co-founder of Burla.dev, we're building cluster compute software for Python beginners. . We help people in Biotech, Geospatial, and quant-finance scale their analyses in the cloud without help from other engineering teams. . There are many fields where people code daily and deal with lot's of data, yet specialize in something other than engineering. We built Burla to enable...
Show HN: 1T row challenge in 76s using 10,000 CPUs
The point of these tools is productivity. What are you trying to accomplish and how long does it take to accomplish? This includes time spent writing code and fussing with configs. This would take <1min to run and <10 to write on a cluster. Happy to might make a demo to prove it.
Yes cost matters also, but running many machines for a short period of time is the same as one for a long time? Open to honest rebuttal.
Or basically a generic nestable `remote_parallel_map` for python functions over lists of objects.
I haven't had a chance to fully watch the video yet / I understand it focuses on lower levels of abstraction / GPU programming. But I'd love to know how this fit's into what the speaker is looking for / what it's missing (other than obviously it not being a way to program GPU's) (also full disclosure I am a co-founder).
Show HN: Easy to use Cluster-Compute software
Hi HN! We're Jake, Jack, and Joe, the creators of Burla, the world's simplest cluster compute software.Believe it or not, it's still super common for research / data-analysis teams to handoff work to Engineering because they aren't able to easily scale analyses on their own. Engineering managers we spoke with frequently attempt to onboard these teams to tools like Apache Airflow, Prefect, Dask,...
Show HN: Extremely simple cluster-compute software
Hi HN! We're Jake, Jack, and Joe, the creators of Burla, the world's simplest cluster compute software.Believe it or not, it's still super common for research / data-analysis teams to handoff work to Engineering because they aren't able to easily scale analyses on their own.Engineering managers we spoke with frequently attempt to onboard these teams to tools like Apache Airflow, Prefect, Dask,...
Show HN: Giz, AI Git commits with easy to modify system prompt (in 140 lines)
https://github.com/JacobZuliani/giz
I tried setting up an AI git commit tool this weekend and it was hell.All the tools are either not maintained, outdated, or make it a total pain to customize the system prompt. All I wanted was simple AI commit messages, that I can customize!Introducing Giz: A tiny, drop in replacement for `git commit`, with ai commit messages.`giz commit` behaves exactly like `git commit` with one...
Show HN: Open-Source Alternative to Modal
https://github.com/Burla-Cloud/burla
Hi all, we're Jake, Jack and Joe, and we're building the open-source alternative to modal labs.We think Modal's great, and wanted to use it at our previous places of work, but weren't allowed to because it was too expensive, and our data couldn't leave our cloud.This is why we built Burla, the open-source alternative to modal.Burla can run any python function on 1000 computers in around 1...
Show HN: Burla – Scale Python to 10,000 VM's with one line of code.
Hi HN! We're Jake, Jack, and Joe, and we're the makers of Burla, an open-source, batch-processing platform for python.We were frustrated by how slow and difficult it can be to iterate on large batch processing pipelines. Simple small changes necessitated rebuilding docker containers, waiting for GCP-batch, or AWS-batch pipelines to redeploy, and waiting for vm's to cold boot, a >5minute per...
Show HN: Introducing Burla – The simplest way to scale Python
Hi HN! We're Jake, Jack, and Joe, and we're happy to share what we think is probably the simplest way to scale python code across thousands of computers in the cloud.Coming from the Biotech world we were frustrated by how surprisingly slow and difficult it can be to iterate on large-scale batch processing pipelines, while contending with the security requirements imposed on us by the...
Currently a mix of after work/ weekend projects
looking for other engineers who might want to collaborate