theo31

I use it and I love checking it in the morning to see what my team is up to, I don’t have to ping people and break their flow.

It helps us figure out what got done and where we are in our roadmap

Those frameworks are installed by default in our custom environment. There is no additional setup/configuration required from you.

At the moment, no, only the random hash gives some kind of security by obfuscation. More advanced security controls are coming soon.

We don't use TensorRT at the moment, but it is something that we are exploring.

Oh that's very interesting, how ready for production is it? It only works for TF right?

> If you need a few dozen inferences per second per server, this is the cheapest way. And you're not depending on a proprietary solution whose parent company could go out of business in a year.

Definitely the cheapest way.

We've been in business for more than a year already actually :)

Sorry that's a typo, they are K80s: https://www.nvidia.com/en-gb/data-center/tesla-k80/

Yes! A more in-depth blog post is coming soon. We do host the hardware ourselves, for complete control over the GPUs. We found a great infrastructure provider that is also experiencing shortages.

The response time guaranteed is for a reasonably sized model. Bigger models (> 700 MB) will take a bit longer.

The model size is the zipped size of your model that is uploaded to Inferrd (either through the SDK or the website).

I'll fix the full screen problem right away, thank you for reporting.

We only have servers in the United States at the moment but are looking to have servers all around NA and EU very soon.

Yes you absolutely can!

Thank you!

We don't have any cold start delay! In our custom environment, you can do exactly what you are describing (running both CPU and GPU code). We provide you with access to the GPU and the CUDA libraries installed. It's basically lambda (minus the cold start) with GPU access.

We can scale a lot very quickly depending on how much you need.

Yes absolutely, you can run almost anything in our custom environment.

There is no cold start! We keep your service hot all the time.

Definitely not a CTF challenge. The product is still very early on and a lot of features are hidden/hard to find (that's one of the reasons the signup isn't open).

I'll send you some documentation soon.

That's fair, I'll come back with something to show :)

It's because I like working closely with early users to nail the features and experience instead of opening the floodgates right away.