News for hackers. Stuff that matters.
Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by bobosha on Tuesday April 14, 2020 @02:33PM (#22869678)
Has anyone used Cortex in production?

- Could you share your experiences?

- why would one choose this over docker for instance?

Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by calebkaiser on Tuesday April 14, 2020 @02:57PM (#22870000)
I'm sure others will comment, but in the meantime, some people have written up their experiences using Cortex in production. I'd point you to AI Dungeon: https://medium.com/@aidungeon/how-we-scaled-ai-dungeon-2-to-...

We also have a pretty active Gitter channel: https://gitter.im/cortexlabs/cortex

As for your second question, Cortex uses Docker to containerize models. The rest of Cortex's features (deploying models as microservices, orchestrating an inference cluster, autoscaling, prediction monitoring, etc.) are outside Docker's scope.

Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by bobosha on Tuesday April 14, 2020 @03:51PM (#22870629)
>orchestrating an inference cluster, autoscaling, prediction monitoring,

Does this approach preclude the need for queuing (a la RabbitMQ) and/or a load balancer?

Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by calebkaiser on Tuesday April 14, 2020 @04:01PM (#22870750)
Yep! Cortex deploys load balancers on AWS and manages queueing.
Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by bobosha on Tuesday April 14, 2020 @04:11PM (#22870862)
This is super-exciting! I didn't know it could be this easy!

How do you handle API authentication? Is there a module that interfaces with AWS API gateway? or external API authentication?

Re:Show HN: Cortex – Open-source alternative to SageMaker fo... by calebkaiser on Tuesday April 14, 2020 @04:30PM (#22871073)
Right now, users handle API auth by using AWS API gateway in front of Cortex, but incorporating AWS API Gateway into Cortex to automate this is on our short term roadmap.