News for hackers. Stuff that matters.
Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @06:05AM (#12303485)
show me an easy way to push a rails application to aws (with docker) that uses RDS ?

is there ANY way i can spin up a server, add the ssh keys to some configuration file somewhere and just "docker-magic push" and have my rails application running ?

or do "docker-magic bundle exec db:migrate" and have that command run on the server.

Or push a Procfile with worker definitions and have the PAAS automatically pick it up, add it to supervisord/systemd and run it ?

Re:“It's The Future” by jacques_chester on Wednesday August 17, 2016 @07:56AM (#12303971)
Cloud Foundry is probably what you want. To the point that the Ruby buildpack code is a soft fork of Heroku's (source: I work on the Cloud Foundry buildpacks team). It'll run on AWS, vSphere, OpenStack, Azure, GCP is coming and others to follow.

There is, however, still a hump to get over in installation -- you need to learn what BOSH is, install BOSH, then install Cloud Foundry with BOSH. In the long run, for a production deployment, this is what you want. But it certainly doesn't feel that way when you just want to kick some damn tires.

If you just want to tinker, you can try PCFDev[0]. It's a fully-functional Cloud Foundry installation in a single VM.

Disclosure: I work for Pivotal, we donate the majority of engineering on Cloud Foundry.

[0] https://pivotal.io/platform/pcf-tutorials/getting-started-wi...

Edit: yes, I know we ask you to signup during the PCFDev install. I hate it too. We have to for export compliance, it can't be avoided.

Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @09:01AM (#12304300)
thanks for this ! how do you look at deis.io vs Cloud Foundry. Do you see yourself subscribing to one of the popular camps out there... or will you stick to Cloud Foundry in the long term ?
Re:“It's The Future” by parasubvert on Wednesday August 17, 2016 @09:31AM (#12304511)
I'm also with Pivotal... CF is a long term deal. Deis is a young startup that began on Dokku before pivoting to K8S, CF is in its third generation runtime and its use of containers predates Docker to 2012.

CF is already a relatively successful business with hundreds of million dollars in annual revenues across a pile of companies. Kubernetes and Docker are small in comparison as "businesses" but of course the momentum there is surging in terms of both pure open source adoption and contribution. It's likely going to be a big market with a lot of choice like Deis, or plain k8s, or RedHat OpenShift, or IBM bluemix, Pivotal , Docker Datacenter, or Mesos/Marathon, etc. It's a bit of a market war brewing and that competition will make for better solutions.

What is great about open source vs. past tech "gold rushes" is that these experiments and feedback loops exist across communities that are otherwise competing and overlapping. Mesos adopted the Docker image format independently of the Docker runtime ; Kubernetes introduced pods independently but also reused parts of Docker. Docker container networking and volumes are being used compatibly in the latest incubated CF releases. RedHat submitted a way to get CF style buildpacks working on K8S. Someone found a way to make CF run on Mesos; I could see a similar attempt on Kubernetes some day. It's a confusing and busy time but also an explosion of activity. And even if there is competition for dollars in the end among all these players that will lead to tension , the work is out in the open mainly.

Re:“It's The Future” by jacques_chester on Wednesday August 17, 2016 @01:04PM (#12306250)
I'm obviously biased.

Most of Cloud Foundry is built the way I like software to be built. Pair programming, TDD, small balanced teams, prioritising for user valu.

That style of development is actually baked into the Cloud Foundry Foundation rules. Companies who join the Foundation are expected to send engineers to ramp up on developing in this style. And voting rights are based on the number of full-time engineers you have assigned to the effort.

The reason I mention all this is that I trust the way we build Cloud Foundry. We still get production bugs and oversights and mistakes. It's around 4 million lines of code that turns into a distributed system of ~50 different interacting processes. We built a fully-featured, robust PaaS, using containers, in about 3 years, starting from scratch.

Nobody outside Google had built a container platform of this level before. Nobody but Heroku had built a fully-featured PaaS of this level before. We are, to my knowledge, the first system to do both of these things. Certainly the first opensource one.

The reason you never hear about Cloud Foundry is because we've already built all the components other folks are trying to roll up into full PaaSes. "It just works, already" is a boring story.

But again, quite seriously: I am obviously very biased.

Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @01:08PM (#12306292)
This is awesome! So you're telling me that not telling the world that you have a high quality, tested, opensource, fully functional, container based Heroku-clone is deliberate ?

Please excuse me while I take an hour to digest that.

Re:“It's The Future” by jacques_chester on Wednesday August 17, 2016 @03:12PM (#12307478)
You're choralling to the preacher, mate.

Right now the companies who provide the most engineering -- Pivotal and IBM -- are laser-focused on capturing enterprise dollars.

Which from a business perspective makes perfect sense. Pivotal's commercial distribution of Cloud Foundry (PivotalCF) holds the record for fastest-growing sales of any opensource product. Ever.

But there's not much effort on promoting to devs and startups (IBM are starting to do this more with BlueMix, which is their CF distribution). But it's early days.

So basically you'll usually find that I and a sprinkling of my colleagues show up in threads like these out of the goodness of our hearts and fondness for our work.

Obviously I have a financial interest. Pivotal makes money from PivotalCF, I work for Pivotal I'm on an options plan as well. So YMMV.

But I think Cloud Foundry is just ... way ahead, in terms of actually getting work done.

Edit: and since I'm musing aloud about business-y things, I should emphasise again that nothing I say is in an official capacity, consult your lawyer, financial planner and astrologer, etc etc.

Re:“It's The Future” by imaffett on Wednesday August 17, 2016 @06:32AM (#12303570)
Ive been looking for the same thing. Tried dokku and it was painfully slow. Tried rolling my own solution via git hooks but other devs had problems with execution. I would love to hear more about people running dokku on Digital Ocean (I was on a beefy azure server)

In a very specific case, Heroku is the best solution for my problem. Sounds like it is for you too.

Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @08:51AM (#12304225)
i would say for most use cases unless ROI becomes an issue. There is a point of time where it becomes cost effective to run your own S3.
Re:“It's The Future” by methyl on Wednesday August 17, 2016 @06:20AM (#12303525)
Re:“It's The Future” by nickjj on Wednesday August 17, 2016 @06:57AM (#12303691)
Once you finish taking my Scaling Docker on AWS course, you'll have access to a magic command that deploys your app and you're free to optionally run migrations.

http://nickjanetakis.com/courses/scaling-docker-on-aws

It covers using RDS, ElastiCache and also handles load balancing your app + much more.

Re:“It's The Future” by mpeg on Wednesday August 17, 2016 @09:15AM (#12304392)
And for a limited time, you get a free set of Japanese cooking knives with every purchase.
Re:“It's The Future” by goldenkey on Wednesday August 17, 2016 @08:30AM (#12304142)
You should mention it costs $20 for information that can be found for free anywhere on the web. While other users answer the question, you simply refer to your piggy bank, shameless.
Re:“It's The Future” by nickjj on Wednesday August 17, 2016 @08:58AM (#12304282)
> You should mention it costs $20 for information that can be found for free anywhere on the web. While other users answer the question, you simply refer to your piggy bank, shameless.

Yep, it costs $20. Basically the cost of chinese food for 2, to ensure guaranteed victory in learning the essentials of AWS' platform while having a guided tour on how to deploy a fault tolerant web app with Amazon ECS from start to finish.

You can definitely learn everything for free, but the value in a course is that you're getting a cohesive learning path that was carefully planned and tested. You get a system that you can apply to your own projects and plenty of source code to reference.

You're paying the $20 so you can avoid spending 6 months trying to figure out everything on your own while stringing together a bunch of half-assed blog posts and tutorials.

You pay the small fee for certainty and it's well worth it because your time (and sanity) is not infinite.

Re:“It's The Future” by goldenkey on Wednesday August 17, 2016 @03:23PM (#12307567)
I love the comparison to chinese food for 2. As if everyone lives in the US with the same economic situation. Your posts are truly despicable.
Re:“It's The Future” by nickjj on Wednesday August 17, 2016 @03:39PM (#12307716)
I'm sorry you feel that way. Unfortunately time is something we all share, and it brings me a lot of joy to have students say that my courses have saved them a ton of time and helped them meet their goals.

I see that you recently left Amazon after making 200k/year there (a comment you made 5 days ago). I can see why you don't like people promoting Amazon products, I fully understand.

Re:“It's The Future” by goldenkey on Friday August 19, 2016 @08:20PM (#12324412)
Condescension abounds! :-)
Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @08:53AM (#12304236)
i have grappled with Amazon ECS and im in no mood to go through that again. Convox (YC S15) is a pretty good alternative - but it will take some time for them to tie the "magic" together.
Re:“It's The Future” by jeremyjh on Wednesday August 17, 2016 @06:42AM (#12303618)
Deis will do exactly that.

http://deis.io/

Re:“It's The Future” by sandGorgon on Wednesday August 17, 2016 @08:55AM (#12304246)
hey - not bad. The documentation looks very similar to heroku.. i cant find if they do stuff to handle workers in Procfiles (which need to be added to the job manager like supervisord/systemd). But interesting..