News for hackers. Stuff that matters.
Re:Joyent Public Cloud EOL by throw0101a on Thursday June 06, 2019 @02:38PM (#20117605)
> My understanding always was that they're some special kind of hosting provider. But I never really got it.

The main selling point is/was being closer to the hardware and thus getting better utilization. Virtualizing at the machine level was a lot slower (especially before Intel VT-x and AMD-V came along) and so one wouldn't lose (say) 30% right off the top:

* https://en.wikipedia.org/wiki/OS-level_virtualisation

Re:Joyent Public Cloud EOL by hinkley on Thursday June 06, 2019 @03:22PM (#20118109)
You will also hear a lot of bragging about how much more robust the partitioning is on Solaris versus Linux. Which is why they did the work to get Linux containers running on top of Solaris instead of just doing Linux.
Re:Joyent Public Cloud EOL by throw0101a on Thursday June 06, 2019 @04:26PM (#20118757)
I haven't been paying attention recently, but last time I checked, there were no known escapes out of Solaris zones, while there are quite a few CVEs about escaping Linux containers and even QEMU/KVM/Xen.

The one escape out of FreeBSD jails that I'm aware of (CVE-2005-2218) involved not a bug in the jails code, but by burrowing out via devfs.

So it seems that OS-level virtualization/security has a better track record.

Re:Joyent Public Cloud EOL by cookiecaper on Thursday June 06, 2019 @05:08PM (#20119225)
Yes, for a very long time the Linux devs were emphatic that cgroups should be not be treated as an actual isolation/security barrier. This was flagrantly ignored and like most things in the Linux ecosystem, the functionality was eventually kinda-sorta backfilled based on the community's refusal to accept anything else. Meanwhile, FreeBSD and Solaris had quietly provided coherent tools to accomplish the same ends securely for many years.

The story of the BSDs and illumos is really a tragedy about the complete and total disconnect between technical quality+value and technology adoption. People utilize technology products as fashion statements first and foremost, and the Linux fashion was easily the most desirable -- indeed, aside from PC v. Mac, it's the only one generally known by average technophiles.

As a technical entrepreneur, I've discovered the sad reality that it's really only the most superficial 10% of any functionality that drives virtually all adoption. Everything else is marketing, even in supposedly heavily-technical endeavors like running an open-source kernel. The more you invest in engineering beyond that initial superficial component, the less you have to invest in brand promotion.

One can choose to gratify their own sense of righteousness and ignore this, and that is certainly a valid option to take, but then they shouldn't be surprised to see their lunch eaten by someone who took the other side of the bargain.

Re:Joyent Public Cloud EOL by Chyzwar on Thursday June 06, 2019 @06:45PM (#20119957)
I disagree.

Linux have 18 millions lines of code in drivers. It can run on almost any chip/architecture. Distributions are fully featured and most of the things you can imagine have first class support.

I do not care how beautiful is architecture of BSD kernel if I cannot run my code on it.

Re:Joyent Public Cloud EOL by Annatar on Friday June 07, 2019 @10:07AM (#20124603)
Write the drivers for your hardware and bootstrap it and it will be able to run. Wait a minute, wasn't that THE one and only answer for "my hardware doesn't run Linux!" from the early '90's all the way to 2005?
Re:Joyent Public Cloud EOL by minusf on Friday June 07, 2019 @03:16AM (#20122341)
does Linux run on a toaster? ;)
Re:Joyent Public Cloud EOL by dragonwriter on Friday June 07, 2019 @03:38AM (#20122432)
> People utilize technology products as fashion statements first and foremost,

It's true that tech has a popularity-breeds-popularity effect, but I don't think it's mainly fashion (at least, for industrial use of tech like PLs used commercially), but network effects around available knowledge and skilled users.

Abstract technical superiority often isn't a commercial win without reliable availability of people able to use it effectively at costs that make it efficient. There's situations where buying the limited knowledge pool, or paying to grow on house skill, is worthwhile, but often the “worse” solution that is well-known is better practically

Re:Joyent Public Cloud EOL by tedunangst on Thursday June 06, 2019 @06:14PM (#20119758)
Are you counting kernel exploits not directly related to jails/containers as an escape?
Re:Joyent Public Cloud EOL by throw0101a on Thursday June 06, 2019 @07:48PM (#20120357)
Generally, if someone was in a guest jail/container, there was no way of them being able to either (a) get to another guest jail/container or (b) getting to the parent context.

That was true at one point in time (i.e., no known breakouts). I don't know if that is still true, and if it is not, when that breakout CVE was published.

Re:Joyent Public Cloud EOL by jaytaylor on Thursday June 06, 2019 @03:02PM (#20117885)
In this case, do clouds with physical bare-metal provisioning capabilities like EC2 / GCP / Azure / OCI kill the Joyent value proposition?
Re:Joyent Public Cloud EOL by cookiecaper on Thursday June 06, 2019 @03:13PM (#20118017)
Docker killed the value proposition. "Worse is better". FreeBSD's jails and illumos's zones have always been far, far superior technically, providing actual kernel encapsulation and coherent administration utilities, but Docker had the triple combination of the familiarity of Linux, the cute whale, and the bonfire of VC dollars to drive adoption.

There is still a great deal of administrative/technical value in using anything-but-Docker if you can tolerate the social stigma, but who can? The CxOs need that Docker/Kubernetes feather in their cap so they can look cool at conferences.

Suggesting SmartOS/illumos gets you sideways looks at the very bare minimum. When I stated that I was thinking about using it here over a year ago, my inbox was immediately flooded with accusations that I was part of a Joyent-bankrolled cabal, because clearly no sane ordinary person would consider such a dead platform. In the interim, OmniTI has gone belly-up and OpenZFS has deemed ZFS on Linux the rightful heir to the ZFS throne, and now the Joyent Public Cloud is shuttering. If the impression that you had to be part of a conspiracy to use SmartOS for a greenfield project was reasonable then, it's only more reasonable now.

The sun may yet rise again on illumos some day, but it's time to accept that it's well into the night now.

Re:Joyent Public Cloud EOL by RantyDave on Thursday June 06, 2019 @06:01PM (#20119669)
Joyent's value proposition was killed (for the most part) by the experience of using their public interface. It would've taken a great deal of bravery to try that and decide a local install would be better. The node thing also did a lot of damage - Joyent wrote a lot of the SmartOS/Triton command line tools in node so they were slow as hell. Triton itself is a very non-trivial install although quite probably less so than a complete k8s rig.

There are also some really subtle Linux compatibility problems. For instance: IIRC a SmartOS malloc will not fail. Ever. But it might not return either. There's a really complicated mark/sweep type virtual memory thing and the documentation is good, for the nasty node stuff, and kinda terrible otherwise.

Finally, and with no lack of irony, you just can't run SmartOS on the cloud. For a start it needs to do its first boot off a CD and subsequent boots off a USB drive-type-arrangement. The hard part is that most cloud providers run a butchered Linux kernel and not a fully generalised VM - and on vultr at least, while they run a proper VM, for some reason the processors don't "come up".

I've not looked at all this stuff for at least a year so it may have changed. Either which way I believe the majority of the community is now on OmniOS - which I always got on better with anyway.

Re:Joyent Public Cloud EOL by jen20 on Thursday June 06, 2019 @06:51PM (#20119994)
> Triton itself is a very non-trivial install

Actually I'd say the Triton install is not only trivial, but should be a model for other similar systems. During my testing with Intel NUCs, I had a usable system deploying containers in under 20 minutes. Most managed Kubernetes systems cannot even provision in that time frame.

> you just can't run SmartOS on the cloud.

The installer may lead you to the USB and install path, but it is not necessary. I built Vagrant boxes that had SmartOS on a regular disk, and I believe that more recently SmartOS has been running well in GCP. There is no reason it could not run in AWS or Azure, either.

Re:Joyent Public Cloud EOL by merb on Thursday June 06, 2019 @07:48PM (#20120353)
> Most managed Kubernetes systems cannot even provision in that time frame.

when was the last time you used k8s?! I mean as of now there is even the expirmental k3os which boots a fully fledged k8s in seconds. you can even built a cluster with it. sadly HA backplane is still not available since k3s is still early in its development.

Re:Joyent Public Cloud EOL by jen20 on Thursday June 06, 2019 @08:20PM (#20120503)
I'm talking here about the managed Kubernetes offerings from AWS and Azure. As for when I last used them: waiting for provisioning right now (18 mins and counting) is affording me the time to comment on this article.
Re:Joyent Public Cloud EOL by merb on Friday June 07, 2019 @03:29AM (#20122394)
maybe you should use gcloud gke. or even digitalocean, they provision in under then minutes aswell. not sure why aws and azure take so long.
Re:Joyent Public Cloud EOL by jen20 on Friday June 07, 2019 @03:10PM (#20127694)
I work on provisioning tools, I use all of them. I've definitely seen GKE take just as long as the others...
Re:Joyent Public Cloud EOL by Annatar on Friday June 07, 2019 @10:19AM (#20124733)
How long did it take you to install Triton?

How many systems did you need to install Triton?

How much memory did(do) the individual systems running Triton have?

Which documentation did you follow to install Triton?

Re:Joyent Public Cloud EOL by jen20 on Friday June 07, 2019 @03:11PM (#20127701)
The total time to install across 4 hosts was probably 15 mins or so. There used to be a post on the Joyent blog that explained the setup for small scale, I'm not sure if it is still there.
Re:Joyent Public Cloud EOL by Annatar on Saturday June 08, 2019 @02:23AM (#20130958)
There used to be but I cannot find it any more, that is exactly why I asked...
Re:Joyent Public Cloud EOL by Annatar on Friday June 07, 2019 @10:16AM (#20124690)
"For a start it needs to do its first boot off a CD and subsequent boots off a USB drive-type-arrangement."

No it does not. I boot my SmartOS instances with PXE, DHCP and TFTP from the network. Served by a Solaris 10 intel server, no less. No CD's or USB images anywhere in sight.

In fact, I came up with a trifecta scheme where three SmartOS servers will all run TFTP and DHCP servers, thus being able to boot each other and all the other SmartOS servers over the network. In the event where all three would lose power simultaneously, THEN I reach for a USB stick with the emergency boot image. And I'll have two of those. But barring such catastrophic loss of power simultaneously, there won't be any CD's or USB sticks needed.

The network is the computer.

Re:Joyent Public Cloud EOL by RantyDave on Saturday June 08, 2019 @12:18AM (#20130602)
So not on AWS, then? Hence "on the cloud", I never said it was impossible in your garage.
Re:Joyent Public Cloud EOL by jen20 on Thursday June 06, 2019 @03:12PM (#20118002)
Not really - since the bare metal provisioning tends only to be large, expensive instance types. The benefit of secure OS-level virtualisation is that you can co-locate the smaller workloads of multiple tenants on the same bare metal, while not incurring the overhead of hardware virtualisation.

When you compared the utility of JCP "tiny" instance (1 CPU worth of shares, 256MB of RAM) to a t2.micro or similar instance in AWS, the difference was astounding. Part of this is the CPU credit mechanism on T2 instances, but I'd wager that a good part of it was being in OS-level virtualisation.