News for hackers. Stuff that matters.
Re:SAS is on the brink of something by jl6 on Friday March 09, 2018 @01:57AM (#16550196)
I’m a lead architect at a major financial services organization in Europe. We’ve just completed a large SAS upgrade project. While we had no interest in SAS Viya, SAS legacy remains an important part of our landscape.

It’s not a tool for programmers. It’s a toolbox for people doing other jobs, who happen to know how to program.

Would we invest in SAS if we were starting today from scratch? No.

But none of SAS’s biggest customers are starting from scratch, and things like continuity, risk, and embedded institutional expertise are incredibly important to these customers, in a way that might not be obvious if you’re coming from the fast-paced world of startups who have the luxury of starting with nothing.

In the endgame though, I can’t see how SAS will be able to resist the cost pressure coming from the Python/R/Hadoop/FOSS-in-general ecosystem, as those tools continue to mature.

Even COBOL will die one day.

Re:SAS is on the brink of something by gaius on Friday March 09, 2018 @03:22AM (#16550454)
Even COBOL will die one day.

The specific syntax of COBOL maybe, but the concept of a COmmon Business Oriented Language lives on in Java

Re:SAS is on the brink of something by mr_toad on Thursday March 08, 2018 @09:29PM (#16549424)
SAS have shown some belated movement towards a more modern architecture. You can install SAS servers using a package management system, and automate the process using Ansible.

But their licensing model is straight out of the 90’s. there’s no point using automated load balancing if your license costs are a fixed multi-million dollar per year cost.

They have moved to a web-based client. It’s great that it’s not stuck on Windows. But it’s a very closed client in that it only works with SAS products. As the article says, no Python or R. And as a web based IDE it’s a pale shadow of the likes of Cloud 9.

If’s disheartening (but not surprising) to hear a SAS employee say they don’t care about the core language any more, they make most of their money from BI tools aimed at non-programmers.

Re:SAS is on the brink of something by meuk on Friday March 09, 2018 @05:22AM (#16550883)
Nitpicking: Maybe I'm stupid, but I don't know what SAS is. I have learned to always introduce abbreviations before using them. I think more people should do this.
Re:SAS is on the brink of something by Terretta on Friday March 09, 2018 @06:05AM (#16551014)
Since this comment is so high, save you a click:

SAS (previously "Statistical Analysis System") is a software suite developed by SAS Institute for advanced analytics, multivariate analyses, business intelligence, data management, and predictive analytics.

SAS was developed at North Carolina State University from 1966 until 1976, when SAS Institute was incorporated. SAS was further developed in the 1980s and 1990s with the addition of new statistical procedures, additional components and the introduction of JMP. A point-and-click interface was added in version 9 in 2004. A social media analytics product was added in 2010.

According to IDC, SAS is the largest market-share holder in "advanced analytics" with 35.4 percent of the market as of 2013. It is the fifth largest market-share holder for business intelligence (BI) software with a 6.9% share and the largest independent vendor. It competes in the BI market against conglomerates, such as SAP BusinessObjects, IBM Cognos, SPSS Modeler, Oracle Hyperion, and Microsoft BI. SAS has been named in the Gartner Leader's Quadrant for Data Integration Tool and for Business Intelligence and Analytical Platforms. A study published in 2011 in BMC Health Services Research found that SAS was used in 42.6 percent of data analyses in health service research, based on a sample of 1,139 articles drawn from three journals.

— https://en.m.wikipedia.org/wiki/SAS_(software)

TL;DR: It’s kind of a big deal in analytics.

Re:SAS is on the brink of something by trollsund on Friday March 09, 2018 @05:49AM (#16550971)
I fully agree. To me, SAS is either an airline company or british special forces, so I have no idea which company this blogpost is about - and I'm not going to start researching to find out which company a blog post about a company is talking about.

However, to be somewhat of a hypocrite, I don't mind abbreviations for broadly known terms, such as SaaS, DevOps or db. I guess it boils down to the context.

Re:SAS is on the brink of something by meuk on Friday March 09, 2018 @10:01AM (#16552151)
> However, to be somewhat of a hypocrite, I don't mind abbreviations for broadly known terms, such as SaaS, DevOps or db. I guess it boils down to the context.

Well, at least SaaS and DevOps are easily googleable. Still, in any type of written article, I would just take the time to write out the abbreviated thing in full the first time. Takes maybe 2 seconds and 10 letters more, and you won't have people like me complaining :)

Re:SAS is on the brink of something by closed on Friday March 09, 2018 @07:35AM (#16551278)
* Flashbacks to when I was learning to program and people were dropping mysterious acronyms like SaaS (and its _aaS compadres)
Re:SAS is on the brink of something by thomaswdinsmore on Friday March 09, 2018 @06:31AM (#16551079)
Hi. I wrote the blog post. (Someone else published the link on HN.) Thanks for reading. SAS is not an acronym. And since I write for an audience of people who work with data science and machine learning, I assume that readers know the largest vendor in the category.
Re:SAS is on the brink of something by meuk on Friday March 09, 2018 @10:08AM (#16552205)
Thank you for your answer, I understand now. SAS not being an acronym mostly voids my critique. I am reading your blog post somewhat out of context, since I am not a data scientist.

That said, the rest of the article is very accessible for me - my only confusion was what SAS is. Maybe a link to a page that explains what SAS is would be a good solution?

Re:SAS is on the brink of something by thomaswdinsmore on Friday March 09, 2018 @10:41AM (#16552463)
Appreciate the feedback. I write for an audience that is familiar with the leading vendors in data science and machine learning.
Re:SAS is on the brink of something by darkhorn on Friday March 09, 2018 @11:43AM (#16552934)
Anybody who studied Bachelor of Science in Statistics knows what is SAS. It is a statistics application. It is just like R, SPSS, and Minitab. If you don't know any of these you might know Jupyter Notebook. Also the buzzword for "Statistics" nowadays is "Big Data".
Re:SAS is on the brink of something by graphov on Friday March 09, 2018 @05:44AM (#16550962)
Yeah, I thought something was wrong with Scandinavian Airlines.
Re:SAS is on the brink of something by roystonvassey on Friday March 09, 2018 @04:49AM (#16550756)
A few years back, I was an out-and-out SAS guy. This was mainly because the company I worked for had everything in SAS.

Then, our company acquired a competitor to SAS; SAS was booted out and literally, overnight, we were asked to stop using SAS and switch over. Thanks to this development, my team and I scrambled to port it over to the new tool. Of course, the transition wasn't smooth and a lot of our programs couldn't be migrated. This is when I began exploring Python and fell in love with it. I rediscovered programming, powerful ML libraries and the awesomeness of the open-source paradigm.

I end my random anecdote to say that I'm grateful for this (unexpected) development that helped me accelerate my career in data science, which would have definitely not happened if the abrupt removal of SAS hadn't taken place. I would've most likely still be churning regular dashboards built on legacy SAS code for some bank.

Re:SAS is on the brink of something by Macuyiko on Friday March 09, 2018 @03:25AM (#16550465)
About a year ago, a sales guy from SAS came to give a talk about Viya at our uni. They even brought a data scientist (whom I believe was actually a smart kid and feeling uneasy about being dragged into a sales pitch). Traditionally, SAS has pushed a lot of resources in the educational sector. Get them started young, and they'll be customers forever.

So anyway, the presentation includes showing off a Jupyter notebook and showing how you can easily use pandas to load in your data set, build a model (with Viya), and plot the results with matplotlib. Standard data science stuff, but distributed automagically thanks to Viya.

During the QA, I asked the following questions:

- So you are basically attempting the same as what Spark has done, and are just using R/Python/... as a client? Yes, but we're way more powerful, manageable, etc...

- Can I see the source code of your models, or build new ones myself? No... well maybe, you can write them in SAS base and call them.

- Can I at least export the model to something like PMML? Oh yes you can export (shows this off)... to SAS base code.

- Do you have GPU support for those fancy convolutional neural networks? No (although I've heard this has changed, though I would still put my trust more towards Tensorflow or Pytorch).

It kind of seems like a last attempt to get some new lock-in going. Even Apple's re-open sourcing of turi (https://github.com/apple/turicreate) is more honest (and more powerful, actually).

I like SAS, they have some very smart people working there and some great consultants (PhD's, often), but there's too much sales going on. This is what killed IBM as well.

Re:SAS is on the brink of something by fwn on Friday March 09, 2018 @04:38AM (#16550700)
> Traditionally, SAS has pushed a lot of resources in the educational sector. Get them started young, and they'll be customers forever.

If that is the strategy I'm not entirely sure it is well implemented. The version available for windows using students requires running a virtualized linux in the background to access a browser based, sluggish IDE like interface.

Compared to SAS, R and Python look like an usability dream.

Re:SAS is on the brink of something by mojoe on Friday March 09, 2018 @12:43AM (#16550014)
Out of the 100 or so data scientists in my division, I know of less than 5 people who still occasionally use SAS. It's all either (decreasingly) R or (increasingly) Python.

edit: scala with spark is increasing in use as well.

Re:SAS is on the brink of something by ninkendo on Thursday March 08, 2018 @08:42PM (#16549263)
What’s a SAS
Re:SAS is on the brink of something by detaro on Thursday March 08, 2018 @08:46PM (#16549275)
analytics software: https://www.sas.com
Re:SAS is on the brink of something by roystonvassey on Friday March 09, 2018 @04:50AM (#16550761)
Just five years back, this question would've been sacrilege in the 'data analytics' community.
Re:SAS is on the brink of something by jsgo on Friday March 09, 2018 @10:42AM (#16552466)
5 years ago, I worked at a company that did a lot of data analytics stuff (though I did not; I was responsible with some web applications). They swore by SAS. To read the comments here are pretty jarring, considering that previous history and how entrenched they seemingly were. I remember conversations with the SAS users and saying if I were to go in that arena, I'd most likely be a bigger fan of using R which seemed like sacrilege in the context of the conversation.

Granted, I worked about 30 minutes from SAS's HQ in Cary, but still.

Re:SAS is on the brink of something by nn3 on Thursday March 08, 2018 @09:22PM (#16549399)
Kind of like COBOL, an old-school legacy thing originating from mainframes that some people still use.
Re:SAS is on the brink of something by paloaltokid on Thursday March 08, 2018 @09:37PM (#16549454)
Most of the worlds largest enterprises run tons of this legacy cobol mainframe stuff. They solve really hard problems using this technology and we would be wise not to be dismissive but instead to learn.
Re:SAS is on the brink of something by nn3 on Thursday March 08, 2018 @09:54PM (#16549513)
Right they do, but they are also all working really hard on their transition plans away from it. See the original link for concrete data on that.
Re:SAS is on the brink of something by paloaltokid on Friday March 09, 2018 @03:12AM (#16550420)
It depends. I work professionally with Fortune 500 companies and for many of them mainframes are here to stay. It’s true that many of them wish to modernize and move away from mainframes; but they don’t want to get rid of them entirely.
Re:SAS is on the brink of something by gaadd33 on Thursday March 08, 2018 @10:40PM (#16549640)
Do people solve really hard problems with COBAL? I thought it was primarily a business language that replaces a lot of manual work. What sort of things has it found a niche for? Similar to how FORTRAN is used a lot in big data/physics?
Re:SAS is on the brink of something by Dangeranger on Friday March 09, 2018 @12:24AM (#16549968)
Every bank, insurance, airline, and electric utility in the world older than 25 years old has a mountain of critical, working, and legacy software running COBOL and FORTRAN.

With the generation of programmers who wrote the code retiring it’s even more entrenched because even though they rely on that code dearly, few if any people remember why it does what it does how it does it.

Re:SAS is on the brink of something by dragonwriter on Friday March 09, 2018 @01:05AM (#16550061)
> With the generation of programmers who wrote the code retiring

For many big COBOL systems that’s long past; in many cases the programmers that were coming on board when that generation retired are near retirement.

Re:SAS is on the brink of something by wastedhours on Friday March 09, 2018 @04:50AM (#16550762)
I've often thought it's probably a cracking time to be get some COBOL skills - you could jack your day rate up to the point you could probably name your price. There's an institutional incentive to replace it eventually, so not a long term thing, but you could probably milk it for a good few years.
Re:SAS is on the brink of something by Nilef on Friday March 09, 2018 @05:33AM (#16550922)
I know COBOL programmers whose day rate is considerably north of £1000
Re:SAS is on the brink of something by gaadd33 on Saturday March 10, 2018 @09:06PM (#16561320)
That doesn't address the question I was asking, of course there are a lot of legacy COBOL systems out there.

Do any of those legacy systems work on "hard problems" similar to how FORTRAN is still used in fluid dynamics, physics, crystallography and chemistry?

Re:SAS is on the brink of something by timClicks on Friday March 09, 2018 @03:12AM (#16550419)
Where would one look if one wanted to learn COBOL though? There's a free C implementation, but barely anything else surrounding it.
Re:SAS is on the brink of something by mdekkers on Friday March 09, 2018 @04:45AM (#16550734)
Where would one look if one wanted to learn COBOL though?

One would look at google. https://www.tutorialspoint.com/cobol/index.htm

Re:SAS is on the brink of something by bigger_cheese on Thursday March 08, 2018 @10:42PM (#16549648)
We use SAS Enterprise Guide as a Business Intelligence/analytics tool at my work (Industrial Plant) - most of our production reporting is SAS based. We also use it for adhoc analysis/troubleshooting. I.e to spot long term declines in yield and that sort of thing.

Where SAS succeeds is they make it very easy for non programmers to do things like query databases extract, transform, merge data, create computed columns and output graphs and reports.

Enterprise Guide is 100% scriptable and has a programming language underneath it the "SAS langauge" basically anything you can do in the GUI has code that is generated in the backend which user can edit directly if they desire. In old versions of Enterprise Guide code the GUI generated tended to be pretty inefficient (especially the SQL side of things) so a lot of people hacked the code directly and bypassed the GUI - nowadays it has gotten pretty good not as much need to hand optimize things.

Best analogy I can give is Enterprise Guide is like Excel on steroids.

SAS also has very powerful statistical capabilities beyond what something like Excel offers. We leverage a lot of this stuff when we need to build engineering models, things like Time Series Analysis, Statistical Process Control, Linear and Non Linear Modelling (Including Stepwise and Logistic Regressions). There is even some Optimization solver type stuff I've used in past (though MATlab is more often used in my org for this work). SAS kind of takes the kitchen sink approach in R you need to install external packages from CRAN to unlock all this stuff in SAS tends to be "baked in". I've found if I read about a statistical technique in a paper good chance it is available in SAS - good example is a few years ago a grad student came to our plant and helped us perform some analysis using a technique called "Projection to Latent Structures" (PLS) to identify relationships between various factors on plant causing yield loss. At the time this wasn't very common - I think it is used in machine learning nowadays but SAS had a PLS procedure available for us to use (kind of like a function in other programming languages) and the documentation SAS provided was very good (especially for someone like me with engineering background rater than stats background).

The only other tool I know of that is remotely similar to Enterprise Guide is IBM's Cognos software and that is vastly more limited as far as the statistical modelling features are concerned.

My work is keen to try other software, in part due to license costs, I think. In the Last 6 months I've been on two training course for Microsoft Power BI, and Microsoft R-Open (which I think is just Open source R-Studio with some extra proprietary stuff thrown in).

I've now used both tools to do my day to day job. I managed to get by with each of them but I found usability fell short of ease of use of enterprise guide.

Power BI was nice and I think it has something to offer as far as data visualization but you need to do the actual modelling in some other language so doesn't really eliminate needs for SAS - more like compliments it.

R on the other hand is a lot lower level it has all the advanced statistics but you have to write the low level code yourself to unlock them which requires learning an entire programming language to build simple models. It will be a pretty hard sell getting Engineers (I'm talking mechanical, chemical engineers not software kind) and finance analyst people to use a tool like R.

I think R would hugely benefit from something like an "Enterprise Guide for R" - I.e a drag and drop GUI which generated R code for you.

Also I wouldn't say the SAS Languge itself is strictly an old-school legacy language (sure the origins of SAS are from the 70's and 80's and there is a lot of legacy cruft in the SAS programming language I'll give you that) - For me SAS is a little like C++ there is a heap of stuff that lives in the langauge for backwards compatibility with old programs but modern C++ program looks very different from early 90's C++ - same with SAS code.

I've found modern ODS graphics (SGplot, SGpannel, etc) was very much on par with "ggplot2" functionality in R which is what the training course covered for producing reports using R.

SAS to me is a bit like MATLAB (and hey we use both in Engineering world). Everyone hates this software and wants something better but nothing else approaches the usability of these tools so models continue to be built using them.

Re:SAS is on the brink of something by garyclarke27 on Friday March 09, 2018 @02:32AM (#16550296)
Thanks for this very informative interesting write-up, notes such as these are what makes Hacker News so great. I’m curious, what do you think of SQL? I come from a finance background was an Excel guru but now prefer PostgreSQl, amazing what you can do with their Windows Functions, Recursive CTEs, Lateral Join Set Functions, Custom Aggregates, also has Python and R built in. I don’t like PowerBi too disjointed from Excel and v weak SQL support why does Microsft have to keep imposing their own languages on us instead of alloing us to use far superior SQL, would be awesome to have SQL in Excel (python Exel wings offers this but limited and clunky)Main proble with PowerBi for me is you can’t update the database without obtuse hacks.
Re:SAS is on the brink of something by tyfon on Friday March 09, 2018 @03:24AM (#16550462)
I used to work in a large international bank where SAS was the standard and while it can be used you can really feel the age of the technology.

Now I work in a startup bank and since I could chose the tools we're now running PostgreSQL/R/Python (RStudio and Spyder). Lately the marketing department are also using Tableu.

It's another world when it comes to output and efficiency of the team I lead compared to using enterprise guide.

Re:SAS is on the brink of something by lulmerchant on Friday March 09, 2018 @05:43AM (#16550961)
Where I currently work, we teach all of our BAs (regardless of how technical they start out), to use SQL (with redash), and some of them use Tableu. As this approach has been running quite smoothly for us, would SAS offer anything that a team like ours might be missing?
Re:SAS is on the brink of something by gaius on Friday March 09, 2018 @03:24AM (#16550461)
You can run R in SQL Server and Excel has the Data Model/PowerPivot now.
Re:SAS is on the brink of something by amrrs on Friday March 09, 2018 @01:42AM (#16550160)
Not sure if you've heard about Alteryx, which imo comes a lot closer to SAS. Alteryx is like SPSS for 2017. It's fast, easy to use, drag and drop gui and works well in Production.
Re:SAS is on the brink of something by mdekkers on Friday March 09, 2018 @04:53AM (#16550778)
Alteryx looks cool. Except for the pricing, which is mind-blowingly ridiculous.
Re:SAS is on the brink of something by mrmondo on Thursday March 08, 2018 @11:36PM (#16549815)
Yeah I thought - Special Air Service or SaaS
Re:SAS is on the brink of something by gaius on Friday March 09, 2018 @12:33AM (#16549989)
Or the Scandinavian Airline
Re:SAS is on the brink of something by dredmorbius on Friday March 09, 2018 @02:59AM (#16550383)
Surfers Against Sewage!
Re:SAS is on the brink of something by dredmorbius on Saturday March 10, 2018 @03:06AM (#16557646)
In my defence, I'll simply note that there's history here:

https://groups.google.com/forum/#!topic/comp.soft-sys.sas/oF...

Re:SAS is on the brink of something by gaius on Saturday March 10, 2018 @05:29AM (#16557960)
https://www.youtube.com/watch?v=2v1m-75I3_o

Both actors appearing in that clip are total muppets but it seems relevant ;-)

Re:SAS is on the brink of something by asteli on Friday March 09, 2018 @04:53AM (#16550780)
Serial Attached SCSI?
Re:SAS is on the brink of something by xapata on Thursday March 08, 2018 @10:11PM (#16549561)
SAS is dying slowly, but deservedly.
Re:SAS is on the brink of something by thriftwy on Friday March 09, 2018 @03:29AM (#16550484)
The airline? Don't know any other users of this TLA.

It's very confusing that you don't get even a basic insight of what the article is about.

Re:SAS is on the brink of something by SOLAR_FIELDS on Friday March 09, 2018 @04:35AM (#16550678)
No, the huge enterprise software suite used for analytics and all other sorts of stuff.

I also thought the airline first, but most people in USA have not heard of Scandinavian.

Re:SAS is on the brink of something by pzone on Friday March 09, 2018 @01:14AM (#16550077)
I have to work with SAS now and again in my research. I grit my teeth and bear it.