News for hackers. Stuff that matters.
Re:NYPD is canceling its Palantir contract by bm1362 on Saturday July 01, 2017 @02:38AM (#14675740)
How is Java/Spring an issue here? Guess what powers Amazon, Google, Apple etc.
Re:NYPD is canceling its Palantir contract by halflings on Saturday July 01, 2017 @04:27AM (#14676037)
Not Java/Spring?

Google at least is known to use C/C++ for its backend. Python is (or was?) used in YouTube.

Re:NYPD is canceling its Palantir contract by kpil on Saturday July 01, 2017 @06:28AM (#14676421)
I think java comes out as one of the most efficient and battle tested backend languages.

For data crunching, especially statistical jobs, Python is probably also a good fit although it's not as efficient but have a number of good statistical, mathematical and ai toolkits that seems to be more active.

For running more specialized jobs, R have even more tools, but is a bit more shaky as a general language although it is a nice functional language, as many tools are more scientists scaffolding rather than nice abstractions.

Then you have fortran and matlab. I've heard of using erlang as a fast real-time analytics tool too, but then you probably need to roll your own everything.

But what do you suggest? Node.js claim to fame is mainly that most web developers know it, and js have formed their mental image of what programing is and how a computer works.

Re:NYPD is canceling its Palantir contract by munin on Saturday July 01, 2017 @08:18AM (#14676781)
Just curious, do you have direct experience with big companies using R, python, etc in production? My sense from working with people from those companies (and a few internships at those companies) is that you could use something like R, matlab, or scikit-learn on your own workstation with a tiny data sample to explore the data, but then do crunching by translating that program into some Java or C++ code (sometimes using specialist libraries) and running that in parallel, for production.

Do people actually just skip that step and just directly deploy their R? That seems really scary.

Re:NYPD is canceling its Palantir contract by RhodesianHunter on Saturday July 01, 2017 @09:55AM (#14677122)
Having worked with several large (fortune 500) data science teams, they generally do their development in Python and then throw their models over the fence for us to productionize with Java.

The major difference I've seen between most of these companies is whether they've embraced Java 8 yet.

Re:NYPD is canceling its Palantir contract by twblalock on Saturday July 01, 2017 @05:19PM (#14679091)
This is my experience as well. The data science people, who need to do proofs of concept, use Python. The people who have to write large, complicated codebases that scale well and accept years of modification use statically-typed languages like Java and C#.
Re:NYPD is canceling its Palantir contract by kpil on Saturday July 01, 2017 @10:03AM (#14677147)
To be honest, until recently I'd say that everything would be rewritten in java - mostly since there were already deployment pipes for it.

With the latest container-based toolchains I think it's not a bad idea to deploy some R-based services for certain type of tasks.

Re:NYPD is canceling its Palantir contract by gaius on Sunday July 02, 2017 @06:45AM (#14681914)
With the work Microsoft have been doing with the former Revolution Analytics, you absolutely can go into Production on R if you want to.
Re:NYPD is canceling its Palantir contract by gaius on Sunday July 02, 2017 @06:44AM (#14681909)
A few companies ago I worked at a company like that - researchers in R, MATLAB, Excel, whatever, then once it worked chuck it over the fence to the developers to rewrite in C++ or Java. Then the CTO, who was a visionary guy, made the decision that we would be all Python end-to-end with occasional C permitted for performance-critical sections. There were some teething troubles at first but when it worked, it was wildly successful and no-one could believe we'd ever worked any other way.
Re:NYPD is canceling its Palantir contract by watwut on Saturday July 01, 2017 @04:44AM (#14676109)
What is wrong with spring other then "not hipster compliant"?

Google has quite a lot of java.

Re:NYPD is canceling its Palantir contract by kayoone on Saturday July 01, 2017 @04:54AM (#14676157)
Google had and has a lot of Java, see GWT. It might not be hip anymore, but its still widely used in a lot of backend environments.
Re:NYPD is canceling its Palantir contract by paulddraper on Saturday July 01, 2017 @01:43PM (#14678044)
Google uses lots of C++ for very performance critical parts (search, browser) and then lots of Java everywhere else.
Re:NYPD is canceling its Palantir contract by cthalupa on Saturday July 01, 2017 @05:18AM (#14676217)
I dunno about Spring in specific, but a quick search for 'java' on amazon.jobs brings back ~2700 open positions. The google search doesn't seem to give a total. Apple brings up ~500.

Java is huge in a lot of places.