News for hackers. Stuff that matters.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by ironrabbit on Monday April 23, 2018 @01:55PM (#16905765)
> a run that takes 1 hour on 720 cores can be run on the CPUs of a 48-core personal computer in 16 hours

Is calling a 48-core machine a "personal computer" a bit of a stretch, or am I missing something?

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by singhrac on Monday April 23, 2018 @02:10PM (#16905895)
I think the intended implication is that it's accessible to individual researchers that don't work at Facebook/Brain/DeepMind with gigantic clusters (and the engineers able to maintain those clusters). Unfortunately deep learning is still expensive, but many areas of science are (most biology research, high energy physics, etc.). That's why we have grants.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by ansible on Monday April 23, 2018 @04:18PM (#16907017)
If you don't care about your electricity bill, you can buy used Xeon workstations on your favorite auction site.

A couple years ago, we picked up a HP Z800 workstation with two 12-core processors and 24GB of RAM for $400.

The main downside is that if the power supply (proprietary) or motherboard die, there's not easy fix for it other than buying another of the same model.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by wpietri on Monday April 23, 2018 @05:24PM (#16907549)
Absolutely!

I wanted something to host my private and experimental stuff. A friend of mine who tracks used server auctions pointed me at some servers that were Dell systems clearly custom built for one of the large SV companies. I paid $450 for a box with 72GB of RAM and 16 cores. At that price, I just bought a second one for spares. Which I haven't needed to use in the 4 or 5 years I've been using it.

It has been great.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by telchar on Monday April 23, 2018 @09:10PM (#16909017)
Would you care to share the server auction site? I've thought about doing something like that.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by wpietri on Tuesday April 24, 2018 @12:44AM (#16909897)
This was 4+ years ago, so I have no idea of the current market, but I bought from this eBay vendor:

http://stores.ebay.com/deepdiscountservers

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by foobiekr on Tuesday April 24, 2018 @01:54AM (#16910206)
WeirdStuff also used to be great for this.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by currymj on Monday April 23, 2018 @02:56PM (#16906343)
i also raised my eyebrows at this. i think "workstation" might have been a better choice of word than "personal computer". but people, especially in the sciences, do actually buy desktop computers with these sorts of specs -- they run like $10k-20k, probably.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by haZard_OS on Monday April 23, 2018 @03:52PM (#16906797)
Closer to the 20k end, I'm afraid. More options are opening up now with GPU processing power on less expensive desktops ( ~ $13k ).
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by snovv_crash on Monday April 23, 2018 @05:12PM (#16907448)
Dunno, check out [1]. You can configure for 48 cores and 256GB ECC DDR4 for under $10k.

[1] http://www.titancomputers.com/Titan-W375-Dual-AMD-EPYC-Proce...

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by Symmetry on Monday April 23, 2018 @02:13PM (#16905921)
I think they're using "personal computer" there only in the narrow sense that a dual socket tower workstation conforms to the PC spec. But then they go on to GPU performance which allows a machine you could reasonably have as your home computer to do this quickly.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by segmondy on Monday April 23, 2018 @01:57PM (#16905780)
Dunno, I have a 32 core, 128gb ram that I bought for $1000. I have a Xeon phi 60core card that I bought for $200 sitting by it ready go go in when I get the chance. When GPU prices drop, I'm probably going to add 2 1080Ts.

I'm just a regular computer user.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by derefr on Monday April 23, 2018 @02:50PM (#16906295)
You’re a computer hobbyist, you mean. You have to have done a whole lot of bargain-hunting to set that build up at that price. The “regular computer user” doesn’t bother with that—they just buy what they can afford at their local shop, which usually means a rather crap laptop.

(Mind you, it doesn’t take any more technical knowledgeability than most users to bargain-hunt like you have; but knowing that the product can be of varying quality at a given price, and caring enough to put in the time to get something of good quality, makes you an exception, in the same way that people who e.g. comparison-shop for quality suits or shoes are an exception. It’s a general mentality that most people don’t subscribe to—neither the “buying the best” of the rich, nor the “economizing” of the poor, but rather the optimizing ROI of the economics-minded. And even an economist will only apply this kind of thinking to cases where they actually believe this thing will affect their life enough that the research time-cost is worth it—i.e. when it’s a hobby of theirs. Economics-minded computer hobbyists are a rather more niche set than “regular computer users!”)

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by taeric on Monday April 23, 2018 @02:06PM (#16905859)
Define "regular computer user." What are you doing with these machines that comes close to using all of the cores?
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by nl on Monday April 23, 2018 @11:27PM (#16909638)
I don't know what the OP is doing, but something like XGBoost scales really well across multiple cores.

I've used my 2014 MBP with a 4 core i7 (plus hyperthreading) plus 3 desktop i5 boxes for over 24 hours straight on the same XGB task before. The 8 CPU threads on the MBP lets it outperform more recent machines on this kind of task.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by taeric on Tuesday April 24, 2018 @12:40AM (#16909883)
Oh, I get that there are things you can do with a setup like this. I challenge that this is a "regular computer user" level of thing to do, though. Mining bitcoin is not a regular user task. Nor is being a render farm for an animated movie. :)
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by nl on Tuesday April 24, 2018 @05:34AM (#16911159)
It's on a post called "Accelerating Deep Neuroevolution". I'm pretty sure it's a regular computer for anyone doing that....

I think the point of "regular" was that it's not exactly some extreme budget needed to do this.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by taeric on Tuesday April 24, 2018 @09:59AM (#16912609)
That makes some sense. However, even in an article about Olympic athletes, I would expect a "regular person" to not be one of them.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by nl on Tuesday April 24, 2018 @09:13PM (#16918012)
I think there’s an awful lot of emphasis on the word regular and not much on the “32 cores for $1000” which - given the context of this story - is much more relevant and interesting.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by taeric on Wednesday April 25, 2018 @04:31PM (#16925788)
I specifically quoted "regular computer user." This thread was specifically about that being a personal computer.

I mean, yes, I can see how an individual can get one. And it is definitely neat to see them pushed to their limits. But calling yourself a regular computer user with a machine that strong is a stretch.

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by banachtarski on Monday April 23, 2018 @02:03PM (#16905826)
*eyeroll

You're also one of "those" people

Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by mysterydip on Monday April 23, 2018 @02:54PM (#16906334)
Where'd you get them? I could use an upgrade for that price.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by segmondy on Tuesday April 24, 2018 @10:13AM (#16912709)
32 core from Amazon Used, the Xeon phi when it was on sale 2 yrs ago.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by igravious on Monday April 23, 2018 @02:05PM (#16905847)
It's more than a bit of a stretch I reckon. That's how the all but hermetically sealed SV tech scene warps some engineers sense of what a regular nerd has access to I suppose.
Re:Accelerating Deep Neuroevolution: Train Atari in Hours on... by lopmotr on Monday April 23, 2018 @05:09PM (#16907416)
If you only had 10% of the cores, that hour would become a day, which is still pretty good.