News for hackers. Stuff that matters.
Re:Developer Preview – EC2 Instances with Programmable Hardware by ranman on Wednesday November 30, 2016 @12:15PM (#13072529)
If you don't click through to read about this: you can write an FPGA image in verilog/VHDL and upload it... and then run it. To me that seems like magic.

HDK here: https://github.com/aws/aws-fpga

(I work for AWS)

Re:Developer Preview – EC2 Instances with Programmable Hardware by cottonseed on Wednesday November 30, 2016 @04:57PM (#13075086)
This is so awesome, I can't even. I wrote arachne-pnr [0] to learn about FPGAs to get ready for this day. Just signed up, can't way to play with these!

I hope the growing popularity of FPGAs for general-purpose computing will help push the vendors to open up bitstreams and invest in open-source design tools.

[0] https://github.com/cseed/arachne-pnr

Re:Developer Preview – EC2 Instances with Programmable Hardware by makapuf on Thursday December 01, 2016 @07:45AM (#13078977)
Wow Clifford is that you ? I hope this, exciting as it may be, won't make you leave open fpga efforts for the dark side (saw your talk last Fosdem, was very exciting)
Re:Developer Preview – EC2 Instances with Programmable Hardware by aseipp on Thursday December 01, 2016 @12:51PM (#13081585)
Cotton is the author of arachne-pnr. Clifford is the author of Yosys and IceStorm, which are all separate projects. Not the same person.

FWIW, Clifford has recently started reversing the bits of the modern Xilinx FPGA series. So, stay tuned for a Xilinx IceStorm-equivalent sometime down the road (a few years, probably...)

Re:Developer Preview – EC2 Instances with Programmable Hardware by cottonseed on Thursday December 01, 2016 @05:52PM (#13084343)
No, Clifford is cliffordvienna on HN. He wrote Yosys (and amazing piece of software) and did the iCE40 reverse engineering (amazing work). I wrote the place and router, arachne-pnr.
Re:Developer Preview – EC2 Instances with Programmable Hardware by makapuf on Tuesday December 06, 2016 @02:15PM (#13117395)
And kudos for that.
Re:Developer Preview – EC2 Instances with Programmable Hardware by orbifold on Wednesday November 30, 2016 @04:20PM (#13074786)
I'm very curious if/how you have managed to make the developer experience sane and enjoyable. I've experience with a FPGA cluster of ~800 FPGAs and it definitely does not get used to its full potential because of the tooling around it.
Re:Developer Preview – EC2 Instances with Programmable Hardware by adamdecaf on Wednesday November 30, 2016 @12:35PM (#13072732)
Is that repo going to be made public? It looks to be private right now.
Re:Developer Preview – EC2 Instances with Programmable Hardware by ranman on Wednesday November 30, 2016 @01:02PM (#13073003)
Yup, sorry -- working on fixing that now. Check back in a bit.
Re:Developer Preview – EC2 Instances with Programmable Hardware by ranman on Wednesday November 30, 2016 @07:46PM (#13076062)
Still not fixed. I'all reply here when it is. Might be a few days because of reinvent stuff.
Re:Developer Preview – EC2 Instances with Programmable Hardware by __d on Wednesday November 30, 2016 @08:47PM (#13076455)
Thanks for the update. Been chasing that link all morning :-)
Re:Developer Preview – EC2 Instances with Programmable Hardware by ranman on Wednesday November 30, 2016 @03:28PM (#13074401)
If you guys are curious about these announcements I'll be recapping them and going into more detail on twitch.tv/aws at 12:30 pacific
Re:Developer Preview – EC2 Instances with Programmable Hardware by brian-armstrong on Wednesday November 30, 2016 @03:52PM (#13074573)
Huh? Isn't Twitch just for gaming content?
Re:Developer Preview – EC2 Instances with Programmable Hardware by tyleraldrich on Wednesday November 30, 2016 @04:38PM (#13074932)
What others have said is true, and also note that Amazon bought Twitch 2 years ago, so I'm sure Amazon can run their own product announcements through Twitch if they want :)

EDIT: updated when amazon bought twitch, woops

Re:Developer Preview – EC2 Instances with Programmable Hardware by frikk on Wednesday November 30, 2016 @03:54PM (#13074596)
Nope. Twitch is excellent for all kinds of live content.
Re:Developer Preview – EC2 Instances with Programmable Hardware by brian-armstrong on Wednesday November 30, 2016 @04:01PM (#13074658)
https://www.twitch.tv/p/rules-of-conduct

"All content that is neither gaming-related nor permitted under the rules for Twitch Creative Conduct is prohibited from broadcast."

Re:Developer Preview – EC2 Instances with Programmable Hardware by Crosseye_Jack on Wednesday November 30, 2016 @04:08PM (#13074711)
I've seen many people programming on Twitch https://www.twitch.tv/directory/game/Creative/programming

While its mainly Game dev or game dev related its not limited to game dev stuff. From their FAQ https://help.twitch.tv/customer/portal/articles/2176641

  Examples of what you can broadcast on Twitch Creative:
  ...
  Programming and coding  
  Software and game development  
  Web development
EDIT: It seems that re:invent is being streamed on twitch anyway.
Re:Developer Preview – EC2 Instances with Programmable Hardware by brian-armstrong on Wednesday November 30, 2016 @04:11PM (#13074725)
This is a product announcement, though
Re:Developer Preview – EC2 Instances with Programmable Hardware by Crosseye_Jack on Wednesday November 30, 2016 @04:16PM (#13074759)
And Twitch have had TV Shows streamed on it in the past https://www.twitch.tv/whoismrrobot

My guess that was a sponsored deal or something. But as my edit from before it seems that re:invent is being streamed on Twitch anyway so guessing its all above board (and as others have said Amazon owns Twitch).

Re:Developer Preview – EC2 Instances with Programmable Hardware by mattnewton on Wednesday November 30, 2016 @06:40PM (#13075725)
Amazon might just let Amazon talking about their products slide ;)
Re:Developer Preview – EC2 Instances with Programmable Hardware by res0nat0r on Wednesday November 30, 2016 @04:09PM (#13074715)
I'm guessing it is covered under the Twitch Creative Conduct, since there is an entire Creative category now that is getting more popular which involves people painting, cosplay, digital art, etc.
Re:Developer Preview – EC2 Instances with Programmable Hardware by shaklee3 on Wednesday November 30, 2016 @04:23PM (#13074816)
What's the cost?
Re:Developer Preview – EC2 Instances with Programmable Hardware by noselasd on Wednesday November 30, 2016 @05:08PM (#13075169)
So it's tied to the PCIe bus - how do you interact with your FPGA once you programmed it - are there general drivers you can use, or do you also have to create a linux driver to talk to your FPGA ?
Re:Developer Preview – EC2 Instances with Programmable Hardware by scott_wilson46 on Thursday December 01, 2016 @05:12AM (#13078429)
Xilinx provide software drivers and IP for PCIe DMA and memory mapped interfaces. These are fairly easy to integrate (probably not the best for latency though - I've developed my own but I require a specific use case - low latency but don't care about bandwidth).
Re:Developer Preview – EC2 Instances with Programmable Hardware by eliben on Wednesday November 30, 2016 @03:49PM (#13074561)
I'm not sure what you mean by the "magic" part here, can you please clarify?

[background: many years of writing VHDL specifically for FPGAs, using various dev boards and custom boards]

Re:Developer Preview – EC2 Instances with Programmable Hardware by ebrewste on Wednesday November 30, 2016 @04:10PM (#13074717)
The magic part is the thing we have gotten used to with the cloud -- virtual hardware you never see and rent by the minute. Imagine having an FPGA idea and not needing to make board, pay for a dev board, or even find a dev board in your lab... Like your idea and need more? Spin up 100 more right now...
Re:Developer Preview – EC2 Instances with Programmable Hardware by zyngaro on Wednesday November 30, 2016 @02:23PM (#13073790)
Exactly what I thought. This is amazing. FPGA is commonly used in embedded systems to perform application specific tasks and now application developers have access to this power too. I guess many machine learning application might take profit of that power instead of using comparatively very expensive graphics hardware.
Re:Developer Preview – EC2 Instances with Programmable Hardware by cma on Wednesday November 30, 2016 @06:04PM (#13075516)
How do FPGAs compare with GPUs for the inference stage of Deep Learning algorithms? Can they accelerate it a lot?
Re:Developer Preview – EC2 Instances with Programmable Hardware by nl on Thursday December 01, 2016 @04:44AM (#13078306)
No, but they do use less power:

To the best of our knowledge, state-of-the-art performance for forward propagation of CNNs on FPGAs was achieved by a team at Microsoft. Ovtcharov et al. have reported a throughput of 134 images/second on the ImageNet 1K dataset [28], which amounts to roughly 3x the throughput of the next closest competitor, while operating at 25 W on a Stratix V D5 [30]. This performance is projected to increase by using top-of-the-line FPGAs, with an estimated through- put of roughly 233 images/second while consuming roughly the same power on an Arria 10 GX1150. This is com- pared to high-performing GPU implementations (Caffe + cuDNN), which achieve 500-824 images/second, while con- suming 235 W. Interestingly, this was achieved using Micros oft- designed FPGA boards and servers, an experimental project which integrates FPGAs into datacenter applications.

https://arxiv.org/pdf/1602.04283v1.pdf

Re:Developer Preview – EC2 Instances with Programmable Hardware by shaklee3 on Thursday December 01, 2016 @10:30AM (#13079975)
That's hard to compare. Typically FPGAs are doing fixed-point math, so they can do more operations with less power. GPUs have traditionally done floating point. However, with the new Pascal architecture, certain cards (P4/P40) support 8-bit integer dot products, which give a massive boost in performance/W. It's still fairly high at 250W, but that's for an entire card with 24GB of memory. You'd have to compare that to an FPGA with that much memory on a PCIe card if you're doing apples to apples. Something like this is appropriate for comparison: http://www.nallatech.com/store/fpga-accelerated-computing/pc...
Re:Developer Preview – EC2 Instances with Programmable Hardware by grandalf on Wednesday November 30, 2016 @01:38PM (#13073354)
This is very awesome. Could you add some more thoughts on the tooling and the development workflow? Is it possible to target the Xilinx hardware using only open source (or AWS proprietary) tools? Or is Vivado still required for advanced stuff?
Re:Developer Preview – EC2 Instances with Programmable Hardware by aseipp on Wednesday November 30, 2016 @02:51PM (#13074063)
Vivado is required for all advanced features and programming Xilinx chips in general; like the sibling post said, there is no open FPGA toolchain implementation for Xilinx devices, especially for extremely high end ones like the ones being offered on the F1 (I expect they'd run at like, several thousand USD per device, on top of a several thousand dollar Vivado license for all the features).

It doesn't look like there's much AWS proprietary stuff here, though we'd have to wait for the SDK to be opened properly to be sure. I imagine it's mostly just making all of the stuff prepackaged and easily consumable for usage, and maybe some extra IP Cores or something for common stuff, and lots of examples. If you're already using Vivado I imagine using the F1/Cloud won't introduce any kind of major changes to what you expect.

Re:Developer Preview – EC2 Instances with Programmable Hardware by duskwuff on Wednesday November 30, 2016 @05:54PM (#13075456)
> I expect they'd run at like, several thousand USD per device...

You're guessing about an order of magnitude too low, actually. The VU9P FPGAs Amazon is using cost between $30,000 and $55,000 each, depending on the speed grade.

Yes, this means a fully equipped F1 instance costs nearly half a million dollars. Don't count on the instances being cheap to run.

Re:Developer Preview – EC2 Instances with Programmable Hardware by chx on Wednesday November 30, 2016 @06:47PM (#13075760)
Do you have a source? I am curious. http://www.digikey.com/product-detail/en/xilinx-inc/XCKU040-... this surely is not the right chip then.
Re:Developer Preview – EC2 Instances with Programmable Hardware by duskwuff on Wednesday November 30, 2016 @07:37PM (#13076016)
https://aws.amazon.com/ec2/instance-types/

Scroll down to "F1"; it says:

> Xilinx UltraScale+ VU9P FPGAs

The VU9P isn't available through DigiKey, but is listed by Avnet. I don't know which specific package and speed grade Amazon is using, but here's one:

https://products.avnet.com/shop/en/asia/programmable-logic/f...

Re:Developer Preview – EC2 Instances with Programmable Hardware by RandomOpinion on Wednesday November 30, 2016 @02:23PM (#13073783)
The press release says:

"This AMI includes a set of developer tools that you can use in the AWS Cloud at no charge. You write your FPGA code using VHDL or Verilog and then compile, simulate, and verify it using tools from the Xilinx Vivado Design Suite (you can also use third-party simulators, higher-level language compilers, graphical programming tools, and FPGA IP libraries)."

So basically, buying a copy of Vivado is the minimum. There aren't any open source tools that directly output Xilinx FPGA bitstreams that I know of.

Re:Developer Preview – EC2 Instances with Programmable Hardware by aseipp on Wednesday November 30, 2016 @02:43PM (#13073964)
It looks like the FPGA Developer AMI includes Vivado and a license explicitly for use on these platforms (look at the PuTTY screenshot in the blog post; it has a customized MOTD). You just need to set up the license server that Vivado will use and point it to the right license.

So I guess the real question is: what exactly is granted by the Vivado license on these AMIs? Do we get things like SDSoC, SDAccel, etc, and all the libraries? [1] The blog seems to imply you can program these things with OpenCL too (AKA SDAccel), so I'm guessing that these features are all enabled, but details about the included Vivado license in the AMI would be nice.

[1]: https://www.xilinx.com/products/design-tools/vivado.html#buy

Re:Developer Preview – EC2 Instances with Programmable Hardware by pjmlp on Wednesday November 30, 2016 @01:26PM (#13073234)
+1 for VHDL. :)
Re:Developer Preview – EC2 Instances with Programmable Hardware by ap22213 on Wednesday November 30, 2016 @06:21PM (#13075613)
that repository is 404?
Re:Developer Preview – EC2 Instances with Programmable Hardware by grandalf on Friday December 02, 2016 @12:20PM (#13090429)
Hmm this still isn't public. Any ETA?
Re:Developer Preview – EC2 Instances with Programmable Hardware by cardigan on Wednesday November 30, 2016 @02:22PM (#13073768)
This is really cool. Do you think it will be possible to run MongoDB on an FPGA anytime soon?
Re:Developer Preview – EC2 Instances with Programmable Hardware by Something1234 on Wednesday November 30, 2016 @02:24PM (#13073796)
I really hope that is sarcasm.
Re:Developer Preview – EC2 Instances with Programmable Hardware by gnofehufo on Wednesday November 30, 2016 @02:47PM (#13074016)
I'm currently working on this. Speedup around 2x for most operations. Not kidding, quite a few startups are currently trying to optimize typical data operations with special algorithms.
Re:Developer Preview – EC2 Instances with Programmable Hardware by wmf on Wednesday November 30, 2016 @02:56PM (#13074116)
Aren't there other software databases that are already more than 2x faster than Mongo and don't lose data?
Re:Developer Preview – EC2 Instances with Programmable Hardware by gnofehufo on Wednesday November 30, 2016 @03:38PM (#13074481)
Maybe, I'm not talking about Mongo specifically.

You can find 'equivalents' to CPU data structures for FPGAs and speed up operations on/with them while still saving power. There's lots of trouble with how buffers are used and memory is accessed. So it's not a trivial task, but IF you can optimize generic data structures and replace the existing ones you basically have 2x the speed or half the energy consumption for any DB.

Re:Developer Preview – EC2 Instances with Programmable Hardware by brian-armstrong on Wednesday November 30, 2016 @03:53PM (#13074589)
But what's the developer time/cost for that?
Re:Developer Preview – EC2 Instances with Programmable Hardware by gnofehufo on Wednesday November 30, 2016 @04:43PM (#13074988)
Totally depends on your use case.

From the blog post:

> From here, I would be able to test my design, package it up as an Amazon FPGA Image (AFI), and then use it for my own applications or list it in AWS Marketplace.

As a user of those Marketplace images, you just look at the hourly fees. Your team needs to set this up, of course, and replace the old stuff, e.g. MongoDB with a new, sped-up FPGA-MongoDB. (And you'd need to fix some new bugs.)

If time is super-critical to you, e.g. if you're working with analytics: do you really need to speed up your processing pipeline? E.g. processing stuff not once but twice per day? If yes, then you'd better off having people on your team who understand all this and are able to fix and implement stuff themselves. Second scenario would be quite a bit more expensive, but still, FPGAs aren't rocket science and there's no way around them in the future.

Re:Developer Preview – EC2 Instances with Programmable Hardware by jonjenk on Wednesday November 30, 2016 @04:33PM (#13074891)
Sure, but they aren't Web Scale!