News for hackers. Stuff that matters.
Re:Modifications to Google Chromium for removing Google inte... by voltagex_ on Monday September 24, 2018 @12:25AM (#18055018)
Heh, I wonder how much that costs. You certainly don't want to be building the whole Android tree on the free tier.

Edit: that's really well done - https://github.com/dan-v/rattlesnakeos-stack#how-much-does-t...

Re:Modifications to Google Chromium for removing Google inte... by danvittegleo on Monday September 24, 2018 @01:34AM (#18055250)
I actually recently added a feature to search for the cheapest spot instance price across a number of different regions. Right now for example the cheapest price for the instance type used c5.4xlarge is ~$0.15/hour in us-east-2. This equates to a full AOSP build with Chromium build included (~5.25 hours) costing $0.80 and without Chromium (~1.75 hours) costing $0.30
Re:Modifications to Google Chromium for removing Google inte... by voltagex_ on Monday September 24, 2018 @01:44AM (#18055281)
How do you handle spot instances being shut down mid-build? Can you recover any built artifacts before the system goes down? IIRC you get a 2 minute warning.
Re:Modifications to Google Chromium for removing Google inte... by danvittegleo on Monday September 24, 2018 @01:54AM (#18055332)
Right now if a spot instance terminates mid-build it doesn't attempt to save any progress. I do have an open item to at least alert users that this has happened though (https://github.com/dan-v/rattlesnakeos-stack/issues/41). Although if Chromium is built it will checkpoint that by saving the built artifact to S3 and would then skip the Chromium build next time. I've found it's much cheaper to do full builds on AWS each time rather than trying to store the source tree for AOSP and Chromium as they are just so large.
Re:Modifications to Google Chromium for removing Google inte... by snaky on Monday September 24, 2018 @02:10AM (#18055404)
That's amazing the Chromium is almost 3 times longer to build than AOSP.
Re:Modifications to Google Chromium for removing Google inte... by snaky on Monday September 24, 2018 @01:13AM (#18055180)
Yes, that's well done. But it would be nice to port RattlesnakeOS build system from AWS to e.g. Nextcloud - because you pay for your Nextcloud VPS anyway, most of the time it's doing nothing, and most of the time you don't really care would it build in 2 hours or 2 days.
Re:Modifications to Google Chromium for removing Google inte... by voltagex_ on Monday September 24, 2018 @01:25AM (#18055230)
I don't know enough Go - but it'd be awesome to port it to packet.net in particular for the 24 core Epyc boxes.

Most people's VPS won't have enough RAM to run the Android builld process.

Re:Modifications to Google Chromium for removing Google inte... by danvittegleo on Monday September 24, 2018 @01:37AM (#18055262)
If you were looking to just do something similar but running on another platform, knowledge of Go isn't required. The core build process is a shell script, which just has some variables injected through Go templates: https://raw.githubusercontent.com/dan-v/rattlesnakeos-stack/...
Re:Modifications to Google Chromium for removing Google inte... by voltagex_ on Monday September 24, 2018 @01:43AM (#18055277)
I'd definitely like to talk to you further about this - it still looks like there's a lot of hardcoded AWS stuff in there, and your terraform code assumes AWS, but it's super cool - thanks.
Re:Modifications to Google Chromium for removing Google inte... by danvittegleo on Monday September 24, 2018 @02:02AM (#18055360)
For sure. I'd love to have this script be able to run standalone as a local build process that would be portable across platforms and only run the AWS specific bits if you passed a flag for example. Anyways, happy to chat - you can shoot me an email [email protected]
Re:Modifications to Google Chromium for removing Google inte... by snaky on Monday September 24, 2018 @01:45AM (#18055288)
If you don't really care would the build take 2 hours or 2 days, using swap on SSD might solve the RAM problem.
Re:Modifications to Google Chromium for removing Google inte... by voltagex_ on Monday September 24, 2018 @01:47AM (#18055300)
I think you underestimate just how slow that'd be. My recollection is that the Android build tree is 30+GB and the build is extremely IO intensive.
Re:Modifications to Google Chromium for removing Google inte... by snaky on Monday September 24, 2018 @01:57AM (#18055338)
There are cheap VPS with even NVMe storage nowadays. And to port it on VPS is not much different from porting it to 'any Linux box or VM' which might be local server or even a laptop (when you could just run it with nice settings in background).