News for hackers. Stuff that matters.

matttah

Agreed, we use them for a number of things and find them very reasonably priced (especially, unlimited plan is very good if you are doing 5+ million).

Ask HN: Archive.is Captcha Problems Lately?

Anyone else having problems lately with archive.is taking you to a captcha, you solve it and then it just keeps redirecting you back to the captcha over and over. Happens to me in chromium, a friend just tried in firefox and had same problem.Today is happening to me on a link from another thread which was to https://archive.is/gwuFp

( Read More... | 20 comments | 3 points | on HN )
Re:Ask HN: What is something you built but never marketed? on Sunday August 14, 2022 @02:07PM (#32461449)
After getting tired of no way to easily follow news of AWS product updates for only ones I actually use we built Broadside. You can set which services you care about, how often you want to be notified and it sends you a digest of the updates.

https://getbroadside.com/

Ask HN: Katalon Experiences?

We're considering Katalon for a project for automated testing. Our goal is to have a non-technical staff build the tests on the frontend and thought Katalon may be a good tool for this with it's recorder.Was curious if anyone had any experience with it and how it worked out for your team. Our frontend is built on Angular.Thanks!

( Read More... | no comments | on HN )

Ask HN: Favorite Front end Test automation for non-devs

I'm looking at setting up a test automation suite for a frontend project and want non-developers to be able to add and update different tests, so something like a selenium recorder or comparable. I know some tests will be too complex/hard to do via a simple recorder so understand some tasks may require developer time.The frontend is built in Angular.At the time we're looking at Katalon but...

( Read More... | 1 comment | on HN )
Just the images on the front page, guess a bit bigger than icons!
Jstanier - Great job, this looks really cool. Curious what icon set are you using? I saw you have similar style icons across a few of your projects, is there a standard library you are using or are you creating them yourself?
Re:Ask HN: Keep Last X entries per ID in larger DB on Sunday January 20, 2019 @08:54PM (#18956965)
At 500 million+ records, even a 0.01 second per lookup/update is going to be too slow at that scale even in parallel, unless the DB is able to process in parallel without lock contention extremely quickly.
Re:Ask HN: Keep Last X entries per ID in larger DB on Sunday January 20, 2019 @08:52PM (#18956955)
Agreed that storage is cheap, unless it's in a live cluster. Right now I keep 100% of the data in Redshift then use window functions to unload the latest X per id. Keeping it in real time I haven't tried but right now the unloading of the full dataset of last X per id takes multiple days on a 6 node cluster.

The analysis at end of month is simply give me 100% of the data set chunked up by ID. All analysis is done outside of the system.

Flat files is my thinking right now with S3 and prefixes per partition, I'm not sure on file format, since one thing is with each day's data being able to process and update existing data quickly. Current thought is to load current day's data to Redshift -> unload sorted by id -> process concurrently. With multiple prefixes on S3 I won't hit the rate limits. My main worry is if read in, loading/parsing each file will take too long to be scalable at 250-500 million unique id's per day. I wanted to check here before going down that route to see if anyone had a different recommendation.

Ask HN: Keep Last X entries per ID in larger DB

I'm trying to figure out the best solution for the following:* Daily importing of ~500+ million rows of data, with ~250 million unique ids. * I need to only keep the latest X entries per unique ID. Older entries are discarded after X entries for that id has been achieved. * Monthly will read out the entire dataset for processingX can be anywhere from 1000 to 3000, it is static over the entire...

( Read More... | 7 comments | 2 points | on HN )
Re:Ask HN: Direct deposit/ACH processor for payroll? on Friday July 06, 2018 @06:49AM (#17470362)
I've heard good things about them, for me right now the payroll takes ~30 minutes or so a month with end of quarter payroll taking a little longer to create the 941 forms.
Re:Ask HN: Direct deposit/ACH processor for payroll? on Friday July 06, 2018 @06:48AM (#17470355)
We do the people at the same bank get free transfers, it's out of bank ones is ~5$ per transfer. The bank recommended using viewpost which charges at 50 cents/transfer but from their site they say they should not be used for payroll, and require the other side is registered on their network so it isn't just a routing+accounting numbers push ACH transfer.

Ask HN: Direct deposit/ACH processor for payroll?

We do our payroll in-house and currently send checks to our employees. I've been trying to find a company which will do direct deposits for us, however all the solutions I find seem to only work if you do the entire payroll solution with them, and for now we don't need or want to pay for a full service payroll.I've seen a few ACH services, but they have stated that you cannot use them for...

( Read More... | 5 comments | 6 points | on HN )
That's a great idea...perhaps a quick weekend project there we'll talk on!

Ask HN: Managed Colo – Where to find providers?

For a project I'm working on we need to have physical servers next to another companies servers. We don't want to manage the network (IP transit) and we do not have our own ASN. Part of the project is going over the exchange in the datacenter to the other company. We've deployed twice in NYC and LAX and both times have found providers which manage the network side of things, giving us a rack...

( Read More... | no comments | 2 points | on HN )

Ask HN: Thoughts on Vertx Framework

I've been evaluating a number of different frameworks to learn next. One I've looked at a number of times is Vertx. Most of the applications I deal with are B2B based applications which have longer running report tasks, integrate with outside services, and have a decent sized web frontend. For the frontend I'd probably use something like Angular to integrate with the backend. Some of the...

( Read More... | no comments | 3 points | on HN )
Re:Ask HN: How is your standing desk working for you? on Wednesday July 26, 2017 @10:16AM (#14856311)
It's great, I've been using one for ~2 years. I bought a powered adjustable one, but have only ever lowered it once when I had my ACL done about a year ago. Otherwise, I stand the entire day and find I can focus pretty well.

I also noticed I drink a bit more water and move around a little bit more since there isn't the "get up from sitting" process.

Older »