News for hackers. Stuff that matters.

dinedal

> You also need devops resources to manage a cloud setup

Don't you also need them in a colo?

https://tvdatanow.co/

We're an Ad Tech startup - cross device attribution measurement aimed at CTV specifically... and we have very few clients, just enough to pay the server bills and expenses but not enough to actually pay ourselves. Been like this for 3 years now.

It's hard, because the job is fairly demanding and it takes effort to keep this kind of big data apparatus going, but at the same time it's never quite dead and almost just barely always on the cusp of getting big enough to support ourselves with it.

We tried (and failed) to raise last year, so still entirely bootstrapped. With funding down right now another attempt at a raise doesn't seem like it's in the cards.

As the author of textql ( https://github.com/dinedal/textql ) - thanks for the shoutout!

Looks great, I love more options in the space for CLI based data analysis tools! Fantastic work!

Re:PRQL a simple, powerful, pipelined SQL replacement on Friday December 30, 2022 @04:16AM (#34183366)
> What is merge? How is it different from join? How is it different from union?

I believe the author is referencing https://www.essentialsql.com/difference-merge-update/ - which you answered in your first point. There's no UPDATE support yet, therefore there's no MERGE support yet.

Re:PRQL a simple, powerful, pipelined SQL replacement on Friday December 30, 2022 @04:11AM (#34183335)
> I don't find that it becomes a mess at all, because properly crafted views and procedures strongly encourage forced indexing and checking execution plans when you refactor them; as opposed to in-code, ad-hoc queries where it's hard to know if someone ever ran tests to optimize them.

I have to provide caution here, when you create views and stored procedures, I've always found it a mess to maintain:

1) VCS for stored procedures and views is usually non existent. Good luck understanding how these change over time and who changed them.

2) Deploying application logic alongside these systems is very painful, because unless you've versioned your views/stored procedures, when you make a breaking change you need to stop the entire application, make the change in the DB, and restart the entire application again on the new version. Zero-downtime deploys would require versioned views/stored procedures.

3) It quickly becomes a challenge to answer the question "what happens when I do X?" reliably, where X is insert, delete, or even select a row. Once you have complex enough stored procedures, modifying the data changes things in unexpected or unintended ways. A dev unaware of how the system works might assume that inserting a row simply inserts a row, but instead due to stored procedures hidden from application logic, it might cascade into inserting rows elsewhere, deleting rows, or modifying other rows in other tables. Discovering these issues without knowing that they could exist is often done around midnight during a production outage, because a new feature was released that did something in the DB that was presumed safe, but wasn't. If the code for the business logic were in one place, the application, it would been much easier to see what the change would actually do.

I understand entirely that performance gains from good DB use are astronomical, but in my humble experience, I've found them to be more trouble in the long run than they are worth.

e: spelling

Re:Avoiding homework with code and getting caught on Friday September 23, 2022 @04:31AM (#32949353)
> The problem is letting other people use it; of course it's nice to help people, and it's altruistic to do so for free, but some of those people might actually need this homework to learn, and you may have deprived them of that.

This, when the scope is limited to yourself, it's very different from when it impacts others.

Back when AOL Instant Messenger (AIM) was super popular, I was in university and had read about ARP poisoning. Our school was pretty cheap, so all the dorms had hubs instead of switches. This meant that it would be, theoretically, possible to ARP poison an entire dorm, MITM attack and read all the text being sent on AIM since it was sent in the clear. I had a bit of a cyber security passion lab in my dorm room, so I wrote a PoC and ran it on a LAN air-gapped from the rest of the network. I proved that it should work for myself, having confirmed that similar cleartext messages would get passed to the machine intending to listen in between two other machines.

I told my classmate of my project and he expressed interest, so I gave him a copy. Fortunately, I didn't add any authorship info, mostly because I forgot to. I did caution him that ARP poisoning is a pretty "noisy" attack, and someone who was paying attention would notice it. He foolish ran it on the university network, and confirmed he was able to see AIM messages flying back and forth for all the dorm, as well as all the other traffic. It didn't take long for our school's IT to notice that one dorm was funneling all traffic through one machine. A week later he was banned from having a computer in his dorm room for a school year. Thankfully he never gave me up, admitting it was his stupidity that brought it on himself, but nevertheless it was a lesson learned - if you're going to play in the grey space between ethical and not, do so responsibility and don't share the exploits with others.

Re:Taxing Mechanical Engineers and Subsidizing Drama Majors on Monday September 19, 2022 @11:54AM (#32900026)
Look, it's obvious when it's an aged degree and you can easily see that the granting of that degree has little chance to a highly paid job. What do you do when it isn't obvious? When I got my student loans for my comp sci degree, it was right at the bottom of the dot-com bust. Everyone was convinced all tech was going to be outsourced and that it was a dead end degree, foolish to pursue.

If the banks had any say in if I would have gotten loans that year, it would have been no. And I wouldn't have gone on to a lucrative career in tech.

I'm not convinced that letting loan underwriters pick the future labor force allocation is the solution.

Re:Ask HN: So, what's up with Phoenix (web framework)? on Saturday August 20, 2022 @07:54AM (#32531330)
Having used Pheonix for one of my small failed startups in the past (failed because of the business, not because of the tech) - I loved every second of it. It was super easy to use and extremely quick to be productive. Ecto is a fantastic ORM, the OTP system is great to build on, and LiveView is magic. As a solo dev, it is a true isomorphic web dev experience with a nice clean language and structure to build in. Even tests work.

I just wish I could get a job in it.

Re:AWS costs every programmer should know (2019) on Thursday June 09, 2022 @04:47AM (#31678973)
> if your service succeeds, you will definitely want to move some components out of aws, but not all of it. aws can always remain the control plane.

Do you factor in the costs of dev time in a cross cloud environment at all? Nevermind all the AWS specific tooling and code you write, which needs to be thrown away and re-done to accomplish this?

Don't get me wrong, I love AWS when I'm not paying the bill, it makes my job of shipping features quickly so much easier. It's good and it works well. But it's a little crazy to think it's "cheap" and to ignore the costs of vendor lock in.

Re:I won free load testing on Monday May 02, 2022 @07:25AM (#31233742)
Just so I understand, you decided to protest this pricing not by boycotting the service, or making a public statement about it, but instead by targeting an employee's use of the platform with an attack? I'm sorry, I really don't get why you did this or why you thought it would be effective.
Re:Resumes are dangerous? on Monday April 25, 2022 @06:34AM (#31152665)
If you're slinging Euler in Haskell, the insight is that you're probably overqualified for most corporate java jobs.
Re:Show HN: M3O – an open source public cloud platform on Wednesday October 20, 2021 @06:50AM (#28929172)
As far as I can tell, only serverless function calls and deployments actually incur costs?

Not sure how I’d actually host a web app/site on it, there doesn’t appear to be any documentation on pointing a DNS entry to an entry point or even static file hosting.

Also no notes on HA or reliability, but I guess you get what you pay for in these cases.

Re:Startup Ideas on Wednesday October 06, 2021 @08:42AM (#28772437)
https://www.gwern.net/Startup-ideas#pet-lemon-market what the actual fuck? seriously positing that a company sell purpose made pets with illnesses to extract money from people who love them? what kind of "value" did this add to the world? disgusting.
The rant is a much better read and insight into the reason for this: https://github.com/csdvrx/sixel-tmux/blob/main/RANTS.md
Re:Open-source alternatives to popular B2B tools on Thursday July 22, 2021 @07:29AM (#27917653)
It's weird that Node-RED is listed as closed source software? But it is open source? https://github.com/node-red
Re:Show HN: SQLite query inside a Bash function on Wednesday July 07, 2021 @12:07PM (#27762678)
You can do this with https://github.com/dinedal/textql as well, and a little easier as you don't need to import the data explicitly.

  SQL_QUERY=<<-EOS
    SELECT 
      category.name AS category, 
      composition.key, 
      composition.composer, 
      composition.name AS composition, 
      concert.name AS concert
    FROM 
      category, 
      concert, 
      composition, 
      program
    WHERE 
      julianday(concert.date) < julianday('now')
      AND composition.category = category.name
      AND program.key = composition.key
      AND program.date = concert.date
    ORDER BY 
      category.sequence, 
      composition.key
    ;
  EOS

  textql --header --dlm=tab --sql $SQL_QUERY category.tsv composition.tsv concert.tsv program.tsv
Does anyone know of the"sqlite connector" mentioned in this post ?

https://opensourceconnections.com/blog/2013/05/06/does-found...

It would be really cool to find it, if it's still out there.

Regardless of the reason being the limit or not - are these limits published anywhere? It doesn’t appear to be the case.
The link to download the 311 reporting app for Android and iOS are on the right side of page when viewed on a desktop, not sure how it looks on mobile however the link should still be there.
SF already has this: http://mobile311.sfgov.org/reports?utf8=%E2%9C%93&q=poop

Just report the poop on 311 and they go clean it up. Yes it works.

Re:Apple updates its iMac line on Tuesday March 19, 2019 @02:08PM (#19433656)
> I'd recommend a hackintosh Intel NUC

What models work with minimal fuss? What about updates? How do I know that an update won't replace/delete some kext that I need and brick it or break some required functionality?

I really wanted to do this a year ago - except there wasn't any hardware that seemed to answer those questions satisfactorily. In the end, the stability of knowing I can turn on the computer and start work every day without worrying about having to drop into a recovery console because an update f'd is worth more to me than a few grand.

Maybe things have changed?

Re:TLDR Stock Options on Monday March 04, 2019 @07:25PM (#19307066)
Also, you can buy as many lottery tickets as you can afford - you only have so many shots at picking a promising company in your working days.
Re:Pagedraw is shutting down and going open source on Thursday February 28, 2019 @02:46PM (#19274414)
The reason they didn't use redux was explained in the medium post.[1]

> We just used global mutable state instead of the whole immutable Reduxy patterns people liked to enforce. It was simple and it worked great.

[1] https://medium.com/@gabriel_20625/technical-lessons-from-bui...

Re:Pagedraw is shutting down and going open source on Thursday February 28, 2019 @02:42PM (#19274383)
The link to the source is right on the page? https://github.com/Pagedraw/pagedraw
Re:Activision Blizzard Begins Massive Layoffs on Tuesday February 12, 2019 @06:28PM (#19148788)
Thanks for the followup!
Re:Activision Blizzard Begins Massive Layoffs on Tuesday February 12, 2019 @05:45PM (#19148433)
I don't fully understand the specifics, I thought that dividend tax was generally 15% in the lower tax bracket, and wouldn't the $50 of non-dividend income be taxable at short term capital gains, or 40%? That means that the $100 of dividend income would be $15 in taxes vs $20 of taxes for the $50 in short term capital gains.

What am I missing?

The problem is simple, trust. How can we trust that you're not going to be skimming data going through the VPN, MITM attacks, etc?

There's not even a privacy policy on that page, no indication where your servers are hosted or what laws they are subject to.

Re:Building Thousands of Reproducible ML Models with pipe on Wednesday January 09, 2019 @01:36PM (#18867342)
No source link? No access to this "magical pipe"? Is this a showcase of proprietary software?
I think this is more useful from the perspective of, if you have some busy task and you need to get the data back into the DOM, what can you do? You either need to build a messaging layer, which was the defacto way, or use this. I have a few projects that could benefit from this, being able to put a progress bar in the DOM and have the worker update it in a clean API is pretty neat.

Older »