News for hackers. Stuff that matters.

fsaintjacques

I recently toyed with a tiny VM for protobuf, you can use it in redpanda WASM streams, or in streaming pipeline (without having to use SAX parsers or IDL shenanigans with projected message compiled...) for filtering and projecting before deserializing. 100% written by claude.

https://github.com/fsaintjacques/wql

Re:Building a Streaming Platform in Go for Postgres on Monday November 06, 2023 @07:21PM (#38171305)
If only go had lambdas, functional interfaces and record classes...
Re:How to (and how not to) design REST APIs on Wednesday November 01, 2023 @05:23PM (#38105507)
I highly recommend anyone to read Google's [AIP](https://google.aip.dev/). There's even a grpc schema linter for it. Put more focus on the resource data design than nitpicking on transport details. I would consider the best lessons to be:

- Optional but supported user defined identifiers, it's so frustrating to work with API that passes you back an identifier.

- String identifier (names) for resources, with some kind of type namespacing, i.e. the prefix in the author's document - Consistent set of fields (create_time, update_time, annotations, ...)

- Avoid dynamic map (this is a JSON self-inflicted wound)

JSON parsing is a minefield, especially in cross-platforms scenarios (language and/or library). You won't encounter those problems on toy project or simple CRUD applications. For example, as soon as you deal with (u)int64 where values are greater than 2^53, a simple round-trip to javascript can wreak silent havoc.

See http://seriot.ch/projects/parsing_json.html

Protobuf support for google's first-class citizen languages is usually very good, i.e. C++, Java, Python and Go. For other languages, it depends on each implementation.

Re:Ask HN: Have you used SQLite as a primary database? on Monday April 25, 2022 @08:48AM (#31153684)
If the application is in go, you can likely embed litestream.
glibc already does dynamic dispatch for the memcpy family of functions.
Re:Ask HN: Who is hiring? (April 2021) on Thursday April 01, 2021 @02:57PM (#26664637)
Optable | Montreal and Remote | Golang, React, Crypto | Full-Time | https://www.optable.co

Optable is building a decentralized data management and connectivity platform designed for online advertising. Our goal is to enable advertisers to leverage publisher's first-party data in a world where third-party cookies and globally shared identifiers will disappear. We operate private instances of our software on behalf of our customers. We use modern, secure multiparty computation and cryptographic techniques to allow matching of data while protecting privacy. We are looking for full-stack engineers who are comfortable working on complex backend features but won't shy away from front-end development. We are also looking for a cryptography engineer to help us build cryptography software and protocols.

Please apply by writing to careers -at- optable.co and mention hackernews.

https://www.optable.co/jobs/software-eng-full-stack-dev https://www.optable.co/jobs/cryptography-engineer

Re:Samsung TV owners complain about increasingly obtrusive ads on Tuesday September 29, 2020 @06:40AM (#24626064)
It sure does.
Re:I lost €4k in a Facebook scam on Monday September 14, 2020 @10:38AM (#24470651)
Let me introduce you to the underworld of affiliate marketing https://www.investopedia.com/terms/a/affiliate-fraud.asp

There's always money to be made if you can generate significant legitimate traffic to a given destination.

Re:FlexBuffers on Sunday June 21, 2020 @09:40AM (#23591958)
Not zero copy, requires deserialization.
Because it would be a trivial indicator that you're in incognito mode.
Re:How we scrape 300k prices per day from Google Flights on Saturday June 13, 2020 @03:23PM (#23511946)
There's a very high chance this is monetization of botnets, which adds even more to the overall shadyness.
Re:Pure Bash Bible on Thursday September 19, 2019 @10:19AM (#21016396)
Python is a portability minefield. I'll spend more time trying to get the script/package run than reading the bash script.
See https://backtrace.io, disclaimer, previous employee.
Re:AdTech Sucks on Friday June 07, 2019 @10:31AM (#20124865)
rtb bid request volume can easily go 1m/sec, this is not impressions, but offers to buy for an impression.
Re:AdTech Sucks on Friday June 07, 2019 @10:29AM (#20124855)
Technical challenges and salary. In my local market, most jobs are web shops and/or CRUD business applications with low pay.
Re:On SQS on Monday May 27, 2019 @08:08AM (#20021455)
Tables as queues is perfectly legit, one less component to worry about.
I received my first paper nigerian scam last month!
Re:AI Startups in Montreal on Tuesday October 23, 2018 @10:40AM (#18283740)
They have a few people and a tiny office recruiting for developers. I work beside them.

https://www.peersight.com/job/appnexus-senior-software-engin...

Re:AI Startups in Montreal on Tuesday October 23, 2018 @09:06AM (#18282997)
As a software engineer in Montreal, you can get above market rate at these companies:

- AdGear

- AppNexus

- Element.ai

- Google

- Hopper

- Shopify

Re:Arguing against using protobuffers on Thursday October 11, 2018 @09:27AM (#18193323)
This.

Don't forget integer type defined by implementation. Very easy to shoot yourself in the foot in when consumers/producers are not written in the same language, even more if it's a mix of dynamic and static languages.

Nothing beats a well defined and commented schema.

Re:Intel Announces Optane DIMMs on Wednesday May 30, 2018 @09:02PM (#17193191)
I'm curious about this, could you point at the documentation?
Re:Intel Announces Optane DIMMs on Wednesday May 30, 2018 @03:46PM (#17191088)
AFAIK, the Optane disks are _byte_ addressable.
Re:Cache Organization in Intel CPUs (2009) on Wednesday June 07, 2017 @12:39PM (#14507813)
Coffee lake is not the same as cannon lake. This chart is from 2015 and suggests the cannon lake would be released in early 2017.

I doubt we'll see cannon lake this year, since they released kaby lake early 2017...

https://en.wikipedia.org/wiki/Coffee_Lake https://en.wikipedia.org/wiki/Cannonlake

Re:Cache Organization in Intel CPUs (2009) on Wednesday June 07, 2017 @10:28AM (#14506689)
It seems you know this subject very well :) https://github.com/etep/resume

On an unrelated subject, do you know if the next desktop generation (coffeelake?) will support AVX512 or should I just buy a skylake-x?

Re:x86 Paging Tutorial on Thursday March 02, 2017 @08:08AM (#13773734)
Ciro, your work is amazing.
Re:Ubuntu 16.04.2 LTS released on Friday February 17, 2017 @09:16AM (#13668340)
Does that means you can have fairly recent kernels with LTS releases? If so, amazing. That was my biggest complaint of Ubuntu on servers.
Re:Hackers Make $5M a Day by Faking 300M Video Views on Tuesday December 20, 2016 @01:48PM (#13222687)
I almost replied like you did; the joke is that there is no such list.
Re:Hackers Make $5M a Day by Faking 300M Video Views on Tuesday December 20, 2016 @01:45PM (#13222663)
You take a decision based on an offer called the bid request, domain/url/page is part of said metadata.

The catch is that almost all fields in said offer can be faked by a malicious adversary due to lack of security/competence from the exchange.

Older »