MasterIdiot

"add tests to"

Off the top of my head:

- Vortex https://github.com/vortex-data/vortex

- Lance https://github.com/lancedb/lance

- Nimble https://github.com/facebookincubator/nimble

There are also a bunch of ideas coming out of academia, but I don't know how many of them have a sustained effort behind them and not just a couple of papers

I think the distribution he uses is pretty close to the paper he links "Exploiting Cloud Object Storage for High-Performance Analytics" https://www.durner.dev/app/media/papers/anyblob-vldb23.pdf

anecdotally Meta has pretty lax moderation against anti-palestinian in Hebrew, allowing tons of extremely racist/violent speech.

Having worked for a SIEM vendor, I can say that all security software is extremely invasive, and most security people can probably track every action you make on company-issued devices, and that includes HTTPS decryption.

Prometheus push gateway maybe? I guess it depends on limitations like battery life, bandwidth and network access (maybe it's behind a NAT or something)

hnswlib is in cpp and has python bindings (you should be able to make your own for other languages). Faiss, Annoy (by Spotify) should also provide similar functionality.

https://github.com/nmslib/hnswlib

There's one, but with some limitations (For example - only vectors of up to 1024 dimensions)

https://github.com/pgvector/pgvector

If you really think that's enough to build a real product, go for it. Even open-source companies (Elastic, Mongo, Scylla) have to build tons of infra around their core codebase in order to make it an actual cloud product.

Among other things - larger caches, more instructions, more cores and more busses in between them.

I've seen similar solutions being built internally in multiple companies, none with a syntax as well thought out as this. Amazing work!

While there's probably some value in posting the resources "everyone knows", Papers with Code was submitted multiple times in the past few years, which is a pretty common HN thing (whether this behavior is desired is up to dang and the community I guess).

It seems to be happening for a pretty long time (at least the 1970s) https://en.wikipedia.org/wiki/Operation_Ivy_Bells

I remember a talk where someone who did both software and hardware development for Intel talked about "Hardware development cycle fro software developers" or something like that at some conference, and the cost of simulating CPUs or fabricating them for a round of testing was absolutly mindblowing. Also - the fact the a 1 in a billion bug will happen multiple times a second on a modern CPU.

P.S Did anyone else happen to run into this talk? I tried to find on youtube and could'nt find anything related.

Ubuntu LTS on my laptop, because it's the closest I've found to "Just Works" status. I run RHEL servers at work, but that's not my decision, though they are serious workhorses (albeit always somewhat outdated).

While there are some good recommendations here, I would defintely hire an expert (either in-house or some external contractor) to design and test the final solution.

NiFi is intended as a serious workhorse, we run it on a cluster with 256GM of RAM and over 20 cores for each server (on-prem), the 2GB of disk storage is negligible in any sort of scale (Just like the dual core/8gb machine)

From what I see in the B2B space, acquisitions are a major avenue for quick innovation. Large corporations buy smaller startup, do some integration into existing solutions and come out with a new product (If they don't just keep the new company as a separate costumer-facing identity (Look at NetApp + SolidFire, or the whole Dell-EMC conglomerate)

Quibi - they raised a billion (according to the media) before launching anything,and a video I can rotate doesn't sound like a revolutionary new form of media or art.

This is not version control using ML, but version control for ML development and research.

also flask, pretty simple and very lean.

It allows you to define a schema, and then compile it to various languages and have multiple applications in multiple languages "speak" the same class, down to the binary level (for RPC, blob storage etc).

A different network connection (With physical infrastructure you might actually use a completely different network) that you can use to move private keys or any other sensetive information without exposing it to the Internet. We use such a network to monitor all of our infrastructure, and for iLo.

Actually works pretty good for me with Firefox on Android.

Maybe it will be a Jarvis(ish) platform, with a nice addition of a functional phone? A great "personal assistant" can make a real difference between this and any of the competitors.

Command and control