News for hackers. Stuff that matters.

pajeets

wait this is crazy

what model can i run on 1TB and how many tokens per second ?

for instance Nvidia Nemotron Llama 3.1 quantized at what speed ? ill get a GPU too but not sure how much VRAM I need for the best value for your buck

gonna need quantum computing once you breach in to the mid 20s
need a 3090 at least for that
so 4 vCPU per customer + 40gigs of RAM ?

Ask HN: I have 24 core server with 1TB of DDR4 RAM, what should I run?

First time I'm doing colocation and as experiment I picked up a 1TB DDR4 RAM server with 24 cores (around 2.2ghz each)What should I do now? What stuff should I run?I have a hello world Flask app running but obviously its not enough to use the full potential.I'm thinking of running KVM and selling a few VDS to friends or companies.Also thought of running thousands of Selenium browser tests but I...

( Read More... | 38 comments | 5 points | on HN )
Re:Command AI Bought by Amplitude on Tuesday October 15, 2024 @04:44PM (#41852902)
but SQL isn't a blackbox and is a declarative language with a strict syntax

Piggybacking on OpenAI or any GPT is not at all the same as SQL

Re:Ask HN: Colocate or Buy VPS/VDS? on Tuesday October 15, 2024 @02:07PM (#41851290)
main appeal is the large amount of RAM and cores

VDS seems to go up in cost when you go beyond 32GB with a decent CPU

amen to the depreciation but methinks 7950x + 512gb of DDR5 RAM should be fairly future proof no ?

Re:Command AI Bought by Amplitude on Tuesday October 15, 2024 @01:50PM (#41851100)
literally 90% of AI startups right now are some combination of the above and their "edge" is just a long system prompt that tells them to "be this niche and output response that mimics an expert from that niche"

This was never going to work out because OpenAI is literally watching everybody and how they are using it including prompts. AI wrapper startups serve these functions:

- wrappers prop up NVIDIA which are owned by the people giving VCs the money to invest in wrappers who are long Nvidia too.

- wrappers give OpenAI RSU holders a fuzzy warm feeling and they are able to see what the market is doing with their product so they can pull "Amazon Basics"

- IRS, attorneys, accountants, politicians love them all because they all get to squeeze milk from the fume

Ask HN: Colocate or Buy VPS/VDS?

I'm looking at purchasing a server with 512gb of ram and then colocating it but dont have any experience but the appeal is buying a lump sump initially to acquire the hardware specs I want and then colocating it at a fixed cost $50~100/monthIf I were to buy the same spec it would cost $200~300/month foreverDoes it make sense to buy my own server and colocate? What are the 1U rack fees now in...

( Read More... | 2 comments | 2 points | on HN )
Re:Command AI Bought by Amplitude on Tuesday October 15, 2024 @01:23PM (#41850836)
> you can bet this isn't the exit most parties wished for. Although by this stage the founder(s) is probably happy to find a buyer who will retain their team.

I've seen a startup that was bootstrapped 10 years ago but took on too much money and ended up getting acquired for "undisclosed sum" but at the same time everybody knew the investors were just recouping their money while founders got nothing (they had sold their equity for raising more money as their costs were way up but nobody was buying their product). Cue local news reporters don't know the nuances so they'll just announce "Startup X acquired by Y, wow!"

Founders place a lot of emphasis on getting "acquired" but there is roughly 95% chance of you selling at breakeven where the terms leave you with a year's worth of salary as a junior SWE

Get ready to see a lot more of these "acquired" news coming out in the near future. something around less than 1% chance of getting more money than you put in.

Startup has horrible odds especially if you are building a simple GPT wrappers

wonder how this works with Pocketbase
Re:FLUX is fast and it's open source on Sunday October 13, 2024 @02:49PM (#41830497)
just tried it out and it struggled with the bubble caption and adopting other drawing styles but oh god yes this is awesome because an image like this would take forever for me to do and if even arranging someone to commission it is expensive

starving artists are going to famish now, not sure how to feel about it

Re:FLUX is fast and it's open source on Sunday October 13, 2024 @02:38PM (#41830391)
wait you think these images are pornographic?
Re:FLUX is fast and it's open source on Sunday October 13, 2024 @03:29AM (#41825941)
I experienced the same thing, it was so weird i got good results in the beginning and then it "craps out"

dont know why all the critical comments about flux are being downvoted or flag sure is weird

Re:Using drones to terrorize a city [video] on Sunday October 13, 2024 @03:25AM (#41825918)
you think Russia is the only one doing this ??!!
Re:Using drones to terrorize a city [video] on Sunday October 13, 2024 @03:25AM (#41825916)
sure there were incidents like this on both sides but nothing whats unfolding today
Re:FLUX is fast and it's open source on Sunday October 13, 2024 @03:19AM (#41825886)
never used midjourney because it had that signature look and bad with hands, feet, letters

crazy not even a year has past since Emad's downfall a local open source and superior model drops

which just shows how little moat these companies have and are just lighting cash on fire which we benefit from

Re:FLUX is fast and it's open source on Sunday October 13, 2024 @03:12AM (#41825859)
Dont care about artists opinion on rest of using AI tools instead of not paying them because I couldnt and wouldnt so theres no demand in the first place.

All I wanna know is the prompt that was used to generate the art speaking of which i wanna know how to create cartoony images like that OP

meh im not convinced that any sort of framework or side tool that works on top of large language models is the solution

we really need something intelligent (no, o1 doesn't count) and its unclear what that will look like. Perhaps it will be some RNN with neurosymbolism

Re:Using drones to terrorize a city [video] on Saturday October 12, 2024 @07:55PM (#41823863)
also relevant: "history is written by the victor" is especially relevant in understanding the Israeli/Palestine crisis.

In the Palestine Mandate, Jews and Palestinians got along just fine. That all changed once the ideology that the land belonged to Jews began to make rounds following the conclusion of WW2 and awful events like Holocaust gave rise.

It would've been fine if the creation of Israel happened peacefully but its egregiously ignorant to assume the other co-habitants who assumed control much of the land previously would excuse themselves especially when the earliest attempts were violent. It's not clear who fired the first shot in the Palestine/Israeli conflict but its important that those who write the history are essentially the voice of those that won WW2.

Had Hitler won WW2, we would absolutely learn how bad one group was and why their extermination was justified. Then as economic prosperity set in, and wealth gap begins to naturally arise as well as freedom of expression, egalitarian ideology quickly spreads. Today's generation that argues that all humans are born equal and a blank slate would be defined as extremist ideology and a President who promotes that belief would be labelled a bigot, racist, and smeared 24/7 by the establishment that descended from the winning ideology.

Eventually the political spectrum shifts back to the center violently and proliferation of information via various technological mediums takes foothold, the waters become murkier and the victor's version of history begins to become shaky until it feels threatened enough to launch a purge of its ideology once and for all and those that resist it to become embroiled in a prolonged civil conflict.

This gives rise to a future where reality is so remarkably different than what we have, rather people hold a Bayesian model of reality one which is measured by statistics backed by groups of facts from both sides of the political fence. This ultimately results in a much more peaceful and less quarrelsome society one which can finally give path to true enlightenment, raising of the collective human consciousness so that we become interstellar species exactly like what we were supposed to do.

That is the "digital media & software is a rivalrous good therefore not paying for it is stealing" argument that copyright lobbyists have preached to Americans since the "You wouldn't download a car" campaign in the early 2000s
I must respectfully disagree with your assertion. The non-rivalrous nature of software, as established in numerous legal precedents (see Sony Corp. v. Universal City Studios, 464 U.S. 417 (1984) and Vernor v. Autodesk, Inc., 621 F.3d 1102 (9th Cir. 2010)), fundamentally alters the traditional concept of ownership in the digital realm.

While your preference for physical media is duly noted, it fails to account for the evolving landscape of digital rights management (DRM) and end-user license agreements (EULAs). The legal framework surrounding digital distribution platforms like Steam is predicated on a licensing model, not a transfer of ownership per se.

Your concern about account lockouts, while not entirely unfounded, overlooks the myriad benefits of digital distribution, including but not limited to: reduced environmental impact, instant access, automatic updates, and cloud saves. Furthermore, it disregards the legal protections afforded to consumers under various jurisdictions' consumer protection laws.

In conclusion, while your nostalgia for physical media is understandable, it does not negate the legal and practical realities of modern software distribution. The non-rivalrous nature of software necessitates a different paradigm of ownership and access, one that the current legal and technological frameworks are still grappling with.

Non-rivalrous means that a good can be used by multiple people at the same time without reducing the amount available to others. By nature, digital licenses are non-rivalrous.

This means it can be used by multiple people at the same time without diminishing their quality or quantity. For example, a fireworks display is non-rivalrous because everyone can enjoy it without affecting the quality of the show. Likewise, software can be enjoyed by everyone without affecting the quality of the life of the producer or its content and there is no indication that piracy can limit the latter and former.

if buying isn't owning then pirating isn't stealing
honestly the "start your own business" trope is irresponsibly bad advice:

- people seeking jobs often dont have disposable income especially those fresh out of school or minimal YOE

- tremendous time and energy for a low probability outcome

- many do not have the aptitude for running a business which require a high degree of planning and execution, soft skills

I know this is a startup focused website so its natural to suggest go out and build an app or raise money but the selection/survival bias is often not considered.

The vast majority of people will either need to switch careers or industries altogether. The fact is LLM code generation has eaten those junior/intermediate roles and soon the same will happen to senior developers as well.

What we are seeing is the same thing blue collar jobs experienced in the 90s where their jobs were outsourced/automated to labour markets in authoritarian countries except this time its outsourcing to a small group of corporations.

Re:Using drones to terrorize a city [video] on Saturday October 12, 2024 @05:09PM (#41822621)
The clearest example of terrorism is sabotaging a supply chain, booby trapping consumer devices and not caring because war?

OR building a neural network to target civilians indiscriminately based on the same egregious moral high ground?

Do Americans truly wish to put themselves in harm's way to support terrorism for some religious/ideological cause the same way the other uses terrorism for the exact reasons?

When do we stop and say enough is enough, America is for Americans and American interests only? Where do we draw the line?

Re:Using drones to terrorize a city [video] on Saturday October 12, 2024 @05:04PM (#41822560)
I don't know who said this quote but "one man's terrorist is another man's freedom fighter" also rings true
Re:Using drones to terrorize a city [video] on Saturday October 12, 2024 @05:02PM (#41822545)
When we do it, its "precision strike" or "human shield penetration".

When the other side does, its "terrorism" no matter how small.

Terror, violence will never stop more bloodshed, you might get the upper hand today but you are borrowing from the future generation's peace.

If a region constantly requires tremendous human sacrifice to exist and constantly at the mercy of spun narratives, should it exist in the first place?

If a region constantly uses terror tactics while calling others terrorist, isn't it a sponsor of terrorism?

Re:In Defense of LeetCode Interviews on Saturday October 12, 2024 @12:44AM (#41816474)
my retort to this article is this simple question: if you can look things up in an encyclopedia, why are you forced to recite it?

if even low parameter LLM can solve most of these leetcode examples that cost nothing to run, why are we using it to discriminate applicants to measure "how badly do you want the $250k/year"

It's almost like the people hiring are optimizing for masochists and there lies the devil, you want hyper-rationality because they are the easiest people to manipulate and brainwash.

Highly sensitive and type B personality aren't going to sit around and let them trade their life to destroy or trap large number of the population with addictive algorithms or drone target selection.

Matter of fact IQ was invented specifically to filter out the most programmable minds, you wouldn't be able to run a country's intelligence agency without being able to brainwash people or a corporation. The promoters at the helms are usually the exact opposite of the producers, unwavering, unforgiving, uncompromising.

Older »