realPtolemy
VPS well, yes - but also no, you don't rent your self in on Costcos servers. The "cloud era" arose because the cost of VPS became so much cheaper than having all servers stacked in-house, and the fact that they provide easier maintenance and off-loads various data security risks that a regular company would have difficulties to comply with. I.e. higher up-time, lower latency for customers, less data security risks, less maintenance, lower cost.
But what we see with GPUs and AI driven compute, it can effectively be done locally, at a cheaper cost depending on the quantity of compute, requires little maintenance, the output can be offloaded on a cloud hosted VPS, the customer interface can still be routed through a cloud hosted VPS, but from a data security perspective you may deem it to be less risky to run local models on local compute.
I guess you could see XAI's (XSI's?) deal with Anthropic for compute as a sort of time-sharing, but I expect us to see these kind of deals being brokered between "non-tech" companies - unless token costs fall dramatically and unless it'll be truly ensured that all token processing is conducted in fully encrypted and closed of environments that are not used for training at all.
We're currently seeing a massive compute bottleneck - GPUs are expensive to buy and people/corps want to push as many tokens as possible into various models. Hence - Timesharing: A Solution to Computer Bottlenecks https://www.youtube.com/watch?v=Q07PhW5sCEk
Perhaps OpenAI's biggest moat in the future will not be that they provide an AI model, but rather that they facilitate a time-share structure for its clients. They will still be able to provide the most cutting edge model, but companies themselves will be able to run local inference on their own compute.
I personally believe that it'll be normalized that mid-to-large size companies will build their own stack of compute for local ai model inference (some already have).
As we'll see more companies stacking hardware that isn't utilized to 100% at all times, do you believe that we'll see cross-company agreements to share this compute with other companies, for a given fee (i.e. the old school concept of time-sharing.)?
Her reason for why: Context and various slang words are grasped much quicker compared to the cumbersome process of repeating of words and phrases (She did not omit the need of the latter though).
She was great, 60 years old at the time and had us repeat the lyrics of Rammstein songs in class, her favorite band.
By reaffirming that “we don’t know how this works, nobody does” it’s easier to avoid being charged with copyright infringement from various actors/data sources that have sued them.
The only initial issue I had was that I had to configurate the broadcom WiFi driver manually. Super easy after some googling for the more technically interested person… But nothing I would expect the general person to solve without frustration.
8gb RAM, 125gb SSD. 1xBattery replacement.
It does not run IDE’s like ST32 (based on Eclipse) and OneNote via Firefox smoothly simultaneously. But everything else so far has worked flawlessly. I use it every day and have done so since the beginning of this fall.
Edit: Call me a script kid all you want, for this particular laptop it’s just more convenient for me to run Manjaro rather than Arch right of the bat. But I guess I could eventually set up a shared partition for storage and an individual partition for each OS.
Ask HN: Best bang for the buck router setup for apartment
I’m looking to buy a new router and need some help.I live in a ~60 square meter apartment which has quite thick walls, longer distances between each room and of course a neighbor in each direction.Which router setup do you, readers of HN, recommend me to look into? What should I purchase that provides best bang for the buck coverage speed and reliability?
Ask HN: Best programmable robot for kids? Christmas gift
I’m thinking about buying a programmable robot kit for my brother’s kid this Christmas. There seem to be a couple of alternatives out there, but it shouldn’t be too complex (target age = approximately 8 years old).Which kits do you, the readers of HN recommend?
But I wish that I was able to ”drag and open in new window” tabs of different opened PDF files.
But I must say that skim for Mac is the best!
Medical secrecy, processes and laws have indeed prevented SOME things, but a lot of things have gotten significantly better due to enhanced statistical models that have been implemented and widely used in real life scenarios.
AMD, Intel, Nvidia, ARM and their partners
I’m curious about what the HN community’s thoughts are on the current state of partnerships between semiconductor/processing units-manufacturers and software/electronics manufacturers.To me it feels like Apple and Google have tied up ARM almost entirely to themselves (just a matter of time until Apple also will cut Qualcomm completely). ARM seems to fulfill each of their custom needs.As a...
I’ve had it bookmarked for a couple of years. Worth visiting twice or trice a year, or even more frequently.
You get what you decide to follow.
Mostly he and the host were chatting about AI responsibility (seem to be their current campaign atm).
Will see Sundar speak today – If Q&A, what should I ask him?
Going to attend a lunch 'fireside chat' at my university today where Sundar Pichai will talk about AI innovation.If there's a Q&A, what should I ask him?One topic that's on my mind is how he sees the recent advancements in AI increase the need for companies to develop custom silicon, and if he believes a result of this will be an increased demand for hardware engineers in...