News for hackers. Stuff that matters.

4k

Ask HN: You have 50k USD and want build an inference rig without GPUs. How?

This is more like a thought experiment and I am hoping to learn the other developments in the LLM inference space that are not strictly GPUs.Conditions:1. You want a solution for LLM inference and LLM inference only. You don't care about any other general or special purpose computing2. The solution can use any kind of hardware you want3. Your only goal is to maximize the (inference speed) X...

( Read More... | 1 comment | 3 points | on HN )

The state of "super fast inference" is frustrating

I am talking about the 3 providers I know of which claim super fast inference: Groq, Cerebras and Sambanova. Every one of those claim extremely fast multi hundred tokens per second inference speeds on reasonably large models. Every one of those also have a chat demo on their website which seems to confirm their proposed numbersHowever, for many months now, each of those providers have literally...

( Read More... | 1 comment | on HN )

Ask HN: Is it feasible to have just a REST API as a back end for web app?

Read about this approach at a few places: Have only a REST API as a backend and do everything else in the frontend JS framework.I don't know enough about web architectures to evaluate this approach. Is it possible to develop a site/app with this approach regardless of complexity of the app, or is this only suitable for certain scenarios?Any help would be greatly appreciated.

( Read More... | 3 comments | 2 points | on HN )

Ask HN: What is the “modern approach” to web/app development?

I am a backend dev and know little of web dev.Assuming you are designing a web app, and corresponding mobile apps in 2018 from scratch, how would you go about structuring it? What would be the best practices? What tools you'd choose?Since it's hard to discuss it without a concrete example, let's say you're designing a Quora or a microblogging site.P.S. I am personally fond of golang.

( Read More... | 2 comments | 2 points | on HN )
I don't know of any, but seems like a great app idea. People are often looking for best <insert-food-name> in the area as opposed to "best restaurant in the area".
A friend's friend. Working in Amazon for 15-16 years (still not manager). His stock would easily make him a millionaire. He puts minimal effort just enough not to get fired, doesn't care about promotions, works 6-7 hour days and has a good life. My friend asked him why doesn't he quit? He said this job gives him something to do.
Iirc, staff SWE is Google's equivalent of Principal Engineer.
Others here would be in far better position to advice you, but from what I can say, having an awesome github portfolio will go a long way to compensate for the other handicaps you mentioned.

Once you are there, I'd say the best way would be to find someone in your network who works at google, and get referred. If you don't know anyone, make contacts through various channels.

European tech salaries are famously lower than US salaries.

Southern Europe is even worse. I was offered a role of Senior/Lead engineer (with over 10 years exp) for "maximum salary of 45k Euro". And was told by their recruiter that this is considered high for Spain.

I don't know, information shared in a comment has more authenticity and can encompass more info (such as other types of comps/benefits) than spreadsheet/form.

And Ireland. :)

I have. Like I said in the other comment, glassdoor (and similar sites) lump together salaries that were collected for as long as the site exists, while in reality the salaries have changed a lot over last 10 years.

I respect your decision not wanting to discuss your salary publicly. May I suggest a throwaway? :)

There is one major problem with glassdoor - the salaries that are collected today are grouped together with salaries that were collected 7 years ago. Which is why you always see lower salaries looking at the glassdoor.

This post is to get a (however small) current sample and it is purely to help me evaluate a couple of opportunities, no commercial interest whatsoever.

Ask HN: Recommend a command line tool to generate neat-looking graphs/charts?

I have used gnuplot for basic tasks in the past. This time I am trying to generate graphs that'll be sent to the customers and it's important that they look neat and aesthetically pleasant.Spent last 3 hours on different ways to do that. Checked out some scripts etc to make gnuplot output nicer looking, but it just doesn't seem to compare with the output of some of the js libraries (D3/charts)....

( Read More... | 1 comment | 2 points | on HN )
Re:Physicists Detect Gravitational Waves, Proving Einstein Right on Thursday February 11, 2016 @11:44AM (#11081234)
I have a question: what does this mean for theoretical physics? (except for Einstein was right) Does it settle any major debates? Does it make any competing theory more or less likely?

Sorry I am not vary knowledgeable on the topic.

Re:What I learnt from being sexually harassed at Google on Tuesday January 19, 2016 @09:29AM (#10930923)
> but the fact that he stubbornly continued them for few days without noticing that the girl is completely turned off and freaked out by him.

She says she laughed at the sexual comments made by her manager.

> I remember thinking to myself, “Did I do something to encourage this kind of behaviour?” I had uncomfortably laughed at some of the sexual comments my manager had made because I didn’t know how else to react as a junior member of the team. Should I not have done that?

Re:What I learnt from being sexually harassed at Google on Tuesday January 19, 2016 @09:24AM (#10930896)
To be fair, in the write-up, she says she laughed at the sexual comments made by her manager.

>I remember thinking to myself, “Did I do something to encourage this kind of behaviour?” I had uncomfortably laughed at some of the sexual comments my manager had made because I didn’t know how else to react as a junior member of the team. Should I not have done that?

And the facts about her 'harassment' are covered in one sentence in the whole article.

> In that week, I was kissed on the cheek, asked to sit on my manager’s lap, told about my manager’s sex life and virility, and told that “all men go through an Asian fetish at some time,”

She doesn't provide any context and keeps it as vague as possible. If you think about it, all/most of those things could have been light jokes that weren't specifically targeted to her. And I am certainly not defending her manager, but I still maintain that she did use this situation to her advantage. Getting a promotion, writing about it several years later in an attempt to promote her current startup.

Re:What I learnt from being sexually harassed at Google on Tuesday January 19, 2016 @08:51AM (#10930695)
I am member of a minority, and have had more than one chance to go to the HR to report "being racially abused" and present the narrative in such a way that anyone would be convinced it was horrible.

Firstly, what happened to her is definitely misconduct, but not sexual harassment. I get the impression that the "victim" here is trying to take advantage of the situation. She never asks the inappropriate person to stop here, instead goes to HR. I mean just in plain words "Please don't, this is inappropriate." would stop most such behavior from happening again in huge majority of cases.

> During the HR investigation that ensued, I remember being shamed by a female colleague who thought I was blowing the situation out of proportion. She thought I was being overly sensitive, and that it was wrong of me to report my manager. That hurt. I thought she would’ve naturally supported me.

"Being shamed"? What if that female colleague honestly thought that she was blowing the situation out of proportion? A mere disagreement is shaming? Just because someone thinks they are 'sexually harassed' doesn't make them right automatically. I mean is there any scenario where someone claiming they are harassed could be on the wrong side of the things (or blowing things out of proportion)? It seems the SF/valley area atleast is too politically correct to even entertain the possibility that the female could possibly be wrong or making a mistake. Anyone that doesn't agree with a narrow notion of SJW equality is literally the devil. And this sort of trend has made 'being victim' a somewhat coveted status that can be used for gaining publicity/career advances.

Re:ARMv7 dedicated servers for 3.40 per month on Thursday September 03, 2015 @07:11AM (#10164265)
But what about bandwidth? That's still shared among all the users, right?

And given that they are even advertising 'Seedboxes' and VPN servers [0] hosted in the same network, it makes me doubt the quality of network even more.

[0] https://blog.scaleway.com/2015/09/02/we-are-slashing-the-c1-...

Re:Ask HN: Who is hiring? (July 2015) on Wednesday July 01, 2015 @12:30PM (#9813096)
Do you hire engineers from Europe?
Re:Introducing Preemptible VMs on Monday May 18, 2015 @10:17AM (#9564551)
I might be missing something important here. But according to their pricing page[1], a preemtible VM with 30GB memory costs $86.4 a month.

Why would someone go for this when cheap dedicated host providers like hetzner etc offer powerful dedicated servers with 64GB memory and multicore server grade CPUs? The comparison only gets worse taking into account that Google's offering is preemptible and can shutdown and come up as they wish.

[1]: https://cloud.google.com/compute/#pricing (0.12x24x30)

Re:Telegram Hits 2B Messages Sent Daily on Wednesday May 13, 2015 @10:09AM (#9539009)
I am really happy to see Telegram growing. I am one of those people who deleted Whatsapp (and lost touch with 30-40 people and several groups) when Facebook bought it.

So far I have been happy with it, even though only like 5 of my friends use it. Yeah, it may (or may not) have security flaws like many on HN complain, but I would take it anyday over FB owned give-us-all-your-data product.

Re:Ask HN: Would you pay for a personal email server? on Tuesday May 05, 2015 @12:19PM (#9493315)
To further clarify, the service aimed at users who like their privacy but do not have enough time or skill to maintain their own server, neither have IT team at their disposal.
Re:Ask HN: Would you pay for a personal email server? on Tuesday May 05, 2015 @12:17PM (#9493309)
Thanks for the feedback, that was helpful. :)

Ask HN: Would you pay for a personal email server?

I am trying to validate if hosting people's personal email servers would be a viable business.In short, you just buy a domain and point it to the service's name server. Everything else is taken care of including updates etc. What you get is your private email server, not a mailbox on a server, but a server that's 100% yours. Would you pay for something like this?

( Read More... | 5 comments | 2 points | on HN )
Re:How one tweet wiped $8bn off Twitter's value on Wednesday April 29, 2015 @10:32AM (#9458503)
BBC is linkbaiting now?

One tweet didn't wipe $8bn off its value, the results did. If the results were released next day, it still would have lost value ffs. I feel angry reading through this and realizing it was a waste of time fluff.

Say what you will, its evident that HN crowd loves sensationalism more than content, as seen again and again.

Re:Why do pub TVs have a pint glass in the corner? on Wednesday April 22, 2015 @10:35AM (#9420701)
Simple solutions are often the best ones.

Out of curiosity, how (if at all) was that person rewarded for saving Millions for the company?

Re:Why people were enthused about GCC early on in its life on Monday February 02, 2015 @11:21AM (#8984930)
Where does the author establish that people are not enthused about gcc anymore? Or does he not even imply that?
To be honest, I am half-scared of taking equity instead of cash pay. The reason is, I don't understand it as well as I should. It always scares me to think that through some VC-magic, whatever equity I have could end up nearly worthless (possibly an irrational fear since I don't understand the whole mechanism).

Older »