News for hackers. Stuff that matters.

instance

Re:How to run Llama 13B with a 6GB graphics card on Sunday May 14, 2023 @01:35PM (#35939678)
For instance used it in conjunction with llama-index for knowledge management. Created an index for a whole confluence/jira of a mid-sized company, got good results with GPT, but for LLaMA of this size that use case was too much.
Re:How to run Llama 13B with a 6GB graphics card on Sunday May 14, 2023 @10:16AM (#35938173)
I tested on a serious use case and quality was subpar. For real use cases I had to either host the most powerful model you can get (e.g. LLaMA-65B or so) on a cloud machine, which again costs too much (you'll be paying like 500-1000 USD per month), or just go straight for GPT-3.5 on OpenAI. The latter economically makes most sense.
Re:Delimiters won’t save you from prompt injection on Saturday May 13, 2023 @02:07PM (#35930986)
yea, you're right. It's really pre-MVP. Basically an API in between your user facing input and OpenAI that detects prompt injections and flags them for you so you can abort sending to OpenAI.
Re:Delimiters won’t save you from prompt injection on Saturday May 13, 2023 @04:44AM (#35926711)
I've put up something like this as a side project a few weeks ago: https://flamingoo.ai/

Love the term "PAF", I think I'll include this.

7B is the number of parameters of the model.
Re:Steve Jobs Said the Best Managers Never Want to Be Managers on Saturday December 03, 2022 @08:40AM (#33843377)
I know an amazing IC at a software company I once worked at that I still keep in touch with. He has extremely deep technical knowledge, which you can simply deduct from basically everyone in the company (even from other teams) coming to him for advice. He's been at the company for >10 years.

He has strong opinions on current processes and just getting things done.

This post resonated deeply with me, since I've discussed before with him his role and how it could evolve. I know for a fact that he dislikes lots of meeting and really likes working on the core product, and so far hasn't really jumped on the opportunity to go into management - he doesn't really want to be manager. So he is kind of exactly the guy the post is describing. The company is growing though and he is very slowly getting pushed by the head of development into a more managerial role..

Let's see how it works out. I believe he is going to be a great manager though.

Ask HN: PayPal 2-factor utterly broken?

Is it just me?I just lost our paypal account for my company just by deleting an old phone number in the settings and adding a new one. After logging out there is no way to log back in, they refer me to their hotline.A similar thing happened years ago when they introduced 2-factor, I never got that account back since I simply couldn't get through on their hotline. I had a private account with an...

( Read More... | 2 comments | on HN )
Re:Are You Ready for the Internet? (1994) [video] on Friday September 23, 2022 @08:17AM (#32950892)
Check it out: https://www.bmvi.de/EN/Home/home.html

"Federal Ministry for Digital and Transport"

Re:Uber’s Still Not Profitable on Sunday September 04, 2022 @07:32AM (#32711933)
To add to this, as a German, the future of Uber does not look great in Europe as well. The taxi lobby is strong here, and I’m sure regulations will come in countries like Germany and will affect negatively their business. And they're starting to face stronger competition from other companies like Bolt.
I've been collecting these for the past year - there is a large body of research going into solving optimization problems using quantum computing, and some interesting POC results coming out using the latest machines.
Re:Shaquille Zuckerberg on Saturday May 14, 2022 @04:47PM (#31382202)
Yea, that title is quite something. I thought this was some long lost brother or sister of Mark that has now appeared.
Re:On $600B of Y Combinator startup success on Wednesday May 11, 2022 @01:02PM (#31342747)
I wouldn't say that's a YC-specific issue. Look at Nasdaq, this is a general issue with tech stocks right now, just this immense selling all across the board.
Re:Ask HN: Share your personal site on Thursday April 07, 2022 @05:10AM (#30942278)
https://blog.xa0.de/list

My basic blog where I talk about Quantum Computing, Machine Learning, Finance, Business.

Re:If it were my home on Sunday January 30, 2022 @10:15AM (#30137860)
Putting things in relative like that (e.g. 30% more likely to be murdered) always feels like much - in reality, one doesn't know the variance. This is just putting the averages of two datasets in relation. If both have a very wide confidence interval, 30% suddenly loses meaning to me..

Ask HN: Getting deranked in Google due to a link list?

Two months ago I posted a list of 61 QUBO formulations and cited every single one (which resulted in 33 links to papers) [0]. After seeing this post get crawled by Google, my traffic dropped permanently by more than 50%. It has also stopped growing (which it did before). Of course, afterwards I noticed my mistake (I suppose Google thought I had become somewhat of a 'link spamming' site?!)....

( Read More... | 2 comments | 3 points | on HN )
Re:Show HN: Alerts for any kind of financial event on Sunday July 18, 2021 @03:48AM (#27871406)
Hello HN! This is a SaaS I've built the last few months using Flask and the least amount of JS that is possible.

It allows setting up SMS/E-Mail/App alerts for stocks, options and crypto, and in the future also bonds and macroeconomic events. There are lots of KPIs (just for example: earnings growth Q/Q, price, volume, the option greeks, etc).

For stocks the main data source right now is Yahoo Finance, but at some point I'd like to move to a better one (but more costly one).

Re:CVE-2021-22555: Turning \x00\x00 into 10000$ on Thursday July 15, 2021 @05:35AM (#27842909)
Is it just me, or is this is super similar to Dirty Cow [0] in terms of severity? Insane find!!

[0]: https://en.wikipedia.org/wiki/Dirty_COW

Re:Show HN: Unlimited, free intraday stock data API on Saturday July 10, 2021 @02:37AM (#27791593)
Since there are quality differences between data providers, it would be good to know where you source the data from. Is it from Yahoo Finance (just for example)? Or is it really directly from Nasdaq (which I presume would be pretty costly, and thus raises the question on how long you'll be able to run this service for free before shutting down or having to raise prices).

This is important since if someone decides to fully build on top of your API, they don't want the service to be gone in a few months and waste all the time integrating with yours.

Re:Show HN: Unlimited, free intraday stock data API on Saturday July 10, 2021 @02:34AM (#27791576)
The prices don't seem up to date.. Check $FB for instance, shows 349.27, when in reality it closed at 350.42.
Re:Audi will halt new gas and diesel cars by 2026 on Saturday June 19, 2021 @02:40PM (#27563133)
I've checked the original source [0]: You've guessed right. They specifically said they won't be introducing/creating new gas models. Nowhere do they say that they won't sell old inventory.

[0] https://www.sueddeutsche.de/wirtschaft/audi-verbrenner-elekt...

Re:Ask HN: Tools you have made for yourself? on Saturday June 12, 2021 @01:44PM (#27486123)
I was annoyed by the seemingly over-engineered tools for screen tracking, so I wrote one myself in ~50 LOC, which simply uses ffmpeg to create a screenshot every X seconds in a very low resolution:

https://github.com/instance01/mac-screenshot-tracker

It's super hackable and gets the job done.

Re:Burnout from an Organizational Perspective on Saturday June 12, 2021 @01:41PM (#27486096)
A very good point. Having the freedom to quit at any time without completely jeopardizing one's finances is liberating.
Re:IRS records reveal how the wealthiest avoid income tax on Tuesday June 08, 2021 @06:12AM (#27432686)
This would increase the cost of capital and potentially reduce investments, would it not?
Re:The Telecom Archive on Sunday June 06, 2021 @09:54AM (#27413165)
heh, found a typo on page 3 (pubic instead of public): http://www.telecomarchive.com/docs/bsp-archive/004/004-405-0...

Also interesting how some pages use a handwritten font.

Re:The NFT market bubble has popped? on Thursday June 03, 2021 @05:27AM (#27378868)
Yea, for all we know it could be a temporary correction, just to shoot up further next month. I think it's too early to speak of a 'collapse'.
Tangentially related: https://staffeng.com/

Really awesome resource that acts as a guide to reach Staff Engineer.

Older »