Ask HN: Share your local LLM setup
I’m curious how people setup local LLM today? What type of hardware do you have? What model and software do you use for general chat (mostly for learning new subjects), coding and RAG.
I’m curious how people setup local LLM today? What type of hardware do you have? What model and software do you use for general chat (mostly for learning new subjects), coding and RAG.
I'm bootstrapping a project and looking for someone that can quickly build a CRUD iOS app using Swift, VisionKit and invoke REST APIs for backend integration. Its a basic app for a web application with the following features:
1. User Login + FaceID (no need for signup, password reset, etc)
2. CRUD operations on an item
3. Ability to take pictures and upload
4. Ability to run Vision operations like Text detection, OCR, etc on the image.
5. Upload data to backend via REST API including background upload.
6. Publish app to iOS app store
API will be provided for login and CRUD operations.
You'll be working with me (backend developer) to make it as close to production ready and publish to app store.
If you are interested please respond with rate and approximate start date and time required to build, my email in profile.
Edit: formatting
Edit: not affiliated with the company
I think something like detectron2 [1] could help. It is Apache2 license, so commercial friendly. That said the pre-trained weights may not be commercial friendly, so you’ll want to check on that.
Also fast.ai course [2] is a good starting point to understand the basics. If you are pressed for time, just go through Lesson 1.
[1] https://github.com/facebookresearch/detectron2
Edit: added fast.ai, grammar
Depending on your personality you may or may not want to setup a booth. I’m a technical founder and not comfortable approaching people, so having a booth and people wanting to find out more about my SaaS helped establish new relationships and sales.
I filed with CFPB, and situation resolved automatically in about two weeks.
I had posted a bit more here https://news.ycombinator.com/item?id=37013206
As someone else mentioned the difficult part is generating the marketing materials and the app review.
You could also try PWA https://en.m.wikipedia.org/wiki/Progressive_web_app
Edit: add PWA
Chic-filla - made an online group order for about $60, they forgot to include an item of <$10 value. Called and they gave a refund for the full order.
https://en.m.wikipedia.org/wiki/Public_safety_answering_poin...
Chase closed my account because I deposited a valid check, but chase fraud dept closed my account with close to 13k in it.
I made a lot of trips to the bank, countless hours on the phone and what I found is different departments don’t communicate or share data. Every time I call or go to the bank the first agent would say a check was mailed and I should wait for it in the mail, but wouldn’t give me an ETA. After I insist they never mailed anything, I get transferred around and finally someone says they have not received the requested document - which I had submitted in person at a local branch.
This process repeated few time and got escalated to their “executive office” twice - which restarted the process. It felt like I would never get my money and after two months found out about CFPB and filed a complaint. About 3 weeks later chase magically found all the documents and mailed a check for the balance.
I checked all - direct airlines, kayak, Google flights, etc. I had specific dates and most online quotes were between $8,000 - $12,000 for cheapest economy ticket. 8k tickets had more stops/duration.
A local travel agent found a comparable ticket with good duration and stops for $5,500 for all of us. And I paid $600 for seat selection since we were traveling with kids and didn’t want to risk sitting apart.
Unfortunately I’m sole developer and need most projects open for demo, etc.
My 2015 15" MBP is showing its age after 8 years of use (almost daily) and I'm in search of a new macbook and can anyone share their experiences with the newer M2 macs?I've narrowed it down to1. 15" M2 Macbook Air with 24GB RAM & 1 TB hard disk - $20992. 16" M2 PRO Macbook Pro with 32GB RAM & 1 TB hard disk - $30993. 16" M2 MAX Macbook Pro with 32GB RAM & 1 TB hard disk - $3249...
With AI it maybe good in macro terms but what about the folks impacted by it? Will it be possible from them to find another job without significant training/education?
Long story short, I deposited a valid check, but chase fraud dept closed my account with close to 13k in it. I made a lot of trips to the bank, countless hours on the phone and what I found is different departments don’t communicate or share data.
Every time I call or go to the bank the first agent would say a check was mailed, after I insist they never mailed anything, I get transferred to someone else that says they have not received the requested document - which I had submitted in person at a local branch. This process repeated few time and got escalated to their “executive office” twice - which restarted the process.
It felt like I would never get my money and after two months I filed a complaint at CFPB. About 3 weeks later chase magically found all the documents and issued a check for the balance.
I’m not sure what is going on at this bank but they should not be allowed to treat customers like this. Just read this from the linked news article
> Victims said Chase would not review surveillance video because the amounts were below $5,000.
Why wouldn’t chase review videos if amount is less that $5000?
Another option could be to freelance as a code reviewer, I've never tried it but it seems interesting [1]
[0] https://www.moonlightwork.com/ [1] https://app.pullrequest.com/signups/reviewer
Hardware academy is also good, where you can ask questions and meet other folks who build electronics products.
https://predictabledesigns.com/academy/
Happy to talk and give pointers, email in my profile.
Edit: I've no affiliation with hardware academy