News for hackers. Stuff that matters.

iAkashPaul

Re:No GPS required: our app can now locate underground trains on Wednesday November 13, 2024 @07:11AM (#42125374)
Could be that or an RNN/LSTM as well
Reversed input strings will the next Enigma
Re:More annoying macOS 15 Sequoia prompts: Bluetooth on Sunday September 29, 2024 @10:24AM (#41687624)
IMO hitting CMD+T thinking it'll open a new tab in my browser but it opens the font window (from Mail) is a user-crime.
Re:The Cheating Device (ChatGPT on a TI-84) [video] on Thursday September 19, 2024 @01:37PM (#41594277)
A USB MITM board with ESP32 could just connect to your phone & do one-way code/content creation for otherwise software locked devices.
Re:Set Up a $4/Mo Hetzner VM to Skip the Serverless Tax on Monday September 02, 2024 @01:48AM (#41422925)
Scaling/cold-boot time is the real concern IMO no the cost
Pretty sure this was never questioned for batched requests, sg-lang/lmdeploy/tensorRT-LLM will have nearly twice as reported speeds with INT8 (fp16 A100 benched here https://github.com/sgl-project/sglang?tab=readme-ov-file#ben...)
Re:Ask HN: Visualize Software Architecture/Concepts on Monday August 12, 2024 @02:43AM (#41221738)
Apart from draw.io I like to use isoflow.io for near isometric diagrams with directional flows as well
Re:Show HN: Pie Menu – a radial menu for macOS on Monday August 05, 2024 @03:11PM (#41164407)
Hey Marius, cool project! Would this work with just the middle mouse button click too?
Re:Taking command of the Context Menu in macOS on Wednesday July 31, 2024 @06:55AM (#41118008)
More than this pressing spacebar should have gotten some customisation by now, eg. certain mp4s/markdowns/any other file-extension for quick previews
Re:Intel N100 Radxa X4 First Thoughts on Sunday July 28, 2024 @07:23AM (#41092512)
Can't wait to get this & have TrueNAS+Jellyfin up & running on it, certainly beats having to buy so many addons for the Pi & still not have a super reliable build.
Re:Ask HN: How is your organization using LLMs? on Friday July 26, 2024 @03:59AM (#41076711)
Where did you find OpenAI in my reply?
Thx will check it out
Re:Solving the out-of-context chunk problem for RAG on Thursday July 25, 2024 @01:53AM (#41065127)
One quick way to improve results greatly is to ask questions with 2/3 chunks & in the lookup for these chunks mention the IDs of the other chunks, qdrant allows for easy metadata addition. So just generate a synthetic question bank & then do vSearch against the same instead of hoping for the chunks to match up with user questions.
What I wished browsers on Android would do is scroll pages with volume buttons and close pages on double tap or some combination similar to screenshot ring.
Re:Ask HN: How is your organization using LLMs? on Friday July 19, 2024 @10:56AM (#41007173)
Mostly Mistral/Mixtral models in addition to Whisper.
Re:Ask HN: How is your organization using LLMs? on Friday July 19, 2024 @04:41AM (#41003645)
Heavily,

Call summarisation at scale, for further insights of key topics/sentiments for diarized & fused channel call data

Lead mining quality improvement by asking questions instead of merely classification

Internal simple RAG chatbot across ~1000 PDFs, not yet down the GraphRAG route

Better chatbot experience over RASA

Contract mining for speeding up mundane governance tasks

Nice, I'll bench server.cpp as well
How long until someone makes a harvested Apple Silicon logic board work with this!
Re:Every Way to Get Structured Output from LLMs on Tuesday June 18, 2024 @04:05AM (#40715243)
My point exactly, lot of brigading on this thread
Re:Every Way to Get Structured Output from LLMs on Tuesday June 18, 2024 @03:43AM (#40715098)
JM2C

1. Langchain not being used in production?

> How out of touch is that remark? Hard pressed to find agentic framework implementation outside of Langchain/Llamaindex.

2. Outlines is not expected to work with OpenAI API because it wasn't created to do that.

I remember watching Andy Barry/MIT demo of Pushbroom stereo approach on a flying -wing drone, it used stereo 120FPS cameras to dodge trees & branches. It's almost a decade later now & such hardware is still not cheaply available for Pis/SBCs.
Re:Japan enacts law to curb Apple, Google's app dominance on Thursday June 13, 2024 @06:58AM (#40668065)
Should have emboldened the ecosystem by providing incentives for web-based government services instead of forcing users to only depend on two primary entities in this space.
INT8/FP8 benchmarks would've been great, both cards could have loaded them with around 60GB VRAM instead of TP=2 on H100.
Not being able to renew domains beyond 10yrs could also be a factor
Re:MicroSD cards' SBC days are numbered on Thursday May 16, 2024 @10:35AM (#40378988)
Yeah heard about these in the latest Geerling video
Re:Project Gameface Launches on Android on Thursday May 16, 2024 @06:11AM (#40376737)
Off the bat I can see on-device assistants be more capable & allow customized handsfree browser/PDF interaction
Re:MicroSD cards' SBC days are numbered on Wednesday May 15, 2024 @03:26AM (#40364058)
Samsung & Transcend SD/mSD have always errored/failed on me with power outages on Pi without additional power management hardware & software.

Having push to eject NVMEs brings forth a future where you can swap out LLMs/brains in K2SO type droid

Re:Apple to Power AI Features with M2 Ultra Servers on Friday May 10, 2024 @10:49AM (#40319722)
Summarisation & SDXL run just fine on M1 & above Macs. Probably the video editing features like Google/Pixel might need cloud compute.
Re:Model Spec on Wednesday May 08, 2024 @02:25PM (#40301380)
Right-clicking to inspect element ain't gonna make it

Older »