News for hackers. Stuff that matters.

anon1253

anon1253 on Hacker News

Re:Prism on Wednesday January 28, 2026 @02:44AM (#46792245)
Slightly off-topic but related: currently I'm in a research environment (biomedicine) where a lot of AI is used. Sometimes well, often poorly. So as an exercise I drafted some rules and commitments about AI and research ("Research After AI: Principles for Accelerated Exploration" [1]), I took the Agile manifesto as a starting point. Anyways, this might be interesting as a perspective on the problem space as I see it.

[1] https://gist.github.com/joelkuiper/d52cc0e5ff06d12c85e492e42...

Re:Subsec fluctuations in extracellular dopamine encode prediction err... on Sunday December 10, 2023 @05:25AM (#38590603)
It always fascinated me how a lot of "state" in our neural networks is probably encoded in the extracellular fluids rather than in the neurons themselves. Biological neural networks really do not like it if you swap out their fluids (you can do this experimentally in vitro). For me it has always been one of those "nature really doesn't care about complexity" things ... it will just use whatever tools are available with little to no regard for our understanding of "boundaries". I'm not saying this complexity is strictly needed for intelligence (however that is defined) ... but I do always find it a little bit dishonest when scientists (and especially those working with pharmaceuticals) "zoom in" to the cells and then usually promptly forget that those cells are part of the much wider stage of tissues and eventually even everything outside the confines of our skin. Anyway, just my two cents.
Re:Multifaceted: The linguistic echo chambers of LLMs on Sunday December 03, 2023 @05:47AM (#38506137)
It's a fascinating topic. I've often been surprised by its use of "tapestry" (as in "the tapestry of existence") and I never really figured out why it seems to gravitate towards such a relatively uncommon phrase. As usual I am reading too much into it (seemingly the logit for "tapestry" was higher than the others), but why? And what do these preferences tell us about the LLMs more generally? Anyway, fascinating!
Re:Ask HN: What are some unpopular technologies you wish people knew m... on Saturday December 02, 2023 @10:52AM (#38499435)
RDF and semantic web used to be my goto's for this, as I believe many of the core ideas are still valid and often overlooked and sometimes even poorly re-implemented. Which says something.

However, lately I've come to like llama.cpp and friends, yes it's not ChatGTP miracle whatever but how often do you /actually/ need that? Despite its tremendous popularity, it still seems like something more people should know about. For me, I've had great fun with running LLMs locally and experiencing their different "flavors" from a more "phenomenological" (what is it like to use them) perspective rather than a technological one.

Re:Mistral 7B Paper on ArXiv on Sunday October 15, 2023 @03:10PM (#37892473)
Code is up https://github.com/vortext/esther but it's still heavily work in progress :-)
Re:Ask HN: Show me your half baked project on Thursday October 12, 2023 @01:47PM (#37860417)
https://github.com/vortext/esther

Esther is my personal project to develop a diary app that talks back. Basically. Along the way I learned how to htmx, llama.cpp via JNA and practical experience with LLMs. I suffer from type-1 bipolar disorder with psychoses and normal life just ain't gonna happen. So unemployed, single, #nolife ... I decided to build a chat bot for myself. It's not finished the RAG stuff still needs implementing, but oh well. It's written in Clojure on GraalVM (because I wanted to try polyglot) other than that it's nothing /too/ fancy ... but it feels great having an LLM + UI you can just build the way you like it

Re:Mistral 7B Paper on ArXiv on Wednesday October 11, 2023 @02:27PM (#37848341)
Cool! And on top of that TheBloke has the quantized models of course:

https://huggingface.co/TheBloke/Mistral-7B-v0.1-GGUF

https://huggingface.co/TheBloke/Mistral-7B-OpenOrca-GGUF

https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGU...

I typically run my models with the 5_K_M or 6_K quantization, but it really depends on the use case and requirements

Re:Mistral 7B Paper on ArXiv on Wednesday October 11, 2023 @02:12PM (#37848135)
Probably soon! I'll post it here. Still finalizing some Retrieval Augmented Generation things. It's written in Clojure with a very thin HTMX front-end. However there are some interesting things like using gbnf grammar constraints creatively for chain-of-thought reasoning. It's a one-person job though but I've always wanted a diary that feels like someone to talk to, and the tech is finally here!
Re:Mistral 7B Paper on ArXiv on Wednesday October 11, 2023 @01:59PM (#37847954)
I typically write them myself in the form of a "you are-such-and-so, your role is this-and-that. As such-and-so you have the following traits..." and so on. Sometimes I let some other AI rewrite it. There's very little method or science to it for me: if it feel right, it's right. Typically I find the first few chat-lines of the prompt (i.e. the chat history in the context) to be much more decisive to the conversation flow than the actual prompt itself. But it's all just "prompt" of course. My biggest realization in making the things go was "it's just a wall of text, the chat bits are just a thin facade". Write the prompt the way you want the text to continue, basically. It's a fancy Eliza. The folks over at https://www.reddit.com/r/LocalLLaMA/ sometimes share their (sometimes NSFW) prompts as well though. Right now I'm working on a minimalist interactive journaling app (a diary that talks back), and it's been a lot of fun to do and learn
Re:Mistral 7B Paper on ArXiv on Wednesday October 11, 2023 @01:19PM (#37847348)
I'll give those a shot as well, thanks! It's a tricky balance sometimes between "I should actually finish building the thing I am trying to build" and "ooooh shiny new model to try for a bit...", however.
Re:Bad Emacs Defaults on Wednesday October 11, 2023 @12:03PM (#37846242)
Being one of those people that still recommends Emacs and have sunk countless hours in my personal dotfiles: I kinda enjoy doing it, that's why I am doing it. It feels great having a configuration so tailored to me personally that it almost feels like clothing or other lifestyle choices. I mean sure, clothes, makeup, cars and whatever are all also huge wastes of time and resources in our short and mostly dreadful lives, but at least Emacs still brings me joy :-)
Re:Mistral 7B Paper on ArXiv on Wednesday October 11, 2023 @11:51AM (#37846063)
It works really really well for chatbots and roleplay applications (at least for me). The fine-tune on the instruct version is rather meh however, and I recommend https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca/ if you plan on using it out-of-the-box. Take note of the prompt template, you'll get really undesired results otherwise (basically just garbage). I've been running it on my pet projects with llama.cpp and the inference is blazing fast even with my mediocre 2080 Super
Re:JEP Draft: Prepare to Restrict the Use of JNI on Wednesday September 20, 2023 @02:18PM (#37587783)
Wow coffi was just the thing I was looking for. I've been struggling with Clojure native interop for a while. Right now I am using https://github.com/phronmophobic/clong which comes with its own set of challenges
Re:Memory loss: Expert advice for improving memory and concentration on Friday January 13, 2023 @08:10AM (#34367180)
I'm guessing auto correct for "by heart"
Re:Vald: A Highly Scalable Distributed Vector Search Engine on Friday April 09, 2021 @01:52AM (#26747127)
There was a similar situation in a project I worked on, at the time FAISS/Annoy/SPTAG were considered but we were really looking for something more managed, think ElasticSearch rather than Lucene. As luck would have it we stumbled upon https://www.milvus.io/ and it certainly checks a lot of boxes. But I'm rather excited to see some competition in this space, it's a broadly applicable trick so I'll definitely take a look at Vald next time it comes up as well!

Older »