FezzikTheGiant
FezzikTheGiant on Hacker News
Posted by
FezzikTheGiant on Friday August 22, 2025 @03:28PM
from the show-hn dept.
https://chromewebstore.google.com/detail/unbreakable/npmbeimjlocaknjjagjcdclmgiogofda
hey hn, wanted to share something i've been working on for a bit.most focus apps like opal are static. they block a list of websites and that’s it. once you start a timer, you’re locked in. can’t quit, can’t delete, can’t reason with it.but real focus isn’t that binary. sometimes i actually need to use youtube or reddit for a task, like watching a physics lecture or checking a solution....
genuinely what's the point of this comment? are you allergic to cool stuff? honestly curious as to what you were trying to achieve by this comment.
nowhere in this post does the author say that it's ready with the current state of models, or he'd use a foundation model for this. why the hate?
what's the cost difference between groq/cerebras vs using something else for inferencing open source models? I'm guessing the speed comes at a cost?
i think lots of apps are going to go in the adaptive/generate ui direction - even if it starts a lot simpler than generating the code
would you be willing to pay for something that essentially is google inbox - but a separate web view client with more personalization/better search?
Posted by
FezzikTheGiant on Tuesday December 03, 2024 @11:56PM
from the self-post dept.
I've been working on designing a more intuitive UI that emphasizes user control and simplicity in email. The idea is to make email fun and not the cluttered mess that we are used to. I've built out a prototype that features smart categorization using user-defined rules in natural language, the ability to ask questions to your email with enhanced semantic search, email composition assistance,...
Posted by
FezzikTheGiant on Thursday November 21, 2024 @04:13AM
from the ask-hn dept.
Hi HN,I am working on a personal project where I'm trying to create an email GUI that I can use for myself. For this, I want to store all my emails in a pinecone index. I want to figure out what's the best way to embed and store all the emails extremely fast - I tried threading in Python and batching but not getting great results. Let's say I have 10k emails I want to store - what's a way I can...
are you using whisper at the backend
Would people be willing to pay for a gmail plugin that takes a stab at combatting ai email spam? something like Mailman [1] but with an LLM layer for detecting AI slop?
[1]: https://mailmanhq.com/
Would you be willing to pay for a gmail plugin that takes a stab at this? something like Mailman [1] but with an LLM layer for detecting AI slop?
[1]: https://mailmanhq.com/
Posted by
FezzikTheGiant on Sunday May 26, 2024 @01:14AM
from the ask-hn dept.
A website where different open source models battle each other super Mario bros style - could be cool.
The generative agents paper takes a pretty decent shot at this I think
I agree on the most part, but I still think some pretty cool games can come up with local LLMs. Suck up for example, though not local afaik, is a pretty cool one.
This is something I was considering as well - thanks
Can you explain further? Why would it not be free if it's running locally
Posted by
FezzikTheGiant on Wednesday May 22, 2024 @06:00AM
from the ask-hn dept.
So that the user doesn't have to download anything else - it's packaged with the app itself. And the app uses it to run inference. Is this possible?
Was playing around with this model - why does it return 2 or 3 responses when I ask it for one? I asked it for a json response and it generates 2 or 3 at a time. What's with this.
Thanks! This is helpful. I was thinking about the phi models - those might be useful for this task. Will look into how those can be run locally as well
What? chill out buddy - there's such a thing as timezones I was just sleeping
Posted by
FezzikTheGiant on Tuesday May 21, 2024 @02:33PM
from the ask-hn dept.
Since there are some models that can run on most consumer hardware (eg. the phi models) - is there a way to distribute LLMs packaged with whatever app. you're building? So the users don't need to download anything extra - they just download your app and you package your local model with it, which uses their hardware to run. This might be a naive question, still pretty new to this field.
Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?
What I think is, from my limited understanding about this field, if smaller models can run on consumer hardware reliably and speedily that would be a game changer.
how did you generate the data
yeah that's what I'm saying - it would eliminate inference costs. What I was asking is how feasible is it to package these local llms with another standalone app. For ex. a game
Interesting - is it viable do you think to package a llm like that with an existing game and run it locally - I assume it will be intensive to run but wouldn't that eliminate inference costs?
Are they able to run at a good speed? I'm just wondering what the economics would look like if I want to create agents in my games. I don't think many are going to be willing to get with usage based / token based pricing. That's the biggest roadblock with building LLM-based games right now.
Is there a way to reliably package these models with existing games and make them run locally? This would virtually make inference free right?
What I think is, from my limited understanding about this field, if smaller models can run on consumer hardware reliably and speedily that would be a game changer.
Posted by
FezzikTheGiant on Tuesday May 21, 2024 @01:31AM
from the ask-hn dept.
Are there any? I was thinking about LLM based agents and games and this will probably only be viable when most devices can handle LLMs running locally.
this is what i ended up doing
Trying to download audio data via http - I have a gcs bucket