michaelnny
michaelnny on Hacker News
An honest question, what’s the news on Wordpress episode? Didn’t follow the topic
One important aspect of the success of AlphaGo and its successor is the game environment is closed domain, and has a stable reward function. With this we can guide the agent to do MCTS search and planning for the best move in every state.
However, such reward system is not available for LLM in an open domain setting.
Wow, this is a great idea!!! Seriously!
The company I work for try to add AI/LLM on everything, instead of trying to improve/fix the underlying problem, they now just add the magic AI and everything is “perfect” now.
As an ML engineer and AI developer, I don’t see the real value at all, not to mention the added cost of using LLM
Maybe they have no idea what’s the difference between “scraping” and “mining”? I mean for non-tech people, these are just buzzwords…
I looked at the supposed “research” article, there’s nothing to read except few charts to show off the “improvements” over current models. No discussion of the training method or dataset whatsoever.
If I remember correctly, the last decent research paper the company published was probably the InstructGPT paper.
I’m curious where did you get this information?
I thought this was a joke at first, but then realized it totally made sense ;)
This there any sources on the closed model you just mentioned? Also, what do you mean “into a Python equivalent?
Anyone know how to use GraphRAG to build the knowledge graph on a large collection of private documents, where some might have complex structure (tables, links to other docs), and the content or terms in one document could be related to other documents as well?
I’ve deleted my reddit account earlier this year and I have no regret. Reddit has turned into something that’s unusable for me.
This is an interesting and well-timed, as I’m in the need to learn more about centralized logging and monitoring for my job.
I’m also wondering how does Uber handle structured logging
I'm wondering if the tensor parallel settings have any impact on the performance. My naive guess is yes but not sure.
According to the article:
"""
AMD Configuration: Tensor parallelism set to 1 (tp=1), since we can fit the entire model Mixtral 8x7B in a single MI300X’s 192GB of VRAM.
NVIDIA Configuration: Tensor parallelism set to 2 (tp=2), which is required to fit Mixtral 8x7B in two H100’s 80GB VRAM.
"""
Sorry forgot to change repo visibility, it's now public
Sorry forgot to change repo visibility, it's now public
Posted by
michaelnny on Tuesday June 11, 2024 @05:13AM
from the show-hn dept.
https://github.com/michaelnny/Llama3-FunctionCalling
Few weeks ago, we were tasked to make llama3 model to do function calling and build an API similar/compatible with OpenAI's python client.While we're still improving our dataset and FastAPI backend server (which can't be open-sourced), we're happy to share with the community our open-sourced project of how to properly fine-tune llama3 model to support function calling, all following OpenAI's...
Hi, just want to state that we would really appreciate if you can give us some advice or suggestions on this question!
Posted by
michaelnny on Tuesday May 28, 2024 @12:19PM
from the ask-hn dept.
Hi, we’re working on deploying llama3 models on a private server for a corporate, however we found that llama3 does not support function calling. And now we try to fine-tune it on our own.After checking on the internet we found few datasets that were available for this specific purpose. However after reviewing the dataset we have some questions regarding the format for prompt and response. And...
Just to clarify, I mean I won't try to use vim to write the code.
I definitely recommend people to try the CS50 course.
I enjoyed the CS50 course few years ago, where they talked about how to build native apps with React Native.
I remember the professor/lecturer was using vim to write the code, no IDE whatsoever! That’s was very cool but I don’t think I’ll ever try it.
I think the main problem is the way we turn the raw mathematics symbols or equations into tokens, and these suboptimal tokenization may decreases the performance
I once worked at a company that put a large logo with the company name on their office building. They used the Microsoft YaHei font, and didn’t have the permission or license, so they got contacted by the Microsoft representatives. I’m not sure if they sued the company, but at the end the company I work for did pay some money to settle the case. That was about 10 years ago.
Posted by
michaelnny on Monday May 27, 2024 @08:32PM
from the wsj.com dept.
Although I don’t know Go programming language, I do appreciate people making stuff using as minimal dependencies as possible. I’m glad that I’m not the only one who has this habit.
Agreed, I still prefer to write my own CSS than using tools like Tailwind.
Yes I agree with you on that. However not every author can negotiate with the publisher to get the permission to offer the ebook for free on their own website (I got rejected on the idea).
I guess if you’re a famous one then you can probably get that , but now for average people?
This is really frustrating, because as an author you can’t offer your own book on your own website for free, while on some third party websites it’s already been downloaded thousands of times.
From my experience as an author of a tech book, the ebook is pirated even before the official publication date, the authors only have access to the ebooks fees days after the publication date. That’s why I’ll never write a book again.
https://link.springer.com/book/10.1007/978-1-4842-9606-6First time author here, made quite mistakes both in the book and the process of writing it, and my biggest mistake is choosing the incompetent publisher.
I’m not looking to make money from writing books, my original plan was to write another tech book about LLM after the first one, however after my experience with the first book, I’ll probably never write another book!