tynmann
It's a landing page for a book I wrote.
What can I do to make it more interesting?
An option I am considering is allowing user interaction after the main animation finishes. So one can explore and browse the files of other subjects and learn more about the corporation. Would you like something like this?
But even bigger models (13B or 30B) can be handled with a dual GPU setup (24 GB total memory at < $600), with quantization.
The Discord bot works as a client (outgoing connection to the Discord public server), so it can run from behind NAT.
Show HN: Chat with Zephyr 7B over voice message using whisper.cpp and llama.cpp
https://bastianai.com/blog/2023/10/chat-with-self-hosted-llm-via-discord-voice-message-transcription
Just my small weekend project, experimenting with LLMs. I made a Discord bot that uses the Zephyr 7B model to reply, and whisper.cpp to transcribe voice messages into text. So you can send it voice messages and it replies.
And here is the link to the demo for convenience:
One has to enter some abstract of what they want to write, and some text they have so far, and the tool generates possible continuations.
It requires quite a bit of editing, maybe 3-4 attempts for each completion if one wants to generate decent text. Feedback was mostly positive from a dozen or so professional writers who tried it out for a day.
I feel that it generates more naturally looking text than ChatGPT with the typical prompts.
See my profile if you want to try it out. You can use the demo without registration.
Remote: yes
Timezone: late hours EU, morning US
Tech: Python, Go, C, Linux. Versatile, can do almost everything except frontend/mobile app development
Email: [email protected]
Software engineer with 6 years of experience, recently backend and before, networks and embedded system programming. I'm very good at what I do and have a couple of top companies on my CV.
Looking for a contract or part time job for a few months to complement my income.