News for hackers. Stuff that matters.

lee101

Checkout https://text-generator.io it's not trained to use tools, but it is highly adaptable to being used that way, with some smart prompting, code generators already understand some syntax such as eval and writing code that does stuff/metres explanations.

Text generator is interesting more because it goes too much higher length to understand input content such as crawling the web for any given input links downloading images and analysing the content/ embedded text etc.

Both strategies and more including training new networks especially for harder problems ( like generating 3D content or designing and finishing new projects ) will be required for agi

Checkout https://text-generator. Io it's not trained to use tools I don't think, but it is highly adaptable to being used that way, M with some smart prompting, code generators already understand some syntax such as eval and writing code that does stuff/metres explanations.

Text generator is interesting more because it goes too much higher length to understand input content such as crawling the web for any given input links downloading images and analysing the content/ embedded text etc.

Both strategies and more including training new networks especially for harder problems ( like generating 3D content or designing and finishing new projects ) will be required for agi

Agree, the faster progress is the faster people will be proved wrong generally speaking.

Checkout https://text-generator.io which is already multi modal (and multi model :), it includes a web crawler to crawl through input links, download and analyse images, do OCR etc to generate better text. As well as Auto picking the right model for the job (multilingual/code/chat/instruct etc)

Re:Localbitcoins Is Shutting Down on Thursday February 09, 2023 @06:25PM (#34733215)
Not sure why they're not just axing a whole bunch of staff like everyone else.. fees on-top of this marketplace is still a profitable concept and/or you could find a buyer
Re:Ask HN: Is anyone else getting AI fatigue? on Thursday February 09, 2023 @06:19PM (#34733155)
Speaking about opportunity cost of folks pursuing AI like a mad crowd... I started a ChatGPT competitor https://text-generator.io let me know what you think .. or if it's too much...
Re:We compete with GitHub. Bing does not show our website on Thursday February 09, 2023 @06:13PM (#34733098)
Looks like this post is flagged too... I'm also competing with you/co pilot with https://text-generator.io but I'm on Bing, take a deep look into your site/SEO etc and tip of the day for generative companies like ours is that we can generate a whole bunch of examples for SEO.

Normally HN and Reddit are less moderated than other sites that do a lot of shadow banning, condolences for getting stomped on by large co's and also welcome to the internet

Re:ChatGPT is a data privacy nightmare on Wednesday February 08, 2023 @03:56PM (#34714993)
For a text generator that doesn't store data you give it checkout https://text-generator.io it's also open AI compatible and self hostable so and easy migration
Nice great principles, really interesting how creative writing is now seeing a huge resurgence as a marketable skill.

Those principles also work well in other AI text generators like https://text-generator.io

Checkout https://text-generator.io for embeddings for search, they are better because they are cheaper/faster/take into account linked images (actually embed text images and code in the same space)

https://text-generator.io/blog/embed-images-text-and-code

Your training trick is neat/great innovation but also keep in mind it is likely overfitting meaning when you get a bit of new data you need to index and search that model isn't going to do well at all at embedding it, said differently that training works well if you can cover the types of data you're going to see in production really well at training time. If not there's a big accuracy drop for unseen data due to overfitting

Re:We come to bury ChatGPT, not to praise it on Tuesday February 07, 2023 @03:59PM (#34699533)
Try https://text-generator.io the bs generated is about the same tbh... But much cheaper, and combines a web crawler so it can speak about links and images which makes it a lot better at lots of things like making a believable conversation about designs/invoices/reciepts/emojis.
Re:We come to bury ChatGPT, not to praise it on Tuesday February 07, 2023 @03:06PM (#34698651)
I run the cheaper self hostable OpenAI alternative https://text-generator.io I've been working on automating this manual verification of everything, with a few components we already have like a search engine and an edit API we can both detect and correct most of these errors to at least be reflective of what a reliable source says like Wikipedia, still a lot of reasoning, logic and math issues will remain, but there's a big step up coming soon in factual generation
Re:Ask HN: How do you plan on making money with Open AI API? on Thursday February 02, 2023 @04:51PM (#34633684)
I built my own OpenAI compatible alternative, https://text-generator.io to help with that pricey ness. Also self hostable which helps people cut costs.

It also analyses linked web pages and image content automatically so helps people build these web integrations or auto img alt tag describers or reiept analysers etc without doing as much of the prompt engineering/crawling themselves.

Re:Ask HN: How do you plan on making money with Open AI API? on Thursday February 02, 2023 @04:45PM (#34633611)
I'm doing this with https://text-generator.io OpenAI is fairly pricy and has heaps of gaps, some of which text-generator.io also solves like image and link analysis. Also does speech to text
Re:Ask HN: How to ensure your water is safe to drink? on Wednesday February 01, 2023 @03:55PM (#34617583)
I'm on a rain water tank so would also appreciate some advice there for DIY style where you don't have access to municipal water..
Re:Ask HN: What API's do people wanna buy/pay for? on Wednesday February 01, 2023 @03:43PM (#34617403)
Side note about rapid API, I originally built https://text-generator.io on rapid API but I got 0 customers there, you would think you could just look on rapid API to see the gaps, there wasn't and still isn't a good alternative to text-generator.io on there but that doesn't guarantee anything, market research takes a lot of thought and the product needs constant marketing just like all businesses, I had to launch it as its own website for it to get users, so there's a lot more that goes into it than just building the right API.

I've also had customers scared off or investors not want to invest because it is a plain API platform and not B2C...

To answer the question market research is kind of the only way to know, Google adwords keyword planner and Google trends are quite good, as well as researching the companies in the same space well and what gaps there APIs have.

As an example https://text-generator.io distinguishes itself from OpenAI by including automatic analysis for input links, linked images, documents etc and doing speech to text/self hosting/embedding images, text and code in the same space, so isn't just an API clone

Re:Ask HN: How to Prepare for the AI Apocalypse? on Wednesday February 01, 2023 @03:33PM (#34617219)
What I'm doing is building a self hostable OpenAI alternative to help bring the AI costs down https://text-generator.io I've also been thinking of lots of other forms of content generation like 3d etc.

You have to be careful with the rate technology progresses and be the one riding the wave of progress and not left behind.

At this point we best believe there will be robots capable of doing near everything we can, but better including sports, trades, war, looking after people, and these are not that far away and will happen in our or kids lifetimes.

Don't listen to the nay sayers, people used to argue hard that computers would never play chess, humans will keep redefining the goalposts including creating new distinctions of what intelligence is like the difference between thinking and writing until machines are just plain better than us at all of it and we will invent a whole bunch of hateful slurs for them

Re: on Wednesday February 01, 2023 @03:20AM (#34607884)
Hi,

Text-Generator.io is now self hostable, It's priced at $1000 USD per instance per year to self host.

The service runs on a single 24GB VRAM GPU, and runs all services including speech to text, text and code generation for almost all languages and generating embeddings too.

The text generator also downloads and analyses any input with links including documents, images, images with text inside and webpages for better understanding and to generate better text.

It's a great alternative to OpenAI and has a compatible API making switching easy.

Let me know what you think and if there's anything i can do to help!

All the best. Lee Penkman - Founder Text-Generator.io

https://text-generator.io an API compatible alternative to OpenAI GPT, it's more affordable and also researches linked web pages and analyses image content, also reads images with text in them so it can do extra things like explain about receipts or how people respond to emojis or images etc.

It also does speech to text over 8x cheaper than Google Cloud, there's a nice free teir, I'm surprised more people aren't taking advantage of it

OpenAI is doing well recently so the next step is to do more things they don't do and let people self Host etc.

LLMs like ChatGPT E.g. https://text-generator.io that combines then with image/web link content understanding, so it can answer questions about pictures with text in them like reciepts or simulate how people would talk about documents or respond to emojis/content.

It's apparent in the future machines will have a deep level of understanding and it will be easy to extend/build upon and also affordable

Re:Large Transformer Model Inference Optimization on Saturday January 21, 2023 @04:23AM (#34465117)
Hey all, I used most of the tactics here to optimise Transformers so y'all don't have to :-)

try https://text-generator.io It also works with code and in multiple languages and is OpenAI compatible so a one line change. There's a few other things that it does too like linked image understanding.

Re:Why is Chat GPT so expensive to operate? on Sunday January 15, 2023 @08:15PM (#34395604)
Basically gpu/compute costs being so expensive. Probably just the chat cost itself. also a whole boat load of Development costs will eventually be passed on to consumers, for a cheaper alternative try https://text-generator.io It also analyses images which OpenAI doesn't do
Re:New and Improved Embedding Model for OpenAI on Thursday December 15, 2022 @03:51PM (#34005563)
Also check out the embedding model from https://text-generator.io

It supports some things that openAI can't do, it retrieves any linked images of web pages, analyses the images or images with text inside to help the embedding model

Re:Show HN: I fine-tuned Flan-T5. Can it cook? on Sunday December 11, 2022 @05:09AM (#33941852)
Awesome! checkout https://text-generator.io which is a language model as a service similar to OpenAi that can cook but much cheaper

I would recommend for vast majority of people to experiment around with these pretrained models first before getting the dedicated GPU/training etc, but cool that your company helps with it

Re:Tell HN: IPv6-only still pretty much unusable on Wednesday December 07, 2022 @05:05PM (#33900978)
I just like to call out Starlink for not supporting ipv6, massive headache as calls to various ipv4 only sites fail in python then you need to set a timeout in your request to trick python into falling back to ipv4, also no public adresses on Starlink made self hosting https://text-generator.io a pain but CloudFlared tunnels helped
Re:Tell HN: Tired of Hearing about ChatGPT on Tuesday December 06, 2022 @03:23PM (#33886495)
I kind of understand about stable diffusion, but ChatGPT seems like just a progression, something you can already do with promoting if I'm not mistaken...

There's companies that offer orders of magnitude of cost savings over OpenAI for text generation too e.g. https://text-generator.io in excited about that going the way of stable diffusion e.g. there's bloom and bloomz for instruct, there should probably be the same excitement when bloom comes out with E.g. ChatBloom, but idk why open source and other co's don't get the press that OpenAi does

Re:Show HN: Domain Name Search with AI on Tuesday December 06, 2022 @03:13PM (#33886380)
For cost of OpenAI try this demo using https://text-generator.io that does the same thing but much cheaper than OpenAI :-) https://replit.com/@LeePenkman/Domain-Name-Generator

Switching is also very easy as text generator is OpenAI compatible/one line change of the base url/API key

Re:Ask HN: What are some examples of cloud lock-in? on Monday December 05, 2022 @07:17PM (#33873987)
Micro example is that you can't scale rds/cloud db disk size downward easily, only upwards, so if you haven't sorted out go archiving before hand you may be stuck paying more for storage until you have both migrated data away and done the extra leg work to scale back down.

Macro examples: cases where there are incentives to use for a period e.g. sustained use or yearly discounts Incentives to use proprietary technology such as S3 or dynamodb being cheap. Situations where migrations are hard (data), expensive (cold storage) or dangerous/slow to recover such as changing the DNS

https://text-generator.io is like a cheaper gpt-3 but also crawls/interprets links to images, webpages, images with text in them, it's OpenAI compatible so if you get it working with OpenAI switching is easy
Re:Upcoming pricing changes (increases) for Cloud Storage on Saturday December 03, 2022 @01:38AM (#33841270)
Best to Checkout alternatives e.g. https://text-generator.io does text to speech over 8x cheaper which is crazy, cloud storage costs going up a lot but compute costs have always been high esp for managed services/ml so shop around and on a code level, ideally use a wrapper around your Cloud usage to make switching easier

Older »