The situation differs when people work within established domains, where the foundational ideas have already been explored. atm everyone does exactly the same some with more salt some with more pepper. Just look back a few months how many of the RAG implementations survived?
MySQL, MariaDB, PostgreSQL, TimescaleDB, CockroachDB, YugabyteDB, Teradata, Snowflake, TiDB, SQLite, DuckDB, and more probably.
I think it's led to great choice and a great sharing of ideas. Theres also been a lot of failures too, that's true, but I'm sure some of those failures have led to a few unique features across those products too.
So now with AI, for me it's the same process, just accelerated. Yes, there is lots of junk coming out there, but I think there's lots of good too.