JohnSSS1978

Re:Show HN: Table Topic: Store Kafka topic data on S3 in Iceberg forma... on Monday December 30, 2024 @10:03PM (#42556001)

Thank you for your suggestion. This blog includes a tutorial to ensure everyone can get hands-on experience. If you need the specific project address, you can check: https://github.com/AutoMQ/automq

Show HN: Table Topic: Store Kafka topic data on S3 in Iceberg format without ETL

Posted by JohnSSS1978 on Monday December 30, 2024 @08:42PM
from the show-hn dept.

https://www.automq.com/blog/automq-table-topic-seamless-integration-with-s3-tables-and-iceberg

Kafka is the core data infrastructure for many enterprises, handling and analyzing many data streams. With the development of data lake technology and the success of Iceberg, storing Kafka's stream data in Iceberg format on object storage like S3 has become an indispensable step in data analysis. Our "table topic" feature is designed to optimize the efficiency of this step by simplifying the...

( Read More... | 2 comments | 5 points | on HN )

Re:A quick look at my homelab [video] on Sunday April 28, 2024 @09:50PM (#40193588)

Did you previously work for a company specializing in IDC or data centers? Your setup is very professional.

Re:Show HN: OpenOrb, a curated search engine for Atom and RSS feeds on Tuesday April 23, 2024 @07:53AM (#40130851)

've been thinking that I needed one of these, but you've already made it happen. That's really great.

Re:Show HN: Easy-to-use, AI-powered GitHub Actions on Thursday April 18, 2024 @06:17AM (#40074652)

What I'm more skeptical about is its value in a real-world environment. Can you give me some use cases?

Re:Ask HN: Flutter or React Native? on Tuesday April 16, 2024 @11:59PM (#40060285)

Choose one that you are better at.