News for hackers. Stuff that matters.
[dead]
Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by aleandros on Thursday October 27, 2022 @12:40PM (#33360220)
Hi Timja, sorry about that! We have been so focused on this for the past months that is easy to loose perspective.

Data connectors, in the loosest definition possible, is simply a piece of software that moves data from one place to the other. This can be from database A to database B or (as in our case) from a given API into a database.

ETL stands for "Extract, Transform, Load", a process in which you get data from some place, clean it/do something with it, then store it into a desired destination. Probably this term is most frequently used in the context of data warehousing, in which you move data from one or more OLTP databases from the application side, into an OLAP database.

Finally, Snowflake is a very popular (and very cool) database focused on Data Warehousing needs.

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by Timja on Thursday October 27, 2022 @12:45PM (#33360307)
Thanks for the explanations!

I get kind of a "no code" vibe from it?

When I want to read data from an API, transform it and put it into a DB, my approach would be to write a few lines of Python. A script that does an http request to the API, transforms it and then writes the data to SQLite.

That seems much easier and more future proof to me than to bring in a 3rd party service.

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by aleandros on Thursday October 27, 2022 @12:49PM (#33360388)
Yes, the idea is for it to be a no-code solution. We completely understand why some people would like to this work in-house, specially for simple use-cases such as the one you mentioned.
Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by ako on Thursday October 27, 2022 @12:36PM (#33360172)
I'd expect anybody doing enterprise software and having to integrate different systems would be aware of these.

Google probably has better explanations for these, but to summarize:

* data connectors - connectors that allow you to get data from all systems you use in your organization, from databases to ERPS, to custom build systems.

* ETL - a method for moving data from your data sources to your datawarehouses (DWH) - extract from source, transform to desired format, load in you DWH.

* Snowflake - cloud based highly scalable DWH for structured and unstructured data

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by dang on Thursday October 27, 2022 @02:23PM (#33361777)
Users flagged it. We can only guess why users flag things. Maybe they thought it was offtopic, or that the terms were obvious? not sure. I've unflagged it now.

When editing the launch blurbs, I usually tell founders to add explanations of any concepts or jargon that HN readers might not be familiar with. It's not always easy to know where to draw that line.

https://news.ycombinator.com/item?id=33360234 was pretty rightly flagged though - you're not supposed to put down other people's work in HN threads, especially not Launch or Show HN threads (https://news.ycombinator.com/showhn.html).

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by Timja on Thursday October 27, 2022 @03:16PM (#33362603)
Interesting that https://news.ycombinator.com/item?id=33360234 is considered to put other people's work down.

I asked about some terms and if they are common among the HN crowd. Ako replied that people who are doing enterprise software integrations know them. Then I ask if the HN crowd is nowadays people who are doing enterprise software integrations. (Because that is not what I would associate with hackers / startup founders. So maybe what initially was a community of hackers + startup founders is now a community of grown ups with enterprise jobs.)

Whose work have I put down by asking this?

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by ako on Thursday October 27, 2022 @03:49PM (#33363050)
There are plenty of startups that focus on enterprise (integration) software, don't see how these are mutually exclusive. And you can be both a hacker at night and an enterprise software engineer by day.
Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by pvg on Thursday October 27, 2022 @04:28PM (#33363568)
It's not hard to figure out what an unfamiliar (to you) product or forum community is about - by a bit of googling for the former and reading and participation for the latter. Maybe it's not your intent but you come off as if you're conducting some sort of interrogation which most people aren't all that keen on. It's also mentioned in the site guidelines:

Have curious conversation; don't cross-examine.

https://news.ycombinator.com/newsguidelines.html

Re:Launch HN: MovingLake (YC S22) – Real-time data connector... by dang on Thursday October 27, 2022 @08:06PM (#33365777)
I guess I took your comment as putting down "enterprise software integrations" as inferior and putting down the community as being "about that".

If you say that wasn't your intent, I believe you, but I doubt that I'm the only reader who took things that way. It can be difficult to read intent accurately from short internet comments. Ultimately the burden is on the commenter to disambiguate intent (https://hn.algolia.com/?dateRange=all&page=0&prefix=false&so...).

To be honest I still find it hard to read that comment and not feel that it was being snide. If one takes your question at face value, it answers itself: of course the community is not "about that"—it's got all sorts of people doing all sorts of things.