Re:Show HN: Data load tool(dlt)-Python library to automate t...
by nrjames on Wednesday October 25, 2023 @06:48AM
(#38011401)
Can the Destinations also natively be used as Sources?
[ Parent
| on HN ]
Re:Show HN: Data load tool(dlt)-Python library to automate t...
by MatthausK on Wednesday October 25, 2023 @07:10AM
(#38011537)
1) Yes. We support all the databases and buckets as data sources as well. Some examples:
- get data from any sql database: https://dlthub.com/docs/dlt-ecosystem/verified-sources/sql_d... or https://dlthub.com/docs/getting-started#load-data-from-a-var...
- do it super quickly with pyarrow: https://dlthub.com/docs/examples/connector_x_arrow/
- get data from any storage bucket:https://github.com/dlt-hub/verified-sources/tree/master/sour...
2) Strictly technical answer: on the code level sources and destinations are different Python objects so the answer is no:) but you as a user rarely deal with them directly when coding