flippingbits
How to mask data in Redpanda/Kafka topics with Python and DataCater
Why DataCater uses Quarkus to build cloud-native Java applications
TLDR: SQL feels most natural for joining and aggregating data sets; Python is favorable for filtering and transforming data due to its higher flexibility and extendability
At DataCater, we help businesses to efficiently connect their growing amount of data silos. To this end, we build the self-service platform for streaming data pipelines, based on the open-source technology Apache Kafka. DataCater enables companies to benefit from the power of event streaming, without handling the complexity. Our mission is to provide essential tooling, so that data teams can unlock the full value of their data, faster. DataCater was founded in 2020 and is serving customers from industries, such as finance, e-commerce, media, and software.
Open positions:
* Cloud infrastructure engineer (https://datacater.io/careers/cloud-infrastructure-engineer/)
* Frontend engineer (https://datacater.io/careers/frontend-engineer/)
* Software engineer (https://datacater.io/careers/software-engineer/)
You can learn more about our company in our handbook: https://github.com/DataCater/handbook
Sounds interesting? Please send an e-mail to our CTO Hakan ([email protected]), tell a few words about yourself, describe what excites you the most about the role, and send along your CV.
You can extract data change events (e.g., INSERTs) from a data source, transform them with a streaming application (e.g., built with Kafka Streams), and load the transformed events into a data sink.
Building real-time ETL pipelines with Apache Kafka
At DataCater, we help businesses to efficiently connect their growing amount of data silos. To this end, we build the self-service platform for streaming data pipelines, based on the open-source technology Apache Kafka. DataCater enables companies to benefit from the power of event streaming, without handling the complexity. Our mission is to provide essential tooling, so that data teams can unlock the full value of their data, faster. DataCater was founded in 2020 and is serving customers from industries, such as finance, e-commerce, media, and software.
Open positions:
* Cloud infrastructure engineer (https://datacater.io/careers/cloud-infrastructure-engineer/)
* Frontend engineer (https://datacater.io/careers/frontend-engineer/)
* Software engineer (https://datacater.io/careers/software-engineer/)
You can learn more about our company in our handbook: https://github.com/DataCater/handbook
Sounds interesting? Please send an e-mail to our CTO Hakan ([email protected]), tell a few words about yourself, describe what excites you the most about the role, and send along your CV.
DevOps and DataOps
Declarative Data Pipelines
Cloud-Native Data Pipelines [pdf]
At DataCater, we help businesses to efficiently connect their growing amount of data silos. To this end, we build the self-service platform for streaming data pipelines, based on the open-source technology Apache Kafka. DataCater enables companies to benefit from the power of event streaming, without handling the complexity. Our mission is to provide essential tooling, so that data teams can unlock the full value of their data, faster. DataCater was founded in 2020 and is serving customers from industries, such as finance, e-commerce, media, and software.
Open positions:
* Cloud infrastructure engineer (https://datacater.io/careers/cloud-infrastructure-engineer/)
* Frontend engineer (https://datacater.io/careers/frontend-engineer/)
* Software engineer (https://datacater.io/careers/software-engineer/)
You can learn more about our company in our handbook: https://github.com/DataCater/handbook
Sounds interesting? Please send an e-mail to our CTO Hakan ([email protected]), tell a few words about yourself, describe what excites you the most about the role, and send along your CV.
At DataCater, we help businesses to efficiently connect their growing amount of data silos. To this end, we build the self-service platform for streaming data pipelines, based on the open-source technology Apache Kafka. DataCater enables companies to benefit from the power of event streaming, without handling the complexity. Our mission is to provide essential tooling, so that data teams can unlock the full value of their data, faster. DataCater was founded in 2020 and is serving customers from industries, such as finance, e-commerce, media, and software.
Open positions:
* Cloud infrastructure engineer (https://datacater.io/careers/cloud-infrastructure-engineer/)
* Frontend engineer (https://datacater.io/careers/frontend-engineer/)
* Software engineer (https://datacater.io/careers/software-engineer/)
You can learn more about our company in our handbook: https://github.com/DataCater/handbook
Sounds interesting? Please send an e-mail to our CTO Hakan ([email protected]), tell a few words about yourself, describe what excites you the most about the role, and send along your CV.
Evaluating user code inside privileged containers is indeed a security nightmare. Fortunately, --privileged is not enabled by default, which is why I think that containers are quite secure by default.
Why we run Data Pipelines as Containers
Overcoming the Hurdles in Data Democratization
How to Use Change Data Capture with Web APIs
Full-stack Rails developer.
Skills:
* Ruby, JavaScript
* Ruby on Rails, Sinatra
* MySQL, Apache Solr, RabbitMQ, MongoDB, Cassandra
* Chef, Vagrant, Capistrano
* Unix, Vim, Git, zsh, tmux
Website: http://flippingbits.org
I like their service and they're nice guys.