DSOfficial
DSOfficial on Hacker News
A ClickHouse outage triggered 200+ retries and a DolphinScheduler deadlock. Here’s how to troubleshoot, recover, and prevent task pileups.
Posted by
DSOfficial on Thursday August 27, 2026 @04:26AM
from the medium.com dept.
How does Apache DolphinScheduler handle long-held task group slots? Explore consistency correction, normal release, and force start.
Posted by
DSOfficial on Thursday August 20, 2026 @11:26PM
from the medium.com dept.
Master big data workflows with Apache DolphinScheduler on Ubuntu via Docker! Build & run visual DAGs effortlessly.
Posted by
DSOfficial on Thursday August 20, 2026 @11:25PM
from the medium.com dept.
Posted by
DSOfficial on Wednesday July 22, 2026 @09:57PM
from the apacheseatunnel.medium.com dept.
Run Apache DolphinScheduler with Spark on Kubernetes! Learn cloud-native deployment, shared storage, and production-ready best practices.
Posted by
DSOfficial on Wednesday July 22, 2026 @09:54PM
from the medium.com dept.
Revolutionizing enterprise-grade workflow orchestration! Apache DolphinScheduler now has generalized OIDC authentication. Simplify user management, enhance security & integrate seamlessly with any identity provider. Check out the details.
Posted by
DSOfficial on Thursday October 23, 2025 @03:00AM
from the apachedolphinscheduler.substack.com dept.
Last week, the tech world was shaken by a headline-grabber: Databricks has surged past the $100 billion valuation mark.
And remember, this isn’t a consumer internet giant, nor is it SpaceX—it’s a software company that builds the data and AI infrastructure layer. In a capital market environment dominated by caution, Databricks has managed to defy gravity, pushing the ceiling of what a unicorn can be worth.
The obvious question is: why? What exactly gives Databricks the right to this number?
I did some digging. Let’s look at why Databricks is valued at $100 billion—and more importantly, what software entrepreneurs might take away from it.
https://dev.to/chen_debra_3060b21d12b1b0/why-databricks-is-w...
Posted by
DSOfficial on Tuesday May 20, 2025 @11:21PM
from the github.com dept.
Great news! Apache SeaTunnel has surpassed 8,500 #GitHub Stars!
A big shout-out to our amazing community for the continued support and contributions.
Join us on our journey to make data synchronization easier and more powerful! #OpenSource #BigData
Just extracted a lightweight, delay-capable EventBus from Apache DolphinScheduler!
Supports delayed & event-driven execution
Inspired by DolphinScheduler's elegant design
Easy to plug into any Java system
Dive in
Submission Deadline: April 21!
The countdown is on for #CommunityOverCode Asia 2025 CFP!
Got a story, project, or insight to share with the open-source world?
Submit your talk now
#Apache #OpenSource #TechConference #CFP
Experiencing CPU spikes with Apache DolphinScheduler? One team solved it instantly by tweaking memory & thread settings — no more crashes, even at peak load! #DolphinScheduler #BigDataOps #OpenSource #DevOpsTips
Just dropped: Deep dive into Apache DolphinScheduler's Master Module! Discover how it handles billion-level tasks with slot calculation, command processing, and DAG workflows.
Once upon a time, when people in the tech circle mentioned DS, what came to mind was a lively “little dolphin” - Apache DolphinScheduler (abbreviated as DS). This distributed task scheduling system, born in 2019, was once the “dream job” for big data engineers with its visual DAG interface, multi-tenancy support, and deep integration with the Hadoop/Spark ecosystem. However, the wheels of fate began to spin rapidly in early 2025: Hangzhou AI company DeepSeek (Deep Quest) burst onto the scene with its inference model R1 and open-source large model V3, touting “low cost and high performance.” Not only did it sweep the capital market, but it also redefined the acronym “DS” overnight - from now on, “DS” was no longer a scheduling tool but the “new darling” of the AI circle.
The software landscape is transforming!Affordable large language models, like #DeepSeekR1, are shaking things up. The future belongs to the monkey-troop-like collaborative software ecosystem.
Join the Apache DolphinScheduler community for an online meetup on December 17th, 2024, at 2:00 PM (GMT+8), as we explore Big Data Scheduling Technology across traditional and cutting-edge applications! Register now:
https://www.slidestalk.com/DolphinScheduler/12_17 #Dolphinscheduler #BigDataScheduling #Meetup
Delve into Quartz, the mighty open-source Java framework for scheduling tasks, and its dynamic partnership with DolphinScheduler through QuartzExecutorImpl. Find out how they work together to orchestrate workflows and manage timings in our in-depth exploration.
An interesting #opensource #LLM project on #github, saving valuable time in the big data era
Explore how Apache DolphinScheduler enhances MapReduce task management! #ApacheDolphinScheduler #MapReduce #BigData #DataEngineering #opensource
Dive into integrating Arthas with DolphinScheduler to monitor specific API calls and analyze performance data. This setup enhances task scheduling reliability and maintainability—take your workflows to the next level! #DolphinScheduler #Arthas #PerformanceMonitoring
Posted by
DSOfficial on Thursday October 31, 2024 @05:35AM
from the github.com dept.
After several months, #ApacheDolphinScheduler is back on the GitHub Trending weekly list, now reaching 12,820 stars! Big thanks to the community for all the support and contributions!