News for hackers. Stuff that matters.

hdespiritu

hdespiritu on Hacker News

Re:Data Engineering Design Patterns (DEDP) on Thursday December 07, 2023 @11:01AM (#38557872)
DAMA-DMBOK2 covers this very comprehensively

https://www.dama.org/cpages/body-of-knowledge

Re:Stochastic gradient descent written in SQL on Tuesday March 07, 2023 @06:45PM (#35063078)
My sentiment exactly. The premise of the article comes across a little naive because there are so many fine-tuned libraries for specialized hardware architectures that already do this computation very efficiently.

However, it did make me wonder what this might look like on a gpu-accelerated database engine that is designed to leverage the SIMD parallelism of GPGPU architectures.

Beyond using SQL/NoSQL databases for CRUD apps I am not a "database guy", so I'm not sure about the feasibility, but it would be interesting to see it implemented.

Re:Stochastic gradient descent written in SQL on Tuesday March 07, 2023 @06:12PM (#35062694)
Your question "Has anyone converted stuff like gradient descent to set theory?" doesn't make sense from the perspective that gradient descent uses differential calculus to find min/max points of an objective function and differential calculus requires a lot of additional assumptions on top of set theory.

That being said, current deep learning libraries such as JAX and Pytorch use automatic differentiation to efficiently compute partial derivatives used for optimization algorithms such as gradient descent and it's not clear to me what the level of effort would be to convert that to something that could run efficiently in SQL?

Re:Majority of Hispanic Americans own a home on Friday March 03, 2023 @06:26PM (#35016386)
If it's your primary residence, the homestead tax credit can offset that increase substantially

https://smartasset.com/taxes/what-is-a-homestead-tax-exempti...

OP's original point still stands. Real estate in America is designed to have many economic advantages for wealth accumulation and preservation. You might even go as far as saying the economic advantages of real estate are a byproduct of regulatory capture

Re:Loss of Epigenetic Information Can Drive Aging, Restoration Can Rev... on Thursday January 12, 2023 @08:40PM (#34362900)
Hopium is a powerful drug
Re:Every modeler is supposed to be a great Python programmer on Wednesday December 14, 2022 @11:27AM (#33985813)
This is an interesting observation. Some of the data scientists I work with have been using Kotlin to define "analytic grammars", and is the first example (in my limited Kotlin awareness) i've seen of Kotlin outside of Android development.

It seems that Roman Elizarov (Kotlin Project Lead) has identified the opportunity for a better language ecosystem to enter the data science space

https://discuss.kotlinlang.org/t/ai-and-deep-learning-define...

Re:Coinbase announces proposed direct listing on Friday January 29, 2021 @12:42AM (#25954436)
Yeah, good catch

https://decrypt.co/55136/coinbase-to-launch-secondary-market...

Re:DuckDuckGo Traffic on Wednesday January 22, 2020 @04:43AM (#22116024)
There's obviously no guarantee in the long run, but Gabriel Weinberg (DDG founder) is arguably one of the most holistic tech founders when it comes to tackling socially impactful problems in tech probably due to his interdisciplinary background. He's detailed his approach in a variety of podcasts and blog posts over the years

https://medium.com/@yegg/mental-models-i-find-repeatedly-use...

https://fs.blog/gabriel-weinberg/

Re:Hundreds of Bitcoin Wannabes Show Hallmarks of Fraud on Thursday May 17, 2018 @03:23PM (#17094620)
There's decades of academic work in the form of "impossibility" results showing that handling byzantine fault tolerance in distributed consensus is alot more computationally expensive than omission/crash fault tolerance. The following (FLP impossibility result) being one of the most famous ones:

https://groups.csail.mit.edu/tds/papers/Lynch/jacm85.pdf

Re:KLEE LLVM Execution Engine on Tuesday April 17, 2018 @05:02AM (#16856649)
One of the contributors wrote a memoir of his time spent working on this project as a PhD student and gives an interesting perspective on the challenges encountered:

http://pgbovine.net/PhD-memoir.htm

Re:Vitalik Buterin Has Left VC Firm Fenbushi Capital on Tuesday January 16, 2018 @09:26PM (#16164960)
Awesome. Been looking for an up-to-date list of current programming language research being done for smart contracts.
Re:The FCC plan to undo its net neutrality rules on Wednesday April 26, 2017 @04:01PM (#14206453)
The major change will likely be companies relying more heavily on user bandwidth through p2p applications, p2p content delivery networks, etc.
Re:Elon Musk’s Neuralink wants to boost the brain to keep up with AI on Monday March 27, 2017 @08:28PM (#13972975)
Elon is not the first to take on so many ventures at once. Richard Branson has done it with overwhelming positive results (some losses are bound to happen). It seems that after a certain point, an entrepreneur that is so inclined gets more effective at putting the right processes in place so that they're no longer a bottleneck at the management level.
Re:A Quick Look at Support Vector Machines on Friday March 24, 2017 @09:51AM (#13948881)
>But now I learned with the minimal dataset I have (<5K samples), linear regression, SVM, or decision tress is the way to go.

Decision Trees are prone to overfitting and especially susceptible for small datasets. Random Forest is a good substitute that's become standard practice.

Re:A History of Reverse-Engineering Game Cartridges on Friday March 10, 2017 @06:55PM (#13843187)
Ha, biblical accuracy. Good one.
Re:Machines That Learn to Code and Take Your Job on Monday October 31, 2016 @05:57PM (#12841314)
https://en.wikipedia.org/wiki/Full_employment_theorem

Seems like there are mathematicians and computer scientists that might disagree with the premise of the article.