Re:Full Time
by marginalia_nu on Friday June 16, 2023 @11:26AM
(#36358213)
I think overall the system is just really well optimized. It needs to be given I'm working with finite hardware.
It's incredibly impressive. Well done.
Re:Full Time
by playingalong on Friday June 16, 2023 @12:15PM
(#36359127)
Watch out for Spark. If not dead, it went into some kind of hiatus. Little activity recently.
Re:Full Time
by marginalia_nu on Friday June 16, 2023 @12:20PM
(#36359230)
Dunno what I'd want to change though.
For anything handling user input I'd be concerned about maintenance status for fixes. Even beyond the codebase itself, even just maintaining an up to date pom.xml can be important - seems theirs was last updated in July of last year. Very brief manual browse of it shows potential exposure to things like https://nvd.nist.gov/vuln/detail/CVE-2022-25647 - not sure if that's reachable in the codebase but there could be others.
Yes, and it was not that well designed to be honest... the successor is quite a lot nicer and it's called Javalin[1].
Same philosophy but just got things right where Spark, being the "first" (in the Java world, using the design inherited by Sinatra[2]) had a few design issues.
That seems to be the status of the whole hadoop ecosystem unfortunately (we're switching away from it at work).
Re:Full Time
by playingalong on Saturday June 17, 2023 @01:59PM
(#36372645)
Does the library have anything to do with Hadoop?
Are we talking of the same Spark?
https://en.wikipedia.org/wiki/Apache_Spark right? My understanding was it was built on Hadoop (https://en.wikipedia.org/wiki/Apache_Hadoop) infrastructure.
Re:Full Time
by playingalong on Wednesday June 21, 2023 @03:25PM
(#36423122)
Then it's something else.
Yeah the static stuff being fast is less surprising - it was mainly the search results page that astounded me.
> via served via spark[2]
Had not heard of this Spark (only the other Apache one). Will definitely take a look.
> Although the search engine is a bit on the slow side since it's routed through cloudflare and I think I'm relatively far away from the closest datacenter so it adds like 100ms to the load times.
I've hit the CF loading screen which introduces a big delay, but when I don't see that the loading is really instantaneous.