News for hackers. Stuff that matters.
Re:Drop-In Replacement for Memcached by mfrw on Sunday December 12, 2021 @03:44PM (#29533426)
I am not among the ones who would blindly say 'rewrite it in rust', but given what happened with log4j, I would much rather choose a safe implementation given the memory safety provided by rust.

This also does not mean rust might not have its fair share of bugs; IMHO the probability is a little less.

Edit: I mentioned the log4j RCE as it was new & do not mean to imply that it would not have happened if we had a rust implementation. As the comments have mentioned, it would be the same in any language IMO

Re:Drop-In Replacement for Memcached by sorokod on Sunday December 12, 2021 @03:54PM (#29533517)
You misunderstand the recent RCE in log4j. It has nothing to do with memory safety and can be implemented in Rust without any difficulty.
Re:Drop-In Replacement for Memcached by spullara on Sunday December 12, 2021 @04:16PM (#29533698)
Further it wasn't even a bug. It was the well defined behavior working as specified.
Re:Drop-In Replacement for Memcached by staticassertion on Sunday December 12, 2021 @05:17PM (#29534230)
> and can be implemented in Rust without any difficulty.

Not really. You'd have to fight the language and pull in some crates, to be sure. There's no native object serialization in rust and it's not really a concept in the language or ecosystem - except perhaps in the future with wasm runtimes.

There are numerous details of log4j that, in general, just don't apply to rust code.

edit: Since perhaps people don't believe me...

Rust has no equivalent of JNDI, pickle, etc. There is no way to send rust 'code' except, perhaps, wasm. Certainly there's no well supported way with decades of history of being ingrained into libraries, or patterns that support it.

Re:Drop-In Replacement for Memcached by ploxiln on Sunday December 12, 2021 @09:00PM (#29535726)
Loading and running a java class is only the most absurd exploitation possibility with log4j. Without that, you can still slurp any environment variables (or other process information) and send it to any host. And you can probably do yet other stuff too, it is quite flexible ...
Re:Drop-In Replacement for Memcached by staticassertion on Sunday December 12, 2021 @10:15PM (#29536191)
> Loading and running a java class is only the most absurd exploitation possibility with log4j.

Uh, yeah, the RCE was very bad. And not a thing with Rust due to not having object serialization.

> you can still slurp any environment variables (or other process information) and send it to any host

Yeah, you can write a logger in rust that does really crazy things like adding environment variables through some sort of parsing of a language construct. That would still be a problem, but a lot less serious. It would probably also be really unidiomatic, but that's a separate story.

Re:Drop-In Replacement for Memcached by tialaramex on Sunday December 12, 2021 @05:41PM (#29534439)
I think it would actually be pretty tricky to do that in Rust without realising what you'd done, as seemingly happened to log4j.

The root of the log4j problem is a failure to distinguish between log format strings and the formatted log string, beyond that what happens is that Java allows a lot of flexibility at runtime which simply doesn't exist in Rust. In Java it's fine to, at runtime pull in classes you've never used before and run them, you can't do that in Rust - the types only existed at compile time. Indeed this is a key feature of Rust, because it means wrapper types are free at runtime, invaluable to the embedded firmware community who love type checking and other safety features but can't afford runtime overhead.

Re:Drop-In Replacement for Memcached by gmfawcett on Sunday December 12, 2021 @06:27PM (#29534796)
> In Java it's fine to, at runtime pull in classes you've never used before and run them, you can't do that in Rust...

Of course you can. Rust would be a severely limited systems language if it couldn't support dynamic loading. E.g. see

- https://michael-f-bryan.github.io/rust-ffi-guide/dynamic_loa...

- https://crates.io/crates/libloading

Re:Drop-In Replacement for Memcached by tialaramex on Sunday December 12, 2021 @07:14PM (#29535136)
Notice that no classes come in here, the Rust Plugin trait used in that first page actually exists in the Rust code at compile time, as expected. You get to pull in machine code, by explicitly telling Rust that's what you wanted to do, but you don't get to conjure any types at runtime, because exactly as I said they simply don't exist at runtime.

The Log4j "lookup" behaviour was, first of all, a really dumb design decision even in Java but it's just wrong to pretend that it would be equally easy for it to be so catastrophic in most languages, not just Rust, even in C++ I think you'd probably realise you'd screwed up while developing a way for the log framework to run arbitrary code.

Re:Drop-In Replacement for Memcached by tptacek on Sunday December 12, 2021 @09:01PM (#29535732)
This whole discussion seems kind of overblown. Every mainstream systems language is capable of having this kind of vulnerability, Rust included. But runtime pluggability is part of the culture of Java code (and some Python projects, and Ruby, &c) and isn't part of Rust or Go's culture. So every Java project is potentially exposed to this kind of thing, but only the plugin-styled Rust and Go programs are.

You're much less likely to see a deserialization bug in Rust or Go than in Java.

There is nothing intrinsic to Rust or Go that prevents deserialization bugs; they're just not encouraged by idiom like in Java.

Re:Drop-In Replacement for Memcached by gmfawcett on Sunday December 12, 2021 @11:06PM (#29536482)
> every Java project is potentially exposed to this kind of thing

Many Java projects, but not all. Class-loading permissions in a Java program are subject to the security-manager policy for the program; class loading can be moderated or even fully disabled (once the main program is loaded, of course).

The default is to allow anything to be loaded, however.

Re:Drop-In Replacement for Memcached by mfrw on Sunday December 12, 2021 @03:59PM (#29533551)
I did not mean that the RCE of log4j is a memory safety issue, its just that, I would prefer to choose something where the probability of me having to wake up at the middle of the night and fix is less. Honestly, I would care less if it were memory safety or whatever, given I had to wake up at midnight :)
Re:Drop-In Replacement for Memcached by johnisgood on Sunday December 12, 2021 @04:37PM (#29533882)
Just because it is written in Rust, it does not mean that you will have less bugs or whatever to fix. I could easily say that if it is written in Ada or Nim, then you will have way less bugs, as those languages are way easier to understand, and they are safe & fast & easy. Nim is just as easy as Python, and it is safe if you want it to.
Re:Drop-In Replacement for Memcached by moonchrome on Sunday December 12, 2021 @05:22PM (#29534278)
>it does not mean that you will have less bugs or whatever to fix

But it does since you eliminate an entire class of bugs, and a class that's generally the source of most exploits out there (eg. heartbleed comes to mind as a similar level of exploit but was a result of memory errors).

JVM does the same with GC, and so do a lot of other languages, but when it comes to rewriting non-managed code Rust is a great choice over C in my book, I would feel better about introducing a Rust dependency over a C/C++ dependency just based on that.

As for ADA and Nim, if it's some black box docker service then sure, otherwise if I have to include it in my build pipeline that's a hard pass.

Re:Drop-In Replacement for Memcached by johnisgood on Sunday December 12, 2021 @05:58PM (#29534574)
> But it does since you eliminate an entire class of bugs

As opposed to what language? C? x86 assembly? You may be right, but I was using Ada and Nim as an example, not C. I could have used D as well. Again, the fact that it is written in Rust and not Ada, Nim, or D does not mean that it has less bugs.

In fact, I would even argue that even if we do a C vs. Rust, it still does not follow that just because it is written in Rust and not C, it has less bugs. There are all sorts of other bugs that could outnumber the memory-related bugs you may have in C. Can you really not see this possibility?

Re:Drop-In Replacement for Memcached by moonchrome on Sunday December 12, 2021 @07:02PM (#29535029)
>As opposed to what language? C? x86 assembly? You may be right, but I was using Ada and Nim as an example, not C. I could have used D as well. Again, the fact that it is written in Rust and not Ada, Nim, or D does not mean that it has less bugs.

Yes, C, the language memcached is written in. The fact that it's written in Rust means that it's more likely to work in the first place because more people are actually using that language in the real world vs. Ada, Nim and D.

>In fact, I would even argue that even if we do a C vs. Rust, it still does not follow that just because it is written in Rust and not C, it has less bugs. There are all sorts of other bugs that could outnumber the memory-related bugs you may have in C. Can you really not see this possibility?

I don't feel like just random googling for the sake of argument - it should be easy to find, there have been many analysis of this kind and pretty much any I've seen concludes the largest source of vulnerabilities have been memory errors (I remember FF, Linux, Microsoft, etc.). So yeah if you want to be pedantic for the sake of argument feel free to keep arguing about the semantics - real world experience motivated initial Rust development and it's gaining adoption in places like cloud provider infrastructure and drivers because people dealing with these issues know what their most common bugs are coming from.

Re:Drop-In Replacement for Memcached by mfrw on Sunday December 12, 2021 @04:48PM (#29533985)
I completely agree. My choice of words was not not right.
Re:Drop-In Replacement for Memcached by charcircuit on Sunday December 12, 2021 @08:26PM (#29535546)
If log4j was implemented in Rust that feature would have never been implemented in the first place meaning th RCE wouldn't exist.
Re:Drop-In Replacement for Memcached by EdwardDiego on Monday December 13, 2021 @03:34AM (#29537840)
If Rust occupied the same market niche (better and easier than C++ for large companies!) as Java did in the early 2000s when such features were considered desirable by paying customers, it totally would have been implemented.

Rust is able to learn from the many mistakes that other languages before it have made. But pretending that this means Rust is inherently purer instead of just "has less baggage, but will soon implement its own", is naive.

Re:Drop-In Replacement for Memcached by zamalek on Sunday December 12, 2021 @03:54PM (#29533512)
> IMHO the probability is a little less.

Exactly, Rust simply eliminates a certain class of bugs. You can still make some really major mistakes in the absence of these bugs, e.g. "goto fail" could have easily been written in Rust.

Re:Drop-In Replacement for Memcached by vlmutolo on Sunday December 12, 2021 @05:35PM (#29534399)
The "goto fail" bug isn't a great example; Rust actually does specifically guard against this by requiring curly braces around the body of "if".

Here's an explanation of "goto fail", which includes a code snippet.

https://nakedsecurity.sophos.com/2014/02/24/anatomy-of-a-got...

If C conditionals required explicit braces around the body, the second fail would have been redundant code instead of a security vulnerability.

Additonally, Rust will warn you if you have "unreachable" code, such as all the code after the unconditional "goto fail". Though, I'm sure modern C compilers would also warn about this.

All that said, Rust definitely does have plenty of bug classes left for people to trip over. Integer under/overflows come to mind (though they're just logic errors instead of undefined behavior).

Re:Drop-In Replacement for Memcached by tialaramex on Sunday December 12, 2021 @05:57PM (#29534569)
In the same class as the integer over/underflows, Rust also doesn't warn for throwing away information when casting. So (my_value as u16) might be a completely safe transformation from an unsigned one byte my_value to a u16, but it might be throwing away the top 16-bits of a 32-bit value and Rust doesn't think that's worth any additional caution.

Rust also hasn't boarded the "People can't remember precedence rules" train like some modern languages. It has fewer operators with unnecessary values, reducing some opportunities for mistakes like C's increment footgun, but it does still have precedence and so you can still forget the precedence rules which the compiler is going to apply to your code.

But there are a lot of things Rust does catch, and there are even more things that aren't caught by Rust the language per se but are caught in idiomatic Rust because the language affords better ways to do things. Locking is an example, idiomatic Rust locking means you can't make the lock A but change B mistake seen so often in real bugs, because idiomatic use of Rust's type system would put the variable B inside the lock for B, if you didn't take the lock you don't have the variable to change it. https://doc.rust-lang.org/std/sync/struct.Mutex.html

Re:Drop-In Replacement for Memcached by Vecr on Sunday December 12, 2021 @11:42PM (#29536693)
You can enable Clippy lints for `as` casting, and I think some of the common "throwing data away" ones are caught in the standard configuration or just pedantic. https://rust-lang.github.io/rust-clippy/master/index.html#as...
Re:Drop-In Replacement for Memcached by pjmlp on Monday December 13, 2021 @02:22AM (#29537508)
Another example would be bounds checking, yes it is much better than silenty corrupting memory, but dying with a panic might not be the best solution in some cases, specially if the application is controlling hardware.

Not only Rust, this applies to all safe languages, just crashing also opens the door to exploits and denial attacks.

Re:Drop-In Replacement for Memcached by tialaramex on Monday December 13, 2021 @04:14AM (#29538019)
If the bounds check fails at compile time then the program doesn't compile. This seems like it should be a reasonable ask for any programming language, but, apparently not.

And it probably applies to all general purpose languages but of course it doesn't apply to all the safe languages that aren't general purpose. You can't have bounds misses in WUFFS. When you try to touch array[x] in WUFFS, the compiler constrains the type of x to have a boundary limit according to the size of the array, reasoning that you can't very well have meant for it to be possible to overstep the bounds of the array at runtime. Trivial arithmetic mistakes you might find in unit testing or worse production with other languages are often compile time errors in WUFFS as a result.

Re:Drop-In Replacement for Memcached by pjmlp on Monday December 13, 2021 @04:24AM (#29538083)
Except bounds checking fail at runtime like 90% of the time.
Re:Drop-In Replacement for Memcached by tialaramex on Monday December 13, 2021 @07:17AM (#29538890)
Well, like I said, in WUFFS this literally can't happen, WUFFS doesn't have any concept of runtime bounds checking, likewise it has no runtime overflow/underflow checking, if the compiler can't see why what you're doing will obey the constraints you don't have a valid WUFFS program at all (well, library, WUFFS is a special-purpose language so you're not going to go around writing whole programs in WUFFS)

And it's still a pretty sad indictment when a compiler is looking at your access, can see it's outside the boundaries and doesn't reject the program because the language (e.g. C) wasn't defined with this obvious expectation.

For me it's in the same category as the (now fixed in an errata) behaviour where as I understand it C++ 20 std::format didn't consider it a compile time error if you wrote

  format("check X: {} Y: {} and Z: {}", x, z)
... even though that's obviously an error, and it's obvious you can detect it at compile time, the original specification said nah, this code just blows up at runtime, good luck with that.
Re:Drop-In Replacement for Memcached by pjmlp on Monday December 13, 2021 @07:28AM (#29538958)
How would you write random app X? That is my point, I don't care about special niche cases.
Re:Drop-In Replacement for Memcached by tialaramex on Monday December 13, 2021 @04:02PM (#29544617)
I think a lot of people would already consider the cases you've declared to be relevant - where dying due to bounds failure is unacceptable - to be niche cases which need to do their own work to stabilise and not act like this is everybody else's problem. It isn't, for example, as if explicitly checking bounds isn't possible in Rust if you want to do something other than give up.

For example I would consider it acceptable if feeding badly corrupted MP3s to the MP3-capable CD-radio makes it stop working... until I disconnect the power and restart it. Nobody dies, if it's very annoying I should remove the offending MP3 file. Whereas if it causes random mayhem that's a problem because now troubleshooting is impractical and most likely the apparent solution is to replace the entire device.

And remember that such "turn it off and on again" is considered acceptable even in some systems you probably deem safety critical, so long as it needn't happen when actively dangerous. For some years trains in the UK with a beacon-based safety system couldn't handle waking up next to a beacon, their firmware wanted to start by not seeing a beacon, then encounter beacons while travelling - so waking up next to one was confusing and they'd go into an error state. The fix? Mostly "don't park the train there when it's to be switched off", but when it happened inadvertently, they would move the train a few metres with its safety systems disabled, turn the power off, wait a few seconds, turn the power back on and no longer able to see a beacon it was now happy.

Re:Drop-In Replacement for Memcached by pjmlp on Monday December 13, 2021 @04:31PM (#29544934)
That is where I disagree, when you buy a pair of shoes that are somehow uncomfortable to wear, do you live with the pain or go to the shop to exchange them?

Exactly that is what we are missing in the software industry, the niche cases of high integrity computing should be a common practice, just like most people usually don't put up with broken stuff when given the option.

We need more liability not less.

Re:Drop-In Replacement for Memcached by tialaramex on Monday December 13, 2021 @06:54PM (#29546345)
When I buy new boots they're uncomfortable for at least a week or two. Replacing the boots wouldn't help at all, the boots adapt to your feet and your feet adapt to the boots, I don't have money to get tailor-made boots that would fit to the millimetre on day one if that's even a thing -- which I suspect in fact it is not (that is, people who could afford such boots don't actually spend hours every day walking and so probably wear shoes which are comfortable but less effective).

User experience matters, and actually just dropping dead in error cases makes for a better user model than many outcomes. The user has a model of what the machine does, which is always over-simplified and often plain wrong, but it's vital to try to get to a place where the user's model doesn't contradict how it's actually to be used. Undefined Behaviour is the enemy of this outcome. The user definitely does not have a correct model of what Undefined Behaviour will be, as we see many programmers don't either, whereas "If I do this particular dumb thing, it stops working and I need to unplug it and start over" fits in the user model relatively well.

Computers aren't special in this regard, watch "Sully" (Miracle on the Hudson), the cockpit dialog is roughly correct. What does their QRH tell them to do in the event of dual engine failure? Turn the engines off first and then try turning them back on again. Didn't work because their engines were trashed, but if even one engine had restarted, those QRH instructions mean there would be no film, just a scary incident some passengers tell stories about and an aviation safety file somewhere, the plane climbs (slowly) on one engine, they're still an emergency but they can put it back down on a runway at their leisure.

Re:Drop-In Replacement for Memcached by pjmlp on Tuesday December 14, 2021 @02:04AM (#29549038)
Some people miracously avoid death by not wearing a seat belt, yet the statistics prove wearing it is still a much better option.
Re:Drop-In Replacement for Memcached by ordiel on Sunday December 12, 2021 @04:26PM (#29533780)
Most certainly opening the door to a diffetent kind of bugs. This mentally of tying bugs to a language demonstrates a very poor understanding of the issues themselves, and if anything a large impacting bug demonstrates wide adoption of an individual piece, most probably choosen due to its stability or ease of use.

Remember heartbleed?...

Re:Drop-In Replacement for Memcached by staticassertion on Sunday December 12, 2021 @05:19PM (#29534258)
> Most certainly opening the door to a diffetent kind of bugs.

No? There's no law of conservation of bug class or something, you can eliminate bug classes without introducing a new one.

> This mentally of tying bugs to a language demonstrates a very poor understanding of the issues themselves,

No it doesn't.

> and if anything a large impacting bug demonstrates wide adoption of an individual piece, most probably choosen due to its stability or ease of use.

I don't think this has held true historically, and log4j is a good example of this (though there are many others).

> Remember heartbleed?...

A weird point to bring up since heartbleed was an out of bounds memory read.