News for hackers. Stuff that matters.
Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @10:34AM (#28074275)
Because it is something that naturally flows from having an understanding of boolean logic and that computers store data in binary digits.

Being a "software engineer" who doesn't understand this seems to me like being an architect who doesn't understand trigonometry or something.

Re:A Bit Overcomplicated by pcthrowaway on Thursday August 05, 2021 @12:45PM (#28076203)
Believe it or not, there are many different kinds of software engineering, many of which don't require you to know anything about binary or bitwise arithmetic. I don't know that I've ever used these as a full stack web developer, but I did learn it in my Computer Science program; the only time I think about the bit position of something is when setting/viewing file permissions, or reading source code for a library which does deal with this (there are legitimate reasons to use bitwise operators in JS for things like hashing, cryptography, secure string generation, etc.)

But really, there are people doing software engineering who have never thought about this, and while I agree that any blind spot in knowledge is detrimental (and everyone has some blind spots), it's condescending to suggest that this specific blind spot is noteworthy to the point of lacking foundational knowledge. Your software engineering isn't the only type of software engineering.

Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @12:58PM (#28076396)
I must question the value of a "software engineer" who is working at a layer so abstracted from the reality of implementation that they don't have to understand binary.

> the only time I think about the bit position of something is when setting/viewing file permissions, or reading source code for a library which does deal with this (there are legitimate reasons to use bitwise operators in JS for things like hashing, cryptography, secure string generation, etc.)

People should understand how the libraries they use work. Not necessarily in detail, but they shouldn't be a magic box they're helpless to understand if it isn't working right.

> it's condescending to suggest that this specific blind spot is noteworthy to the point of lacking foundational knowledge.

Possibly. I'll admit that though it seems foundationally important to my understanding of computing it may not necessarily be foundational to understanding of computing in a conceptual sense. However, it is so basic, and follows so naturally from boolean logic (which is foundational), that it is quite surprising it never came up for someone in this profession. I mean, if you already know how logic gates work it is trivial to leverage that into understanding bitwise operations.

Re:A Bit Overcomplicated by pcthrowaway on Thursday August 05, 2021 @01:09PM (#28076538)
> People should understand how the libraries they use work. Not necessarily in detail, but they shouldn't be a magic box they're helpless to understand if it isn't working right.

What I'm saying is that 'should' is unfairly prescriptive. There are things I don't understand that would be massively beneficial such as being able to understand drivers and driver code, C (we didn't learn it to any meaningful capacity in my program), and many other skills.

Fortunately, I've managed to take what I do know about computing, software, and programming, and find places I can apply that knowledge in a software engineering discipline that utilizes the knowledge I do have most effectively. Would I be able to write a driver if I was being paid to do it? Probably; there would be some learning required, maybe not even that much, but someone would be paying me to learn things outside of my general experience. I'd welcome it as well, but it just hasn't happened.

Similarly, there are people whose knowledge encompasses a subset of what I know (but possibly excluding binary and bitwise operations in totality) who are also very effective software engineers.

If you can think about browser state, reactivity, CSS specificity, the DOM, and git, you can be a very effective front-end engineer, and you never have to know much about how computers work. There are absolute wizards with 'front-of-front-end' who will be much more effective at animations, effects, device breakpoints, and visually pleasing layouts than I will ever be, who will never think about binary. And it will never be remotely relevant to them.

Re:A Bit Overcomplicated by ryandrake on Thursday August 05, 2021 @04:05PM (#28078926)
I think everyone, no matter where they are in the stack, should have at least a basic idea about how their programs eventually work. How they get turned into machine code, how that machine code gets fetched and executed, how registers work, memory accesses, RAM vs. ROM, what various caches are doing, how I/O devices work including disk, how interrupts work, how syscalls work, how memory allocation is done, what the stack is, typical segments of address space: code, data, stack, heap. I've been in the field for a few decades, but this is still kind of basic second-year compsci, right?

You don't need to be an expert at bitwise operations to grok these important concepts.

Re:A Bit Overcomplicated by pcthrowaway on Thursday August 05, 2021 @04:53PM (#28079638)
> How they get turned into machine code, how that machine code gets fetched and executed, how registers work, memory accesses, RAM vs. ROM, what various caches are doing, how I/O devices work including disk, how interrupts work, how syscalls work, how memory allocation is done, what the stack is, typical segments of address space: code, data, stack, heap

Yeah, I've learned all of this stuff ~10 years ago (in compsci also) and forgotten a lot of it due to never using it. Should I learn it again? To be honest, I'd like to, but I haven't taken the time either. I contemplated doing a deep dive the one time I've had to interview recently, but then didn't end up needing it. I'm sure if I wanted to move to a FAANG I'd need to brush up, but in the mean time I'm bombarded with plenty of things I need to learn on a regular basis to keep up with the actual technologies I work with

> but this is still kind of basic second-year compsci, right?

To be honest, I find I have a very hard time really integrating knowledge of something until I've had ample opportunity to apply it in different ways over some extended period of time. I think this was why the knowledge never stuck when I learned it in CS. There were so many things I'd cram before the test and then never need to think about again.

If I don't have the opportunity to apply these concepts, trying to really 'learn' them is a Sisyphean task for me. With enough effort and repetition I'm sure I could, but I don't agree that I should. I think your attitude really overlooks the variance in learning styles and capabilities. Not everyone can remember things they don't apply for 10 years.

Re:A Bit Overcomplicated by pests on Thursday August 05, 2021 @05:08PM (#28079866)
No, but you don't need to know them to do the front end work mentioned by OP.
Re:A Bit Overcomplicated by nomel on Thursday August 05, 2021 @03:20PM (#28078263)
> I must question the value of a "software engineer" who is working at a layer so abstracted from the reality of implementation that they don't have to understand binary.

To me it sounds like very productive work and a progression of technology. It's 2021, where 99.99% of us don't have to implement our own binary protocols, and work with computers rather than microcontrollers. If you're bit shifting, then it's most likely extremely low level work, which, as is the point of advancements in technology, is necessarily becoming more and more rare, or some case of NIH.

I do work with binary protocols, so I'm very familiar with bit shifting, but I also realize this is all grunt work that I'm having to implement due to poor vendor support of usable/no libraries.

Re:A Bit Overcomplicated by dwaltrip on Thursday August 05, 2021 @02:51PM (#28077912)
"Understanding binary" on a basic level is different than being comfortable using bitshifting / bitwise operators.
Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @03:03PM (#28078068)
...not really? Bitwise operators can be explained in a couple minutes, tops, and follow naturally from another concept everyone working in computing should be familiar with: boolean logic.
Re:A Bit Overcomplicated by CRConrad on Monday August 09, 2021 @09:51AM (#28116810)
> Bitwise operators ... follow naturally from another concept everyone working in computing should be familiar with: boolean logic.

I'd say to most people raised on "ordinary" maths they follow more naturally from quite a different concept: Moving the decimal point.

Re:A Bit Overcomplicated by AnIdiotOnTheNet on Tuesday August 17, 2021 @08:21AM (#28209069)
That only works for shifting, not the other bitwise operations.
Re:A Bit Overcomplicated by dwaltrip on Thursday August 05, 2021 @06:34PM (#28080939)
Uh yes, I’m an example of one. I’ve understood all of the operators at one point or another. I get the basic ideas. I’ve just barely used them so I would have to look them up before using them. I also don’t find the concept of bit-shifting to be that intuitive. Boolean logic is easy and a very necessary fundamental concept for all programming — I’m completely comfortable with that…

For what it’s worth, I think most people consider me a competent software engineer. I have a degree in computational mathematics from a good school.

Re:A Bit Overcomplicated by wtallis on Thursday August 05, 2021 @10:53PM (#28082782)
> I also don’t find the concept of bit-shifting to be that intuitive.

Can you clarify what you mean by this? Because the concept of shifting bits to the left or right is so simple that I don't see how it could possibly strike you as unintuitive unless you are completely unfamiliar with the idea of data being represented by a string of contiguous binary digits.

If your problem is merely that knowing what bit-shifting is does not present any obvious use cases to you, that isn't the same as finding the underlying concept unintuitive.

Re:A Bit Overcomplicated by dwaltrip on Monday August 16, 2021 @06:49PM (#28203902)
Hmmm. I'll try. I guess the main issue is that I rarely ever deal with data in binary format. The times that I've dealt with binary strings has probably been most often as binary numbers in some sort of programming or math puzzle. Thinking of it as "multiplying" or "dividing" by a power of 2 feels more natural to me than "shifting" bits left or right. Maybe this is because I was a math major instead of CS :p

If I had more experience with lower level languages and / or dealing with raw binary data formats, I probably would have internalized it better by now.

Re:A Bit Overcomplicated by Zababa on Thursday August 05, 2021 @03:24PM (#28078303)
Then why don't you spend that few minutes explaining the thing to the person you initially replied to, or link them to a resource instead of doing what you're currently doing?
Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @03:36PM (#28078469)
Because several other people already gave perfectly adequate direct responses.

Mostly what I'm doing currently is defending my level of surprise.

Re:A Bit Overcomplicated by Zababa on Thursday August 05, 2021 @03:59PM (#28078831)
That's fair. A point that I didn't see mentionned is that what seems really easy for you may not be for others. I know about boolean logic, and bits, but I'm not comfortable with bitwise operation and they certainly don't seem obvious to me. On the other hand, I have coded with other people, and was really surprised that they didn't understand a certain thing (going from for loops to map for example).

When you look at the number of programming languages and how different "idiomatic code" can be for the same task, I think it's a proof that different people think in a different way. For some low-level stuff will be very intuitive, for some it'll be functional programming, for others OO, etc.

As some other people said, CS/SWE is very wide, it's hard to know everything at any point. Add to that that for most people working with high level software, knowing more about the business gives more leverage than learning more about CS fundamentals, you end up with people knowing widely different things.

I think that in general, what's important is having a basic idea about most thing (known unknowns instead of unknown unknowns) so that you can look into stuff deeper if you need it.

Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @04:26PM (#28079267)
> That's fair. A point that I didn't see mentionned is that what seems really easy for you may not be for others. I know about boolean logic, and bits, but I'm not comfortable with bitwise operation and they certainly don't seem obvious to me.

....how in the world can that be? Bitwise operations are just the application of boolean logic to each pair of bits in the arguments. If you know what "exclusive or" means, XOR should be perfectly comfortable to you no matter how many bits are involved.

Re:A Bit Overcomplicated by Zababa on Thursday August 05, 2021 @04:54PM (#28079661)
XOR is fine, I understand how it works, though I often don't think about it in some leetcode-type exercise where a xor is the "clever" solution. Byteshift is not really intuitive to me, for example in the article, I wouldn't know if I had to shift left or right and would take a bit of time to look that up. As I said, different people think in a different way. I don't understand how people that can understand for loops don't understand map and filter, but I know that they exist.
Re:A Bit Overcomplicated by AnIdiotOnTheNet on Thursday August 05, 2021 @06:05PM (#28080599)
That's just wild to me. If I held up a card with a decimal number on it and asked you to remove the X least significant digits, would you have to look up which way to shift them?
Re:A Bit Overcomplicated by Zababa on Thursday August 05, 2021 @06:14PM (#28080709)
Yes, I would have to.
Re:A Bit Overcomplicated by wtallis on Thursday August 05, 2021 @10:57PM (#28082804)
Would you have to consult a reference in order to be able to point to the least significant digit of a number written down in front of you? Maybe the "least significant/most significant" terminology is unfamiliar enough to you to present a stumbling block. Certainly the fact that you're communicating on a written forum means you're probably comfortable and experienced reading a string of digits and knowing how to understand it as representing a quantity, even if you've forgotten the formal terminology describing that process.
Re:A Bit Overcomplicated by Zababa on Friday August 06, 2021 @01:38AM (#28083684)
No, I wouldn't have to consult a reference. What's unfamiliar to me is how exactly byteshifting allows you to take the X most significant bits from a number, although now that I've talked a bit and thought a bit about this it starts to make more sense. The thing is, I've never spent much time thinking about this, so it's unfamiliar to me.
Re:A Bit Overcomplicated by dalmo3 on Thursday August 05, 2021 @07:55PM (#28081592)
If you have a number base n, shift right/left k digits means, respectively, "divide/multiply by n^k".

That's the same whether it's decimal (n=10) or binary (n=2).

Re:A Bit Overcomplicated by pcthrowaway on Thursday August 05, 2021 @09:59PM (#28082456)
It's floor division with bit shifting though, right?
Re:A Bit Overcomplicated by devit on Thursday August 05, 2021 @05:14PM (#28079949)
It is a clear sign that the person never had any genuine interest in computing, since that would have led to learning how a CPU works (it's the most important part of a computer!) and thus its instruction set, which would have of course led to learning about binary operators and shift operators.

Instead the person clearly was motivated only by some specific application of computing or by making money.

Re:A Bit Overcomplicated by yusefnapora on Thursday August 05, 2021 @05:45PM (#28080371)
To me this reads like someone arguing that a champion race car driver must never have had a genuine interest in automobiles if they've never rebuilt an engine.
Re:A Bit Overcomplicated by foxes on Friday August 06, 2021 @03:02AM (#28084113)
Clearly you do not have a genuine interesting in computing because you do not have a complete theory of everything, unifying gravity and all the fundamental forces, so really you have no idea how computation even happens at a fundamental level.

Stop gatekeeping there’s going to be someone smarter than you.

People work at different levels.

The logic of how a huge program works can be abstracted above bit shifting. It is still computation.

Maybe try be more understanding.

Re:A Bit Overcomplicated by dwaltrip on Thursday August 05, 2021 @06:43PM (#28081023)
Talk about gate keeping…

You don’t get to decree what genuine interest in computing looks like for all of humanity.

Re:A Bit Overcomplicated by snailysnooze on Friday August 06, 2021 @02:07AM (#28083833)
Everyone thinks their work/what they know is important, that's it. Why don't study electrical engineering while we're at it. Even better, go even deeper and get us all some physics

There's a reason Randall Munroe draw that butterflies xkcd comics.

Re:A Bit Overcomplicated by afavour on Thursday August 05, 2021 @01:55PM (#28077200)
> and that computers store data in binary digits

I know that computers store data in binary digits but it has absolutely no impact on how I do my job. I'm vaguely aware of how bitwise operators work but have never had to use them in my work, only in random hacky side projects.

> like being an architect who doesn't understand trigonometry or something

I'd equate it with a an architect that doesn't know where the brick supplier they are working with sources their bricks from. It's absolute essential to the project, nothing is going to get built without the bricks. But the architect can still plan the use of those bricks and the project can be entirely successful without them needing that knowledge.

Re:A Bit Overcomplicated by stickfigure on Thursday August 05, 2021 @04:37PM (#28079398)
I'd say it's a bit more like a truck driver who doesn't know how an engine or transmission works.

Sure, you can learn the habits just fine, and maybe go your entire career without knowing what goes on under the hood. But sooner or later you're going to get stuck on the side of the road waiting for someone else to come out and fix something trivial.

Re:A Bit Overcomplicated by confidantlake on Friday August 06, 2021 @10:44AM (#28087836)
But then you can call AAA and get fixed in under a hour. I would guess the number of truck drivers that know enough about their engine or transmission to fix a trivial issue is <10%. For Uber drivers I would be flabbergasted if it was over 1%.

I actually think this is a pretty good analogy. A truck driver does not need to know how to fix their truck to do their job. A web developer does not need to know how to bitshift. For mechanics or low level programmers it is a different story.

Re:A Bit Overcomplicated by fungiblecog on Thursday August 05, 2021 @04:37PM (#28079400)
But this is like an architect trying to lay bricks without knowing how
Re:A Bit Overcomplicated by bandyaboot on Thursday August 05, 2021 @06:40PM (#28080991)
It really isn’t.
Re:A Bit Overcomplicated by WJW on Thursday August 05, 2021 @01:14PM (#28076617)
I mean, if you work as a Staff engineer in a department that only does web app development (say, working at Shopify on their rails codebase) I can easily see that you wouldn't come into any contact with bitwise operators at all. Rather, your time is probably better spent on scaling databases, refactoring codebases and other such higher-level things.
Re:A Bit Overcomplicated by wpietri on Thursday August 05, 2021 @01:58PM (#28077252)
People can understand that without knowing about bit-shift operators in a given language.

I know about them because I had to. My first computer had 4K of RAM. When I hit the limits of Applesoft BASIC, which didn't take long, I had to learn 6502 assembler. Later, I've done things like writing protocol decoders, so I've also learned them in Python.

But I think it's perfectly reasonable to have a solid career and never use these. To forget that they ever existed, because one is solving problems where they're just not relevant anymore. Our field is too big to know everything, so I think it's fine that people focus on different aspects of the work.

Re:A Bit Overcomplicated by rcurry on Thursday August 05, 2021 @04:06PM (#28078937)
Same here, I started on 6502 assembly and you had to know a lot of that stuff just because we didn’t have cool libraries like the STL and so on. You want to sort something, well you’d better write a sort routine.