News for hackers. Stuff that matters.
Re:The accidental HFT firm by lmm on Wednesday January 24, 2018 @10:52AM (#16223591)
> The sign of a good developer is attempting to look ahead and wonder how else will data need to be presented and manipulated - building the system open-ended enough to allow for the evolution of business needs.

I've gradually become convinced of just the opposite: a good developer doesn't think ahead at all. The best way to prepare for the evolution of business needs isn't to add extension hooks in the middle of your code, it's to keep the code as simple as possible so that you can change it in a very direct way as and when you need to.

Re:The accidental HFT firm by arethuza on Wednesday January 24, 2018 @11:34AM (#16224010)
I've convinced that 95% if the "extension points" I've seen built into code over the years never get used to create extensions - usually because they have significant assumptions about what extensions would be required that turn out to be very wrong.
Re:The accidental HFT firm by hinkley on Wednesday January 24, 2018 @12:17PM (#16224349)
There are subtle ways to add extension points that most people won’t even notice.

For instance, putting related code into a data structure allows you to add more to it later without replumbing the whole system (as opposed to functions with five arguments).

With enough experience with refactoring, just choosing a structure that’s easy to refactor can serve as an extension point. (I have even tricked people into implementing a feature the way I had it in my head by writing the intermediate version in such a way to suggest a simple change for part 2.)

Re:The accidental HFT firm by mickronome on Wednesday January 24, 2018 @03:33PM (#16226052)
Never add any extension points you don't already need, but design as if you could suddenly be tasked with adding all kinds of weird ones, but mostly without spending any significant time.

Try to make sure that reasonable extensions are cheap to add, and that even some of the more unreasonable ones are at least possible without complete system redesign.

This should not significantly impact either implementation time, or design time. But it will almost certainly make you avoid some really bad design choices that make quite plausible changes extremely expensive.

Good design is more about avoiding obvious traps than finding a path to nirvana.

Re:The accidental HFT firm by kbenson on Wednesday January 24, 2018 @11:56AM (#16224174)
It's not always about a hook, sometimes it's about where yo break into subsystems and subfunctions. Breaking it up at the right point allows for easy extension through writing new components later, while requiring the least amount of modifications to the production code (and thus hopefully less bugs introduced into working code-paths). Additionally, how you represent your data may allow for easier extension of the data type or additional, related data type processing later.

I do a lot of data mining, and the first step is always securing the data source and archiving it. There have been times where I wasn't able to revisit the project and finish the actual parser of the data for 5-6 months, at which point I can run through the old data. Other times, I'll write the parser but we'll only be parsing a subset of the data we acqiured. The additional unparsed portionisn't necessarily without merit, it's just not something we are dealing with yet (either because it's still of an unknown quality, or requires more effort than we want to spend at that moment). Knowing it's there and that it may need to be parsed in the future can subtly affect your design such that you leave yourself the openings you'll later need to easily parse this additional data. Sometimes that's as simple as just avoiding situations that would make it extremely cumbersome later, and not necessarily actively making it easier.

I'm not sure ignoring something as obvious as this makes one a good developer, but what's "obvious" and what isn't is actually quite different at different software engineering experience levels.

Re:The accidental HFT firm by hderms on Wednesday January 24, 2018 @10:55AM (#16223621)
I agree in the sense that your system will be the most flexible provided you use composeable and easy to understand code as much as possible. Overengineering is overengineering because it trades complexity for "flexibility" but the real goal is to keep complexity down as much as possible.
Re:The accidental HFT firm by mickronome on Wednesday January 24, 2018 @03:23PM (#16225972)
Depends on which meaure of good in use obviously, but I have never seen anyone capable of being efficient over significant time spans without in some way having design and architecture be guided by principles that balance cost of change, cost of implementation, and difficulty of understanding.

Ignoring cost of change can be absolutely devastating in the long run, but believing you can somehow scry the future for all possible extension points necessary is equally so.

Designing for (anticipated) change in my mind is not at all about adding hooks, API's, or any code at all for that matter.

I think of it more like making sure your system respect analogues to gravity and the other natural laws as best translated into the more abstract relations relevant for the particular kind of system you are building.

One could call it programmer and refactoring friendly design and not miss the target by much.