News for hackers. Stuff that matters.
Re:Metaclasses: Thoughts on generative C++ by Animats on Friday July 28, 2017 @02:19AM (#14872365)
Are they trying to catch up to Rust while maintaining backwards compatibility? Or what?

C++ needs the full definition of a class, including its private members, before you can use its methods. This is a huge dependency headache. Most later languages have interfaces or traits or something to decouple class definition and interface definition. This looks like an attempt to deal with that. Of course, this is a retrofit, so it's going to be messy.

C++ has a lot of baggage. It may have exceeded its excess baggage allowance. The basic problem with C++ is that it has heavy encapsulation without memory safety. No other language has that. Either nothing is hidden, as with C, or the language is memory-safe, as is almost everything since C++.

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @02:27AM (#14872388)
Rust still needs to catch up with C++ in many areas, including HKT, value parameters in generics, compile time evaluation code, compilation speed at the same level as VS with incremental compilation and linking, GUI and mixed programming tooling across all major desktop OSes.

Trying to use Gtk-rs made me see that lifetimes still need a bit of ergonomics improvements for any reasonable GUI programming in Rust. In fact some of the non-lexical lifetime improvements proposal are actually the exact problem I had related to callbacks handling.

By the way, interfaces in C++ are pure abstract classes, only with pure virtual methods, without any private data.

Re:Metaclasses: Thoughts on generative C++ by Longhanks on Friday July 28, 2017 @02:48AM (#14872458)
Is GUI programming in C++ still a thing, though? On Mac, you're better of with Swift/ObjC, on Windows, there's C#, and Gtk has binding to about any language. On mobile, C++ isn't even an option.

The only thing coming to my mind is Qt, but development of Qt Widgets has basically stopped in favor of Qt Quick, and for cross platform GUIs there's other options like Xamarin or Electron (not that I'd prefer either).

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @02:54AM (#14872476)
On Windows you might have C#, but WPF and UWP lower layers are actually written in C++ and based on COM.

Xamarin uses C and C++ to bind the nice .NET code into the platforms they support.

Qt Quick is just the layout engine, many important parts of the stack keep being C++.

Apple's Metal shaders are C++14.

On Android Vulkan is only exposed to the NDK and SurfaceFlinger and hardware compositor are in C++.

Plus if you compare compare Rust with Objective-C, Swift, C#, Java, the productivity story regarding GUI programming doesn't get better than when comparing with C++, on the contrary.

Re:Metaclasses: Thoughts on generative C++ by beojan on Friday July 28, 2017 @04:00AM (#14872741)
> Qt Quick is just the layout engine, many important parts of the stack keep being C++.

Also, Qt Widgets isn't deprecated, it's just considered pretty much complete.

Re:Metaclasses: Thoughts on generative C++ by dom0 on Friday July 28, 2017 @05:58AM (#14873141)
And Qt Widgets won't be deprecated for a long time to come, if ever.
Re:Metaclasses: Thoughts on generative C++ by ygra on Friday July 28, 2017 @03:48AM (#14872684)
> On Windows you might have C#, but WPF and UWP lower layers are actually written in C++ and based on COM.

Well, this doesn't really influence the language programmers have to use to build applications, considering you can use C++, C#, VB.NET, or JavaScript to your heart's content.

Windows GDI is a C API, but not every application using it is written in C.

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @03:57AM (#14872719)
Still the issue stands, from my experience Rust isn't yet at the same productivity level as C++, C#, VB.NET, or JavaScript for writing Windows GUI based applications, both for Win32 and UWP set of APIs.

Yeah it will eventually get there, but it is a disservice to Rust to promote the language as it if was already possible today to do it, when most toolkits are still WIP and lifetimes aren't that friendly for the usual GUI coding patterns.

This will only lead to disillusion and shy away contributors that might otherwise enjoy using the language, if they understood the current state before diving in.

Re:Metaclasses: Thoughts on generative C++ by develop7 on Friday July 28, 2017 @08:25AM (#14873700)
Sure, there's C++ here and there underneath, so what?
Re:Metaclasses: Thoughts on generative C++ by whowouldathunk on Friday July 28, 2017 @11:33AM (#14874973)
> Is GUI programming in C++ still a thing, though?

All of the new Windows 10 UI is C++ (using the UWP XAML framework, which is implemented in C++). The paper says metaclasses are a way to avoid language extensions like UWP's C++/Cx, which adds C# things like "interface" and "event" to C++.

Disclosure: I work at Microsoft.

Re:Metaclasses: Thoughts on generative C++ by pas on Friday July 28, 2017 @12:16PM (#14875344)
Oh, that explains why I can't navigate in "Settings" with Alt-Left (and there's no Back button either), yet it looks like an IEView (MSWebView, Electron, etc.).
Re:Metaclasses: Thoughts on generative C++ by whowouldathunk on Friday July 28, 2017 @12:20PM (#14875391)
Alt-Left goes back in Settings for me, and there is a back button at the top left of the window.
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @11:45AM (#14875092)
Can you disclose anything about C++/WinRT?

Things went pretty silent there.

Re:Metaclasses: Thoughts on generative C++ by whowouldathunk on Friday July 28, 2017 @11:47AM (#14875118)
Don't know, but it's been discussed publicly rather recently:

https://github.com/Microsoft/cppwinrt

https://msdn.microsoft.com/en-us/magazine/mt745094.aspx

"Teams within Microsoft are already starting to use C++/WinRT to build WinRT components for the OS itself."

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @02:05PM (#14876229)
Thanks, that part I already know.

My point was more about Blend, XAML tooling support and official integration into Visual Studio.

So, all the things that C++/CX has today, but C++/WinRT was still catching up when that information was made public.

Re:Metaclasses: Thoughts on generative C++ by petters on Friday July 28, 2017 @04:09AM (#14872778)
> C++ needs the full definition of a class, including its private members, before you can use its methods. This is a huge dependency headache. Most later languages have interfaces or traits or something to decouple class definition and interface definition.

C++ has pure virtual classes, as well as the pimpl idiom. Both decouple the class definition from the interface.

Yes, they have a theoretical runtime overhead. To get rid of that, you'd need a special "sizeof" member function instead of the list of private member variables. I guess that would be possible to introduce to save compilation times.

Re:Metaclasses: Thoughts on generative C++ by taneq on Friday July 28, 2017 @07:45AM (#14873509)
> as well as the pimpl idiom

To save others the arduous trial of googling it like I had to: http://wiki.c2.com/?PimplIdiom

In the past I've sometimes taken this a step further and defined a pure abstract class plus factory function in the header and then defined a derived implementation class in the source file, kind of a COM lite approach. (Is there an agreed name for this pattern? I don't doubt that, like most things I've invented, it was first thought of in the '60s or '70s. :P )

It's good for libraries because it separates all implementation details from the public interface while adding very little overhead for the library dev. Not so good for smaller utilities which are more natural as header-only classes, though.

These days I don't bother with that kind of messing around until it actually becomes necessary, which it almost never does. I feel like my code's become way simpler over the years.

Re:Metaclasses: Thoughts on generative C++ by Someone on Friday July 28, 2017 @02:35PM (#14876458)
"Is there an agreed name for this pattern?"

I wouldn't know, but some Dylan book taught me that, along the abstract-concrete dimension, there are not two, but three kinds of classes:

  - concrete, instantiable
  - abstract, instantiable
  - abstract, not instantiable
where a type <foo> is instantiable if a function make(<foo>) exists (because <foo> is abstract, that function must return an instance of a subclass of <foo>)

That factory function makes your abstract class instantiable.

Also, in Java, Foo would be an interface, and that factory would be a FooFactory.

Re:Metaclasses: Thoughts on generative C++ by eej71 on Friday July 28, 2017 @06:45AM (#14873288)
Rather than specifically single it out as "trying to catch up to Rust", I'd say that C++ is doing what it has always been doing. Reaching for the future while maintaining backwards compatibility. It's been a great strategy for 30 years and I hope they keep at it.
Re:Metaclasses: Thoughts on generative C++ by nemaar on Friday July 28, 2017 @07:38AM (#14873481)
>It's been a great strategy for 30 years and I hope they keep at it.

I wouldn't say that it's been great. The evolution of C++ is insanely slow.

Re:Metaclasses: Thoughts on generative C++ by eej71 on Friday July 28, 2017 @08:01AM (#14873578)
Perhaps. It's like that old joke about perspective. The length of a minute depends on which side of the bathroom door you're on. :-)

From my standpoint, I'm _still_ trying to get my head around all the ramifications of what has arrived in C++-11 (and it's a lot!). And I still have '14 and '17 to plow through too. '20 will be here before I know it. So for me, there is so much to absorb.

To my eyes the C++ leadership has done a great job at setting up standards processes for regularly delivering new versions and the compiler community has done an amazing job at keeping up too.

I expect to see more movement in the world of standard libraries which is where C++ still feels like a desert compared to other languages.

But yes it definitely is not fast when compared to other newer language communities.

Re:Metaclasses: Thoughts on generative C++ by dom0 on Friday July 28, 2017 @09:22AM (#14874033)
> The evolution of C++ is insanely slow.

The only language today with more independent implementations than C++ is C. Compared to C, C++ evolution is not slow — processes involving so many implementers are inherently not in fast-forward mode.

Most major languages only have a handful of active implementations, if it's not just one implementation. Most don't have specs.

Re:Metaclasses: Thoughts on generative C++ by ThatGeoGuy on Friday July 28, 2017 @01:10PM (#14875780)
I would argue that you're eschewing Lisp and Scheme in terms of independent, active implementations, however in a more general sense I agree.

Moving fast (and breaking things) is just not what the standardization committee does, and that's fine. They can move faster since C++11/14, but sometimes you really don't want a giant moving target with new features all the time. I think their approach works for the kind of environment you find C++ used in.

Re:Metaclasses: Thoughts on generative C++ by lallysingh on Friday July 28, 2017 @07:05AM (#14873343)
.. And that future is defined as "rust"
Re:Metaclasses: Thoughts on generative C++ by dsacco on Friday July 28, 2017 @07:42AM (#14873499)
Once again: there is plenty of room for both Rust and C++. One language does not need to "win."

The Rust community doesn't endorse your flavor of evangelism here. It's not a holy war.

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @11:50AM (#14875133)
Exactly, and even if I complained about the current ergonomics of lifetimes, the amazing work of Rust developers is already influencing design decisions on Haskell, Swift, .NET, Pony and C++ regarding resource management.
Re:Metaclasses: Thoughts on generative C++ by dsacco on Friday July 28, 2017 @02:47PM (#14876535)
Any chance you could throw up an email for me to contact you, or use the one in my profile? I'd be interested in chatting with you "offline" as it were.
Re:Metaclasses: Thoughts on generative C++ by eej71 on Friday July 28, 2017 @07:51AM (#14873537)
While your comment is a bit snarky, there is some truth to it in that if rust successfully evangelizes a technique, I'd expect the C++ world to bring it on board if there is room and I'm sure room can be found.

The one topic to consider is this - is there a world where a language's existing code base is so large and the community so diverse that even _you_ would hesitate to break things for them? And at the same time, doesn't it make sense for that community to keep marching forward?

Yes the language has baggage and the path forward isn't easy, but there are still paths ahead for C++.

My advice to the rust community. Model yourself after the C++ strategy of evolution. Do not repeat the mistakes of the Python 2->3 world or the perl 5->6 world or what appears to be happening to Go. Don't break the past.

Re:Metaclasses: Thoughts on generative C++ by steveklabnik on Friday July 28, 2017 @10:34AM (#14874515)
In general, Rust is modelling ourselves after that. There was even a recent RFC to explicitly move to a model of language change after the C++ model, but people are concerned that it breaks too much.

https://github.com/rust-lang/rfcs/pull/2052

Re:Metaclasses: Thoughts on generative C++ by panic on Friday July 28, 2017 @02:48AM (#14872459)
This proposal isn't about adding interfaces to C++: it's about removing boilerplate through compile-time metaprogramming during the class definition process.
Re:Metaclasses: Thoughts on generative C++ by justicezyx on Friday July 28, 2017 @02:25AM (#14872380)
> full definition of a class

Pointers and virtual class, why do you need the definition to use the interface? Could you provide more details?

> The basic problem with C++ is that it has heavy encapsulation without memory safety.

It's pretty simple to write memory safe code in c++, and encapsulation is a feature that not mandated in c++ code.

Re:Metaclasses: Thoughts on generative C++ by adrianN on Friday July 28, 2017 @02:28AM (#14872390)
Pointers and virtual classes have runtime overhead.

It's not simple to write memory safe code in C++, otherwise we would have a lot fewer vulnerabilities in C++ codebases.

Re:Metaclasses: Thoughts on generative C++ by _pmf_ on Friday July 28, 2017 @02:36AM (#14872416)
> It's not simple to write memory safe code in C++, otherwise we would have a lot fewer vulnerabilities in C++ codebases.

Using the STL after using Java collections or Qt collections is a shock. I think there really needs to be a "Safe STL" in addition to "Performant STL" that performs range checks. You simply cannot recommend using the STL for safe code.

Re:Metaclasses: Thoughts on generative C++ by duneroadrunner on Friday July 28, 2017 @03:45AM (#14872670)
> I think there really needs to be a "Safe STL" in addition to "Performant STL" that performs range checks.

SaferCPlusPlus[1] provides compatible, memory-safe versions of the most commonly used STL containers. (The compiler switches mentioned by others add range checking, but do not, for example, catch use-after-free bugs.)

> > It's not simple to write memory safe code in C++, otherwise we would have a lot fewer vulnerabilities in C++ codebases.

Using SaferCPlusPlus, it now is simple to write memory-safe code in C++. And it's not much different from writing traditional (unsafe) C++ code.

[1] shameless plug: https://github.com/duneroadrunner/SaferCPlusPlus

Re:Metaclasses: Thoughts on generative C++ by signa11 on Friday July 28, 2017 @03:10AM (#14872535)
> I think there really needs to be a "Safe STL" in addition to "Performant STL" that performs range checks.

indeed. for gcc, you can compile stuff with '-D_GLIBCXX_DEBUG' to enable random-iterator bound checks. moreover, random-access-iterators do have the 'at(...)' stuff available for bounds checked access to the containers.

but, yeah, a standardized way would be very useful.

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @03:14AM (#14872554)
Visual C++ on debug mode also enables iterator validation and bounds checking for arrays and strings.

It is also possible to explicitly enable them in release code.

https://blogs.msdn.microsoft.com/vcblog/2017/06/28/security-...

Re:Metaclasses: Thoughts on generative C++ by zvrba on Saturday July 29, 2017 @01:44AM (#14879722)
> Using the STL after using Java collections or Qt collections is a shock.

Why?

I prefer having a free-standing generic find function as opposed to it being implemented in each and every container. Even better example: copy. You can use it with containers, but also with input/output streams (using stream iterators).

You mentioned safety, is iterator invalidation bothering you?

Re:Metaclasses: Thoughts on generative C++ by nicwilson on Friday July 28, 2017 @05:49AM (#14873107)
You can't do that with C++'s "3-legged" algorithms. the begin - end - begin triplet is missing the second end.
Re:Metaclasses: Thoughts on generative C++ by sideshowb on Friday July 28, 2017 @03:50AM (#14872688)
> Pointers and virtual classes have runtime overhead.

Most popular languages don't allow putting objects on the stack and thus have at least comparable overhead anyway.

Re:Metaclasses: Thoughts on generative C++ by justicezyx on Friday July 28, 2017 @11:12AM (#14874804)
> Pointers and virtual classes have runtime overhead.

If you are sensitive to these overhead, you pretty much already only have C++ as your only choice. Or maybe Rust, but I do not know rust well to comment if Rust does not have such overhead.

> It's not simple to write memory safe code in C++

No, in C++11 or newer, memory safe code is the default. That's the design goal of the newer standards of C++. IMHO, memory safety is no longer a central issue for C++.

> a lot fewer vulnerabilities in C++ codebases.

This only applies to legacy code.

Re:Metaclasses: Thoughts on generative C++ by steveklabnik on Friday July 28, 2017 @11:42AM (#14875060)
Rust doesn't have classes, and therefore doesn't have virtual classes. So it ends up being different. Dynamic dispatch is used pretty rarely in Rust.

If you want dynamic dispatch, you don't use a virtual class, you use a "trait object". Basically it's a double pointer: a (pointer to vtable, pointer to data). Technically the C++ standard (as far as I know) doesn't define the exact implementation of this stuff, but in my understanding the vtable pointer is stored with the data.

There are pros and cons to each approach.

Re:Metaclasses: Thoughts on generative C++ by justicezyx on Friday July 28, 2017 @12:41PM (#14875527)
> If you want dynamic dispatch, you don't use a virtual class, you use a "trait object".

Is this referring to Rust? Then it sounds like it will have similar overhead as C++'s virtual functions.

Re:Metaclasses: Thoughts on generative C++ by steveklabnik on Friday July 28, 2017 @12:51PM (#14875618)
Yes, it is, and yes, it does. There are small differences due to the stuff I said above, but it's similar.
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @02:33AM (#14872403)
It is quite simple to write safe C++, when people don't treat the language as if it was a nicer C.
Re:Metaclasses: Thoughts on generative C++ by adrianN on Friday July 28, 2017 @03:09AM (#14872529)
If it were simple why is approximately nobody managing to do it? Do you think that they don't care?
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @03:21AM (#14872577)
Yep, they just don't care and keep throwing pointers instead references or std::vector/array, #define instead of const, char* instead of std::string and so on.

I have been preaching how to write proper C++ code vs "nicer C" since the late 90's, but without much success, specially to enterprise developers.

Many of the so called modern C++ features were already possible with C++98.

As a good example, MFC 1.0 could have been like Turbo Vision, OWL, VCL, Qt and so on, but the test group from Microsoft found Afx too high level and wanted just a thin layer over Win16 thus it was reborn as MFC.

Re:Metaclasses: Thoughts on generative C++ by seanwilson on Friday July 28, 2017 @04:48AM (#14872894)
> Yep, they just don't care and keep throwing pointers instead references or std::vector/array, #define instead of const, char* instead of std::string and so on.

> I have been preaching how to write proper C++ code vs "nicer C" since the late 90's, but without much success, specially to enterprise developers.

In no practical sense is it easy then. Even if you find it easy to write perfect code, you still have to work with other people that don't and use libraries which have problems.

C++ has so many ways to shoot yourself in the foot I literally cannot think of a mainstream language that is actually more difficult to master. Would you say it was easy compared to Python, Java or JavaScript to write safe code in? Those languages have no undefined behaviour and they all have automatic memory management compared to C++.

Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @05:06AM (#14872948)
It is harder yes, and actually nowadays I spend most of my time on Java/.NET, just diving into C++ for system stuff.

However, the mechanisms for safer code are there, if one cares to use them in first place.

The usual set warnings as errors, CI build with static analyzers that break on failure, unit tests with sanitizers that break on failure.

But many companies don't care to set this workflow.

They also don't care for doing that for Python, Java or JavaScript as well.

JavaScript might have automatic memory management, but it has its own collection of WTF moments and implementation issues across browsers.

Java is way better, yet there is a reason why Java Puzzles are so entertaining.

While a tracing GC is much more productive than RAII/smart pointers, sometimes you also need to track down those references that prevent the collector to do its job.

Android developers have lots of "fun" doing that regarding context and activities.

One should not forget that safe languages only get us free from memory corruption, regarding safe code. There is still the whole spectrum of logical errors, specially bad in dynamic languages.

In any case, until we finally get a mainstream OS written in Swift, .NET Native, Rust or D, we need to make the best use of our tooling for low level system coding activities and in this regard C++ is so much better than C.

Re:Metaclasses: Thoughts on generative C++ by seanwilson on Friday July 28, 2017 @05:43AM (#14873092)
I agree tools and workflows exist to make it easier to write good C++ code but it's still an order of magnitude harder to do this compared to other languages. I'd only use C++ if there was no other practical choice. It's simply far too much effort to make your code robust.
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @05:48AM (#14873106)
So what is your alternative when you need C++ like features for systems coding, C?!

Because as much as I would like to use a safer alternative like Swift, D or Rust, as an ex-Pascal/Oberon user, they aren't there yet.

Re:Metaclasses: Thoughts on generative C++ by adrianN on Friday July 28, 2017 @08:28AM (#14873710)
There is always Ada if newer languages are not there yet for your application.
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @08:43AM (#14873790)
Ada is only a solution if it can fulfill the project requirements regarding the libraries, tooling, supported CPUs, OSes and IDEs.
Re:Metaclasses: Thoughts on generative C++ by adrianN on Friday July 28, 2017 @09:15AM (#14873998)
Sure. But now you're retreating to a rather small set of applications. Ada has nice tooling and supports a pretty large number of platforms. I don't think you'll find many niches where not one of Rust, D, Swift, Ada, Java, Go, or the dozens of other memory safe(r) languages could do the job and only C or C++ are adequate.
Re:Metaclasses: Thoughts on generative C++ by pjmlp on Friday July 28, 2017 @09:53AM (#14874261)
Practical example, we use C++ as systems language for projects done in Java (Standard, Android), .NET (WPF, UWP, Xamarin), Swift/Objective-C (iOS).

There isn't much Ada tooling available for those environments, and even using GNAT would be increasing project costs regarding having to implement ourselves stuff that we get for free with the SDK tools that support C++ out of the box.

Re:Metaclasses: Thoughts on generative C++ by gpderetta on Friday July 28, 2017 @05:50AM (#14873114)
> Many of the so called modern C++ features were already possible with C++98.

exactly! C++11 only made it more pleasant to write.

Re:Metaclasses: Thoughts on generative C++ by zvrba on Friday July 28, 2017 @03:43AM (#14872660)
> otherwise we would have a lot fewer vulnerabilities in C++ codebases.

Are you sure you're not referring to _C_ codebases?

Re:Metaclasses: Thoughts on generative C++ by adrianN on Friday July 28, 2017 @03:45AM (#14872669)
Yes. All the popular browsers are mostly C++ for example.
Re:Metaclasses: Thoughts on generative C++ by saurik on Friday July 28, 2017 @07:59AM (#14873570)
> C++ needs the full definition of a class, including its private members, before you can use its methods.

This is more a limitation of the ABI than the language (and even then, only comes up if you are using multiple inheritance or have private virtual functions). Objective-C had the same problem, and then they introduced the non-fragile ABI: no language change was needed, just a compile flag.

(I do realize that there is some awkwardness in C++ if you attempt to declare these things in that private-decoupling sense; but to me the reason this is most brutal is not hiding of state, where we have solutions already, but being able to add and remove members without having to recompile users.)

Re:Metaclasses: Thoughts on generative C++ by yoklov on Friday July 28, 2017 @03:00AM (#14872499)
> The basic problem with C++ is that it has heavy encapsulation without memory safety. No other language has that.

I think in general these things are unrelated, unless you stretch the definition of memory safety rather far.

Also, you can hide things in C, just it's not always zero cost. Put private fields in a forward declared struct that's not implemented in any headers, use static for private functions (also outside of headers).

Re:Metaclasses: Thoughts on generative C++ by misil on Friday July 28, 2017 @03:41AM (#14872654)
>catch up to Rust This proposal has nothing whatsoever to do about any Rust feature. It's about compile-time metaprogramming on steroids.
Re:Metaclasses: Thoughts on generative C++ by steveklabnik on Friday July 28, 2017 @10:36AM (#14874530)
It is similar to several Rust features, but has its differences, as you'd expect. They're also in-development features, so I agree that "catching up to Rust" feels like a bad way to frame this.
Re:Metaclasses: Thoughts on generative C++ by _pmf_ on Friday July 28, 2017 @02:29AM (#14872393)
> C++ needs the full definition of a class, including its private members, before you can use its methods.

Is that true when using virtual methods from some virtual base class on an object created elsewhere?

Is this problem solvable at all without specifying the ABI?