News for hackers. Stuff that matters.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by fultonfaknem42 on Tuesday February 11, 2020 @12:31PM (#22300383)
I still can't believe more people aren't leveraging the Roslyn APIs to write compiler extensions or additional tools around C#. It's conceptually powerful.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by eropple on Tuesday February 11, 2020 @12:34PM (#22300412)
Personally speaking, I'd love to, but I'd then have to figure out how to make them work with an IDE. I'm very tired of waiting for record classes to show up and I could have written a (to be clear: inferior) set of stuff around regular classes that magics one into "everything is readonly and we autogenerate a `copy` method", much like Kotlin does for its data classes...but my IDE isn't gonna understand it unless I do a lot more work, and so I never bothered.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by louthy on Tuesday February 11, 2020 @02:24PM (#22301701)
I have a code-gen for records and discriminated unions [1] (as well as other useful features). It will generate a record-type at build-time (which includes the background build process in VS). All that's needed is a [Record] or [Union] attribute:

[1] https://github.com/louthy/language-ext/wiki/Code-generation

Re:How Microsoft rewrote its C# compiler in C# and made it o... by eropple on Tuesday February 11, 2020 @03:00PM (#22302171)
You just made my day. Not kidding. Thank you.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Tuesday February 11, 2020 @01:22PM (#22300996)
I'm not sure that it would be that difficult with Roslyn and Visual Studio these days. There are Roslyn-based syntax-highlighters and linters and snippet-generators and code-transformers. I use one for making sure all of my code is not just formatted the way I want it, but auto-inserting "readonly" modifiers for fields that don't get re-written outside of the constructor, one that treats not implementing IDisposable correctly as an error (it can also track the lifetime of a Disposable object and warn when it detects that it never gets disposed, which is super cool), and another one that rainbow-highlights code blocks. The tooling is there to support just a thing, it just needs someone to put all the pieces together.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by eropple on Tuesday February 11, 2020 @02:08PM (#22301538)
Hey, that's cool. Sounds like things have really improved. Maybe next time I get back into C# I'll see about writing the gizmo I want, if somebody else hasn't already. Thanks a lot.

(If somebody has--well, I wouldn't mind some lazyweb recommentations...)

Re:How Microsoft rewrote its C# compiler in C# and made it o... by thrower123 on Tuesday February 11, 2020 @01:57PM (#22301423)
What is the name of that IDisposable checking one? That sounds very, very useful.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Wednesday February 12, 2020 @11:16AM (#22310041)
I think the easiest way to set it all up is to manually edit your CSProj files, especially if you are still building .NET Framework projects. By default, Visual Studio will only create the new SDK Style project file format for .NET Standard and .NET Core projects, but it's still usable for .NET Framework projects if you manually change the format. Once you change it, it sticks, so you can use VS to edit the config after that, but it's still pretty easy to edit by hand now.

So here is my base project config: https://github.com/capnmidnight/Juniper/blob/master/Juniper....

The most important part is the first PropertyGroup sets values for all build configs, in particular is setting LangVersion to 8.0. Framework 4.8 taps out at C# 7.2, but you can use most of the C# 8.0 features, including fully async streams if you manually set the language version. Features that aren't available are some minor things like the array ranges and indexing: https://docs.microsoft.com/en-us/dotnet/csharp/language-refe...

And here are my base project with the analyzers I use: https://github.com/capnmidnight/Juniper/blob/master/Juniper....

They're all ones provided directly from Microsoft, though there are a bunch more from other vendors: https://www.nuget.org/packages?q=analyzer

Then here is an example project using that targets file: https://github.com/capnmidnight/Juniper/blob/master/src/Juni...

You can see just how much the new SDK Style project file format simplifies things. There is no importing of any base Targets files hidden deep in Visual Studio's install directory anymore.

I manually import the .props and .targets file instead of using Directory.Build.props and Directory.Build.targets because I have other projects that use these configs, included via a git submodule.

Here is my .editorconfig file, where I set most of the rules related to Disposable types to errors: https://github.com/capnmidnight/Juniper/blob/master/.editorc...

And this Visual Studio extension makes .editorconfig files a lot nicer to work with: https://marketplace.visualstudio.com/items?itemName=MadsKris...

(BTW, I pretty much install all of Mads Kristensen's extensions)

And while I'm here, I'll give a shout-out to Viasfora for its syntax highlighting modifications that rainbow-highlight code blocks: https://marketplace.visualstudio.com/items?itemName=TomasRes...

And VSColorOutput for making the Output window in Visual Studio actually readable: https://marketplace.visualstudio.com/items?itemName=MikeWard...

Re:How Microsoft rewrote its C# compiler in C# and made it o... by simplyinfinity on Tuesday February 11, 2020 @02:11PM (#22301573)
5 years ago i wrote a C# code analyzer that found/suggested and fixed async versions of EntityFramework extension methods in your async functions.

Example: if my function was async and it had a .ToList() function call inside it would suggest to use .ToListAsync() and with a click auto fix it in your function

here is the repo for reference :

https://github.com/aviatrix/YARA

It took me couple of days to wrap my head around all of the new concepts, but it was quite fun! To get it integrated with the IDE, you need "CodeAnalyzer" class, and that gets executed automagically and provides annotations in the IDE :)

Re:How Microsoft rewrote its C# compiler in C# and made it o... by ygra on Tuesday February 11, 2020 @06:28PM (#22304104)
We've written a custom compiler from C# to Java and JavaScript based on Roslyn. Over time it gained more features and target languages as well (Python is in progress, we can also emit a working GWT wrapper for the JavaScript output, we can emit TypeScript typings or just normal TypeScript as well, etc.). For us this helps us in offering our products on various different platforms without having to write the code in different places anew. Since our product is a library, not an application, we couldn't really take advantage of existing conversion tools that mostly take the path of converting IL to hideous code and an entry point.

The whole thing is now used in basically every library build we have at some point, even for the C# versions, as it ties in with our documentation writing process and places the correct API names and links for that product into the documentation, even though the docs start with mostly the same content for each.

I agree that lack of documentation makes working with Roslyn a bit daunting at times, although the API is very well designed and oftentimes it's very obvious where to look for something. I was also very impressed by their compatibility efforts. We started while Roslyn was in beta and upgrading through the releases worked without a hitch.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by fultonfaknem42 on Wednesday February 12, 2020 @08:15AM (#22308513)
I'll second the API being very well designed. It is incredibly legible from a technical perspective and it has actually been generally a joy to figure it out, as opposed to just being told how it works. That being said: I need some bathroom friendly reading material every now and again.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by tasogare on Tuesday February 11, 2020 @12:40PM (#22300494)
I looked at bit when I was in preview. It’s indeed powerful but also quite verbose and it distinguish between a lot of concepts, so there is a steep learning curve. Then there was the lack of examples beyond a few blog posts.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Tuesday February 11, 2020 @01:26PM (#22301030)
Oh man, the verbosity thing was a huge problem until C# got "using static". Any static classes that just hold static methods can be imported into your code module as bare functions. I frequently do "using static System.Math;" and "using static System.Console;" when tossing together little mathy processor apps.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by Ididntdothis on Tuesday February 11, 2020 @12:44PM (#22300531)
Agreed. I have a few ideas and it would be nice to see more examples. Right now it’s hard to make sense of things without spending a lot of time on it.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by rafaelvasco on Tuesday February 11, 2020 @01:03PM (#22300758)
At some point I wrote a barebones scripting system using roslyn for a project of mine. At runtime I got a piece of code compiled to a DLL in memory and then executed this DLL; Worked well; But at that time there was no support for destroying AppDomains or something, don't remember the exact name. Still pretty fun; But yeah, there's no real complete documentation anywhere; And the DLL hell was real. Dozens of DLL's just to support this; But now with .NET Core 3+ things must have improved a lot;
Re:How Microsoft rewrote its C# compiler in C# and made it o... by thrower123 on Tuesday February 11, 2020 @01:28PM (#22301068)
Roslyn is very powerful, but it is still pretty cumbersome. At one point I spent quite a while trying to get a game scripting system akin to the way that Lua is commonly used working, and I just couldn't get it working fast enough to be viable. I essentially wanted to have a core C# engine that provided services, and then have it call an initialization function and a gameloop function that were defined in designated script files, and then all of my game code would also be written in other scripts; this way I could run things, edit the code on the fly, and hot-reload.

It's entirely possible that I just don't know what I'm doing well enough to do this correctly, but I just couldn't get it to do the kinds of things that I wanted from it. My sense is that it is really great for injecting custom code that is used rather infrequently. I've had good results using it for building out reporting systems that are pluggable.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by fultonfaknem42 on Tuesday February 11, 2020 @01:33PM (#22301127)
I think ignorance is a pretty powerful argument to be made by any developer wanting to use Roslyn. The last few times I messed with it there was literally no documentation and everything I knew/know comes from reading headers, trial and error, and experimentation.

I feel defensive about calling it cumbersome though, and I can't imagine why something like your LUA vision isn't possible (though, I've never tried I just assumed someone would inevitably do this). For example, if World of Warcraft were to switch out their UI LUA extension system with C# I could totally imagine this being possible (though it'd be suicidal for their mod community). Likewise, if Unity were to begin using it for this kind of thing (if they don't already) I'd imagine it is possible.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by jmarolf on Friday February 14, 2020 @02:29PM (#22329493)
We have some documentation now: https://docs.microsoft.com/en-us/dotnet/csharp/roslyn-sdk/

would really appreciate bugs/comments on these docs pages of what else you would like to see.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by rafaelvasco on Tuesday February 11, 2020 @01:39PM (#22301221)
Well, it's not cumbersome at all. The problem is really lack of real documentation and most importantly real world examples; About the performance, if you use the real scripting support for Roslyn , yeah, I think you'll have bad performance. But if you compile the code to memory at runtime and execute it like I did, it's pretty fast;
Re:How Microsoft rewrote its C# compiler in C# and made it o... by eropple on Tuesday February 11, 2020 @03:18PM (#22302345)
FWIW, I wrote effectively what you describe pre-Roslyn, using the old CSharpCompiler, and it was plenty fast enough for my own developer tolerances. I ended up going to a compile-on-startup mode instead, though.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Tuesday February 11, 2020 @01:24PM (#22301009)
DLL Hell doesn't refer to "lots of DLLs", it refers to conflicting versions of DLLs not being easily manageable across multiple applications. Outside of putting assemblies in the GAC (which was always a hack of last resort anyway), .NET has never had "DLL Hell".
Re:How Microsoft rewrote its C# compiler in C# and made it o... by WorldMaker on Tuesday February 11, 2020 @01:43PM (#22301257)
Yeah, the closest .NET equivalent is Binding Redirection hell, and NuGet and Visual Studio and .NET Core have spent years of work making that better than it was at its worst in the early NuGet days. There's a couple of low level APIs that are still annoying problems to redirect if you need to support particular sets of .NET Framework and .NET Core, but beyond that a lot of it is managed for developers automatically these days.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Tuesday February 11, 2020 @02:05PM (#22301508)
Yeah, the VS interface for managing it is not great, but the new project file format is a lot easier to understand and manage, so I've had good luck just making manual changes.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by qes on Tuesday February 11, 2020 @02:06PM (#22301514)
> .NET has never had "DLL Hell"

I take it you've never worked on a .Net solution with projects targeting both full framework and Core framework.

Core v1.x stuff was a nightmare - haven't had so many issues with versioning in 20 years. Core v2.0 was still pretty bad but each v2 point release made decent strides - and specific packages would get updated out of band at times to fix issues.

But to say .Net has never had DLL Hell is just wrong. Even pre-Core you could run into difficult situations with conflicting downstream dependencies of directly used packages.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Tuesday February 11, 2020 @07:16PM (#22304437)
DLL Hell had nothing to do with project development. It was a problem of application deployment and running applications with DLLs in shared locations.

https://en.wikipedia.org/wiki/DLL_Hell

  The problem arises when the version of the DLL on the computer is different than the version that was used when the program was being created. 
Other than the GAC, which was never recommended for use anyway, .NET has never had DLL Hell
Re:How Microsoft rewrote its C# compiler in C# and made it o... by pjmlp on Wednesday February 12, 2020 @03:39AM (#22307046)
GAC was surely the recommended way until .NET 4.0, when the location changed.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by moron4hire on Wednesday February 12, 2020 @10:23AM (#22309490)
No, the recommended way was to install your application with all dependency DLLs in the application install location.

And I've misspoken about GAC causing DLL Hell for .NET. It fixed DLL Hell, but introduced a new Strong Naming Hell.

Re:How Microsoft rewrote its C# compiler in C# and made it o... by pjmlp on Wednesday February 12, 2020 @01:43PM (#22311456)
Initially that recommendation only applied to native code DLLs, not managed ones, as far as I can remember.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by rafaelvasco on Tuesday February 11, 2020 @01:35PM (#22301166)
Yeah, lots of assemblies is kinda like .NET dll hell ;) .NET Core had this problem in earlier versions. Not anymore;
Re:How Microsoft rewrote its C# compiler in C# and made it o... by fultonfaknem42 on Tuesday February 11, 2020 @01:29PM (#22301069)
Maybe Assembly unloading, in which case if you wanted to swap out new dlls in memory you'd have to tear down the process and restart it. Definitely not sexy. That being said: I think Assembly Unloading is a thing now (and AppDomains don't exist in .NET Core last I heard).
Re:How Microsoft rewrote its C# compiler in C# and made it o... by teh_klev on Tuesday February 11, 2020 @03:14PM (#22302302)
In .NET standard (i.e. not .NET Core) you can load and unload assemblies without tearing down whole processes by creating AppDomains within a process. You then load your desired assemblies into these app domain(s), consume and when you need to load say a newer DLL version you just tear down the AppDomain and create a new one for the new DLL's.

It's a feature that's been around since .NET 1.1 and I used to use heavily 10+ years ago.

https://docs.microsoft.com/en-us/dotnet/api/system.appdomain...

Re:How Microsoft rewrote its C# compiler in C# and made it o... by rafaelvasco on Tuesday February 11, 2020 @01:36PM (#22301175)
Yeah, if I remember correctly it's indeed a thing in latest versions of .NET Core;
Re:How Microsoft rewrote its C# compiler in C# and made it o... by fultonfaknem42 on Tuesday February 11, 2020 @01:48PM (#22301314)
This looks like a pretty cool demonstration of what we're talking about: https://www.strathweb.com/2019/01/collectible-assemblies-in-...

See the section titled: Collecting a dynamically emitted assembly

Re:How Microsoft rewrote its C# compiler in C# and made it o... by rafaelvasco on Tuesday February 11, 2020 @02:46PM (#22301992)
Yeah that's exactly it. Thanks!
Re:How Microsoft rewrote its C# compiler in C# and made it o... by m0xte on Tuesday February 11, 2020 @01:57PM (#22301428)
From my perspective I’d love to but from writing c# for nearly 20 years now it’s a rough ride for anyone trying to keep up with the platform. Knowledge is thrown in the trash faster than you can learn it and direction changes of all sorts jump on you. I’m not in for investing my time in that any longer.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by yonaguska on Tuesday February 11, 2020 @02:47PM (#22302011)
I don't think that's true. If you're familiar with functional programming concepts- nothing in C# is really that new. In my experience, C# is just getting easier to use as they add more language support for things you'd normally have to implement on your own.
Re:How Microsoft rewrote its C# compiler in C# and made it o... by m0xte on Wednesday February 12, 2020 @03:03AM (#22306849)
The core language is fine but the surrounding ecosystem is volatile.