Is Managed Code (.NET/Java) Slow?

Software applications are getting more and more complex and each platform for developing applications these days seems like its operating on a higher and higher level of abstraction to hide that complexity from the developer.

In particular, when I say “a higher level of abstraction”, I am talking about “managed languages”. “Managed code” is a term coined by Microsoft to identify computer program source code that requires and will execute only under the management of a Common Language Runtime (virtual machine), typically the .NET Framework, or Mono. However, this also applies to frameworks such as Java and the JVM (Java Virtual Machine). The individual VMs differ from each other, but the core concept of “managed code” remains the same.

I am a big fan of languages/platforms that allow you to operate at a high level, handle your memory management, transform and optimize your code for the hardware it is running on, and much more.

However, I am always questioned from other developers with “Aren’t managed languages slow? Shouldn’t we use C++ for everything?”

It seems to me that this layer of management between your program and the computer’s processor can be a major source of anxiety for developers who assume that it must add some significant overhead.

There are many unfortunate stereotypes in this world. One of them, sadly, is that managed code cannot be fast. This is just not true. What is closer to the truth is that the CLR (Common Language Runtime) or the JVM (Java Virtual Machine) makes it very easy to write slow code if you are sloppy and not careful.

When you build your C#, VB.NET, or other managed language code, the compiler translates the high-level language to Intermediate Language (IL) and metadata about your types. When you run the code, it is just-in-time compiled (“JITted”). That is, the first time a method is executed, the CLR will invoke the compiler on your IL to convert it to assembly code (e.g., x86, x64, ARM). Most code optimization happens at this stage. There is a definite performance hit on this first run, but after that you will always get the compiled version (there are ways around this first-time hit when it is necessary).

In my experience with .NET/Java the overhead is worth it, and the supposed performance degradation is almost always exaggerated. Often, the performance problems developers blame on .NET/Java and other managed languages are actually due to poor coding patterns and a lack of knowledge of how to optimize their programs on this framework.

Skills gained from years of optimizing software written in C++, C, or VB may not always apply to managed code, and some advice is actually detrimental. Sometimes the rapid development nature of .NET/Java can encourage people to build bloated, slow, poorly optimized code faster than ever before. Certainly, there are other reasons why code can be of poor quality: lack of skill generally, time pressure, poor design, lack of developer resources, laziness, and so on.

The bottom line is that the amount of performance optimization you get out of your application is directly proportional to the amount of understanding you have not only of your own code, but also your understanding of the framework, the operating system, and the hardware you run on. This is true of any platform you build upon.

As most things in life, managed code has its pros and cons and obviously is not a silver bullet. Pros being that the developer can focus on what is important to the business and business logic rather than the details of worrying about pointer addresses and thread management. Some of my favorite advantages managed code provides over it’s unmanaged brethren are as follows:

  1. Advanced Language features – Delegates, anonymous methods, and dynamic typing.
  2. Automatic memory management – I think this speaks for itself…
  3. Easier extensibility – With reflection capabilities, it is much easier to dynamically consume late-bound modules.
  4. Safety – The compiler and runtime can enforce type safety (objects can only be used as what they really are), boundary checking, numeric overflow detection, security guarantees, and more. There is no more heap corruption from access violations or invalid points.

Of course its not all rainbows, butterflies , and unicorns (that would be nice). The cons for manage code are that operating at this level requires understanding the platform that you are running on and how it handles some of the lower level details for you and recognizing how to use the platform to suite your individual needs. Understanding how to optimize your code for the best performance can sometimes be more complicated with managed code if you are not familiar with performance optimization on these platforms.

Performance optimization can mean many things, depending on which part of the software you are talking about. In the context of managed applications, think of performance in four layers (in order of greatest potential impact):

  1. Algorithms – Here is where your computer science fundamentals come into play. Remember asymptotic time complexity and analysis of functions as their input approaches infinity? This is where the most time is either gained or lost in programming. (If you aren’t familiar with asymptotic time complexity and “Big-O”, there’s a post for that)
  2. Framework – This is the set of classes provided by the platform owner (Microsoft .Net Framework libraries, or the Java Standard Edition libraries) that provide standard functionality for things like strings, collections, parallelism, or even full-blown sub-frameworks like Windows Communication Foundation. You need to understand how to use your preferred framework and be familiar with most of its APIs.
  3. CLR/JVM – Below the Framework is the virtual machine that is running your managed code. Understanding how this is implementing and how it works will provide the next level of potential performance gains.
  4. Assembly Code – This is where the code hits the metal, so to speak. Once the CLR/JVM JITs the IL/byte code you are actually running processor assembly code. If you break into a managed process with a native debugger, you will find assembly code executing. That is all managed code is – regular machine assembly instructions executing in the context of a particularly robust framework.

Remember that when doing performance analysis, you should always start at the top layer and move down.

Make sure your program’s structure and algorithms make sense before digging into the details of the underlying code. Macro-optimizations are almost always more beneficial than micro-optimizations.

If you liked this post, please share it, like it, or subscribe to my blog Doing so helps me decide what is the best content to post and deliver to all you reading! Thanks again, and have a great day!

2 responses to “Is Managed Code (.NET/Java) Slow?”

  1. I’m having a hard time getting past the image you used in the header of this article. The single character variable names alone piss me off, not to mention lack of comments or white-space. If I had a programmer on my team writing code that looked like that, I’d fire them. But, there’s all these graphics design folks that like to make images of code like this … “ooohhh.. look how complicated it looks! All those c.a=x*a.r … return c” YEAH! Because some idiot MADE it look complicated with crappy coding ethics and no coding conventions followed.

  2. Ok, writing a real comment about your article (and not just on the image)…

    Managed code is to programming what Blogs are to Journalism. By lowering the bar to entry, you end up with a ton more folks getting into programming. But, these folks may not have been officially trained in how to do GOOD programming. So, as more and more managed coding gets adopted, we see more and more code monkey work getting cranked out. And since it’s done in managed code, the managed code gets a bad name.. not the bad programming.

    This boils down to lack of design training.

    A lot of people thinking learning to program is just learning the language. But, that would be like saying learning to write is just about learning the letters. There is a massive leap from learning letters to learning how to write like Shakespeare.

    But, many companies don’t have the chops to understand this. A lot of folks in charge and making hiring decisions are often non-technical folks. “You know how to write code. You’re a programmer.” Well… yeah, in a sense. They can program. But, again, it’s like saying “you know how to write letters.. you’re a writer.”

    Colleges were getting blasted for moving from C++ training over to C# and Java training for the past decade or two, b/c everyone was bemoaning how managed code was bloated and added overhead, etc, etc. They’re getting blasted for shifting from Java to Python now (b/c even Java is overly-complicated for some folks… eg: business majors that are learning programming as a side thing to enhance their skills).

    But, colleges have moved on to managed code languages b/c people can get taught the language quickly.. and then the college and quickly move on to teaching them Systems Design. This is the thing a lot of “self-taught” folks are missing. They just get a book on C# or Java and learn the language, but they havent’ had any proper systems design training at all. So, they just keep writing bad code.. just in a new language.. a managed language.

    This is the massive growing pain that the IT / IS industry has been going through for the past 25 years or so. Java came out, .NET came out… and programmers that were using C++ shifted over, and maybe they already had good systems design ideology under their belt, so they were able to make good systems faster using managed code.

    But, there were code monkeys in the C++ days.. and all they did was shift to Java and .NET, and brought along their code monkey skills just flinging crap everywhere… but now more quickly due to a managed language.

    And, since managed code lowered the bar for entry.. there was a massive wave of new programmers showing up in the JAVA and .NET world… and they got in b/c Java and NET made “coding easy”… yeah.. coding was easy now (no dicking around with pointers and other weird crap)… but they had NO design training. So, they just bloated up the pool of code monkeys we have around… and they were exponentially adding to the amount of monkey poop being flung around.

    These days, we have enough old salty programmers combined with academics and business folks saying “you need design skills… go learn some” that they’re starting to weed out the code monkey pool… by either not hiring code monkeys (coding skills alone won’t get you hired) and thus they leave the industry.. or forcing them to upgrade their skillset with good design principles.

    We’re also seeing a rise in project management skills… a guy running a programming dept or project can’t just be a CS major… they need to have project / program management skills today as well… like… REAL PM skills taught from a school, not just “oh, I read a book on that once”. Some industries force their project and program managers to go out and get PMP certified…. and the software industry is starting to follow suite.

    So, better project management skills + better design skills = better managed code written + better systems designed.

    It’s just there’s a HUGE mess of monkey poop written in managed languages that has to get cleaned up retroactively.

    However… I still believe that while managed code can crank out good stuff quickly, really base things should get revisited and analyzed to see if writing them lower-level could bring out more performance… especially in the OS realm. I think Microsoft has an over-reliance on managed code to quickly crank out more features for Windows. But they never seem to get around to revisiting the stuff to see if some of it could get pushed further down towards the machine to increase performance. They will kit-bash together something and say “here’s the prototype!”.. but in the business world, execs will take the prototype / band-aid.. and run with it as the full product. So, programmers that ad-hoc’ed something together to solve a problem or show-case a new feature.. get stuck baby-sitting the crappy prototype they created without a chance to redo it properly. “I wrote that in 2 days! I thought they just wanted a demo, but they took it and are using it like the actual solution! WTF?!” This ends up with “frankenstein’s monster” really fast, as all kinds of junk gets kit-bashed together…and not integrated well at all… so you may have components written well in managed code (or not), but dont’ play nice together.

    So, yeah.. managed code got a bad rap, b/c it lowered the bar of entry for folks to use it.. and a bunch of folks started using it poorly b/c they didnt’ have the high-level design skills to use it right.

Leave a Reply