Question

I’m writing a DSP application in C# (basically a multitrack editor). I’ve been profiling it for quite some time on different machines and I’ve noticed some ‘curious’ things.

On my home machine, the first run of the playback loop takes up about 50%-60% of the available time, (I assume it’s due to the JIT doing its job), then for the subsequent loops it goes down to a steady 5% consumption. The problem is, if I run the application on a slower computer, the first run takes up more than the available time, causing the playback to get interrupted and messing the output audio, which is unacceptable. After that, it goes down to a 8%-10% consumption.

Even after the first run, the application keeps calling some time-consuming routines from time to time (every 2 seconds more or less), which causes the steady 5% consumption to experience very short peaks of 20%-25%. I’ve noticed that if I let the application run for a while these peaks will also go down to a 7%-10%. (I’m not sure if it’s due to the JIT recompiling these portions of code).

So, I have a serious problem with the JIT. While the application will behave nicely even in very slow machines, these ‘compiling storms’ are going to be a big problem. I’m trying to figure out how to resolve this issue and I’ve come up with an idea, which is to mark all the ‘sensible’ routines with an attribute that will tell the application to ‘squeeze’ them beforehand during start-up, so they’ll be fully optimized when they’re really needed. But this is only an idea (and I don’t like it too much either) and I wonder if there’s a better solution to the whole problem.

I’d like to hear what you guys think.

(NGEN the application is not an option, I like and want all the JIT optimizations I can get.)

EDIT:

Memory consumption and garbage collection kicks are not an issue, I’m using object pools and the maximum peak of memory during playback is 304 Kb.

Answer 1

You can trigger the JIT compiler to compile your entire set of assemblies during your application’s initialization routine using the PrepareMethod … method (without having to use NGen).

This solution is described in more detail here: Forcing JIT Compilation During Runtime.