Enabling software rendering has fixed the leak. In each Window_Loaded event I'm now enabling software rendering using the following code.