The best way to edit/change those images is using WSB. Simply Open msstyle in WSB down below is location for image edit/change click on Save and that's it.

The location for that image is: Windows and Caption Buttons>Aero>DWM Windows>Frames>Controls>Captions>Window>Close Button

Hope this helps.