When I attempt to install Microsoft Visual C++ 2010 Redistributable I get the following error.

I have an updated msvcrt.dll to replace the current one with but every time I delete/replace the old dll windows re adds the old one into the system32 folder again.
It would be useful to know the OS version you are using. Could be Windows 2000 or XP (my guess from the screenshot, but could be over RDP as well).
When
msvcrt.dllbecame a first-class citizen (i.e. a system DLL) some time during the lifetime of XP, some changes were also made to it. Incompatible changes, I should add. Example: if you built a program against the VS CRT in former times (e.g. using the WDK/DDK) you could rely on the fact that it works starting with the least common denominator of existingmsvcrt.dllversions. However, at some point MS decided that programs built to target, say, XP could rely on the new functionality that was snuck into newer versions ofmsvcrt.dll. Hence the observed incompatibility.One way to make it work could be to add a file
msvcrt.dll.localin the same folder or – failing that – to create a shim that enforced your intended behavior. See here.