I'll also add that if your charging handle is superficial (some M4 bodies instead require you to open the dust cover with your finger and close by themselves) you could always opt to remove the spring altogether and fix the handle in place some other way.
Someone should do a poll to see how many impatient and acoustics-sensitive gun docs remove their bolt release levers from M4s for this exact same reason
