Why use a shorter release time for all compression on your master?
The shorter the release time for compression, the louder a signal will be. The reason is that it takes less time for amplitude to return to normal after being compressed. Short release times cause distortion but the effect can have a beneficial result.
The distortion will amplify the signal, causing it to sound even louder, but this may not be ideal. A good mid-ground for your release time is 50ms if you do not want any distortion.
The general consensus is to use a short release time for all compression, but each compressor has its own quirks and you should experiment with the right settings.