I get good results with my RKII by placing all my channel volumes at 12 o clock and then equalizing them with each other (really only necessary with the Modern mode as it increases the negative feedback). Then I adjust the whole amps volume with the output volume.
One way of thinking of a volume control is as an attenuator. Volume (and gain) controls typically don't adjust how much gain gets through each amplification stage. They adjust the level of the signal before or after the stage. So, if you turn down the channel volume and turn up the master volume, here is what is happening. You reduced your signal and then amplified it, so noise is going to go up. It's like turning your volume control on your guitar down and turning the amp up to get the same signal, right? So if you turn your guitar volume up and turn your amp down, it's going to have a lesser amplitude of noise getting into your signal. But if you play with the balance there, you can tune how hard the next gain stage is going to get hit before it gets amplified. I would recommend you play and learn the relationship between the master volume, channel volume, and gain controls on your amp to help appreciate this. Just set the EQ to something reasonable (maybe bass on 10-12 o clock, mids on 9 o clock and treble around 1-2 o clock).
That being said, you should definitely try turning your master volume down and then cranking the channel volumes to their max (especially in channels 1 and 2) and try that out for size. I love that sound in channel 2 brit mode. What that does is completely overdrive all the gain stages before the output.
And if you don't already know this, use the Bass control to adjust how "tight" the amp tracks your guitar playing especially with the saturated settings. The Recto sound is already pretty loose to begin with, so reducing that helps keep your sound from slowing down. It's super apparent when compared to a fast amplifier like the Mark V IIC+ mode. A good way to check for the right setting is to palm mute your guitar until you hear the flubbiness disappear.