Connecting Amp to Amp In, Cabinet to Speaker Out, with PS2 powered off?

I understand that with the amp plugged into “amp in”, the cabinet plugged into “speaker out”, and the PS2 powered on, we can bypass the PS2 with the bypass switch.

My question is: can we do the same with the PS2 powered off?