The camera should do frustum culling by default, so the stuff behind the mirror (or outside the view) will not be rendered. The physical size of the mirror makes no difference. However, the resolution of the second Viewport does, as this affects the performance (how many pixels are shaded). So the easiest solution is to simply lower the resolution of the mirror. Most games use a half size or even a quarter size (half on each axis) and it can still look okay, as long as it's not a core part of the gameplay.