No, you do not need the balance tube. Its primary function is to provide a smooth vacuum source for the Master-Vac, PVC, and other vacuum powered devices.
The Master-Vac does affect the idle a bit. In some cars the idle speed increases slightly while pumping the brakes. This might be more pronounced if it is only connected to one carb. I doubt it will actually be a problem when driving.