As discussed in the thread, there is a significant distinction between the job of the header and collector and the long exhaust pipe.
If you size your exhaust pipe to "keep velocities up" you are robbing yourself of torque, since frictional losses are increased by both decreasing pipe diameter and increasing velocity. Frictional losses go up with velocity squared. Add in the long length of the pipe and some bends, and even more torque is lost. Thus, with a properly designed exhaust, there is no "too big" when it comes to performance. Otherwise, there is a "too big" and it's when you can't fit it under the car anymore! Of course, there comes a point of diminishing returns (upping diameter has negligible gain) and that's when you've sized the pipe properly.
Scavenging is the purpose of the header and collector, and possibly a tuned length of exhaust, not your long pipe that goes out back!