You're right, there is a centrifugal mechanism, advancing timing with RPM, and a vacuum mechanism, advancing it with intake vacuum when the port is open.
What happens if you disconnect only the hose to the vacuum canister on the distributor? It's not really clear what hoses you're disconnecting that cause the idle to increase and the timing to drop 11 degrees. If there's no vacuum on the hose to the distributor hose, then nothing at all should happen when you disconnect it, since it won't be a vacuum leak and it's not pulling on the advance mechanism. Try to isolate cause and effect, specifically.