It depends on what you intend to do with or on the pole. If you are thinking of using just for dancing around (no spinning tricks, etc) then you can probably do with a clearance of less than 3 feet on the "wall" sides of the pole.
However if you are wanting to be able to leg hook, back arch, spinning leg hook manuevers then you will want to have approximately 4 to 5 feet clearance on the "wall sides" of the pole. This is of course provided you are installing it in a corner area of a room.
Personally, unless you live in a home with a room that NEVER sees anyone but you and your partner I suggest checking out the removable/portable stipper poles. Do be sure to check if there are any weight limitations and RESPECT those limits if you intend it to be used for "tricks".