Thanks for your feedback. The exhaust is placed high, diagonally across the room.
I am pulling air from inside, but I am planning to use one of these (see image) on the man cave side. I'm hoping this will serve two purposes;
1. Allow the man cave to still have negative pressure even if the exhaust fan is running on low speed and only open when needed.
2. Stay closed when the exhaust fan is not running, thus not allowing smoke or smell to seep back into the room I am pulling air from.
One advantage of placing the intake low is that it will pull inn the coldest air from the next door room, but one major disadvantage is that no shelf's or furniture can be placed in that location on either side...