Yep, I sail in the harbour if the surf is a bit wild and I'm short on time. Straight south best, SSW ok, SSE/SE I go to Collaroy but some sail Clontarf in SE with big gear.
Went yesterday arvo, launched off Manly at oceanworld end but usually go from other end and can get out in one run. It's really good if south as funnels but you don't get bashed by the chop like Botany. Never been hassled by Waterways but been blasted by the ferries a few times!
Park on West Esplanade to sail by the Aquarium or East Esplanade to sail out from between the boats (closer to Skiff Club). It's 2 Hour parking which may double if you have a Manly Parking permit.