I don't see the complication. Seems like the ladies can join the getaway and play golf if they like. Should they choose not to, I am sure there is plenty of other things to do like the beach which is nearby, the spa at the golf resort, maybe some tennis or a casino if applicable. Then meet up with the guys later for drinks/dinner
Say a few words: