The host called the swingers and at the party they all got down to business