Actually driving to Port Dickson is quite straight forward. There is no coach from Singapore to Port Dickson resorts area. You can try coach from Singapore to Seremban.
If you are looking at resorts on the sea, can try Avillion (The rest are either too rundown or too crowded) Book rooms facing the Malacca Strait.