My understanding is the most deadly/destructive parts of hurricanes are usually:
1. the storm surge, the potential wall of water brought by the continuous winds and waves near the shore, followed by 2. the flooding from heavy rains, then 3. followed by the wind.
So your example might also be hitting the same issue you're trying to avoid.
Note, the worst storm surge is from the eye towards the side where the winds are blowing in the direction of the shore. That's only part of the area with the peak winds.
Good points. Where I am at it’s mostly the wind because I am a well drained higher elevation, so I’m sure that coloured my perception. But you are right, the storm surge and flooding also do a great deal of damage.