If I could dispel any food myth, it would be that cooking fish is more finicky than cooking chicken breast or steak. I think fish tends to get a bad rep as being 'bland' or difficult to properly cook, and much of that most certainly has to do with the often poor selection of fish at regular grocery stores. Can you relate to buying fish from the store and it smelling -- well, fishy!
Fresh fish really shouldn't.
It should smell like the salty water it came from. My way around this is to first and foremost to always tell the manager of your local fish department if this happens they are aware of the issue. Forming a relationship with your fishmonger is not only a great way to ensure you'll get the best service, but also a great way to learn about new ways to prepare seafood.