Intel is usually the issue with naval battles going dreadfully wrong. Since the AI tends to stack units on the border with little surprises, players aren't used to relying on intelligence missions or radars to track enemy movement. What you see is usually what you anticipate.
In the case of naval battles, due to the fog of war and the sheer size of the oceans, you need intel in order to make the best decisions. Whenever I go to war with a country, I always switch my active spies there to military intelligence so I can gather necessary information and make the best decisions possible. Of course this isn't without its drawbacks, spending precious leadership on decryption tech and having spies die to a mission other than lowering national unity may be a big no no to some, but I prefer it especially since most players don't update their encryption techs nor does the AI most of the time.
The reason for my intel rant above is to clarify how important tracking enemy ships and more importantly knowing their compositions is. It allows you to set up ambushes or even naval invasions without much worry if you know where the enemy is and what they're up to.
To add to all this, your strategic goal is what you should base your naval strats on. Do you want to develop naval superiority in an ocean or even the 7 seas? Do you want to orchestrate a naval invasion? Or do you want to secure your supply routes/convoys?
If you want to achieve naval superiority, carriers alone are the least of your worries per se, you could bypass them altogether by sinking any surface action fleets (BB/BC/CA/CL/DD) and that would render their tiny fleet irrelevant if you maintain your navy properly and minimize losses. Again, intel is key to determine navy compositions before engaging. But as a rule of thumb, air superiority and CAS/NAV on naval strike will go a long way if you cba with intel and just want to wreck everything. But personally I enjoy the planning and execution of a good take down rather than click spamming a naval province till no enemy ships exist anymore.