As mentioned, weather would have been a factor; in moderate winds, the Victory would have been a hard pressed to protect its stern, which American frigates seemed to favor over duking it out broadside to broadside.
__________________
Aka "Trick of the tail"
The movie Master & Commander portayed this particular manuver as a favorite of the French navy as well even while at battle with a ship less her own guns and length.