Keep the vita base, look for ee on your wep (I prefer axe for consistent damage), you can get ee on your armor if you want to tank- but str or dex (dex is generally cheaper) would be more useful, and str or dex on your charm (again, dex is somewhat cheaper).
If you're going swords or club, make sure you get ~ 110- 120 dex with your gear on, if you go axe I prefer to stat all str to keep high consistent damage.