To improve your effectiveness with a weapon, you must gain experience in its specific attribute. For Heavy weapons, this involves dealing damage or successfully parrying attacks to earn EXP.
Invest in these (from specific stat thresholds): deepwoken weapons