It sounds counterintuitive, but you need to make the crack slightly bigger to fix it properly. Use a utility knife to cut a "V" shape along the length of the crack. This removes loose debris and creates a surface for the compound to grip.