Was thinking about shooting them with arrows. I've just been running at them hoping to get lucky.
I've downgraded the spear, now I just need to upgrade it to the Butterfly Horn. My Crystal Halberd is doing just fine at the moment though. Taking out those Giant Knights with a few hits.