Yeah, it can be pretty painful. I had someone sit on my thumb when it was facing directly up and I happened to turn just in time to see it pushed ALL THE WAY BACK. It looked awful. Right after that happened my lower thumb area was extremely huge.
Last year I broke my "ulna" (may be spelled wrong) bone...which is a wrist bone. That sucked too.