I call what Jeremy is referring to a "Demolition Hammer". Basically, it's a miniature jack-hammer and I ABSOLUTELY AGREE that this is the tool to use.
You can spend a couple hundred (or more) bucks if you buy one of the major tool suppliers. Or, you can do what I did and buy one made by Chicogo tools for $60 bucks. I've had it for a few years now, taken up several thousand sq. ft. of tile with it, and it still works like new. You can also use it to take up VCT.
You can buy different size flat (chizel like) attachments for it. From 1" wide up to 4" I think.