It really depends on what you’re trying to do. If you’re trying to create a hole, you need a drill. But if you’re trying to enlarge a hole, or even more commonly, remove the etch cusp from a hole, then a tapered broach is the right tool. At least with the volume of holes we deal with. As has already been commented on, drills have a tendency to catch and twist in thin material. A delicate etch can be rendered useless by use of a drill if one isn’t careful.
Definitely on the drills creating a hole, that's a given. Also a given is drills catching in thin sheet metal and destroying the area around the hole, if not the whole part.
The biggest issue I see with tapered reamers is that they create tapered holes. Of course in thin metal, this is negligible. I use machine chucking reamers to open up holes, usually on the drill press, but I've also inserted them into a pin vise and used them by hand.
Jeff