I was always told by many old-timers over the years that the drill press is the most dangerous machine tool because it seems so simple and intuitive to operate, and because of that, it often leads to severe injuries.
Case in point the following video. This gent is well familiar with machining and shop safety, but he failed to secure his work in a fixture or vise and chose to secure the part by simply holding it in place. I've been there, and many of my friends who have garages or machine shops have experienced this same issue. We were lucky and still have all our digits, but many are not so fortunate.
It doesn't matter if it's just one simple hole -- these days I make sure I secure my workpiece on the drill press table before I do anything else.