The History of the Button blog has a bunch of good posts about this common design element, including this one on the fake crosswalk buttons in NYC and this one on a really cool new peripheral (watch the video).