Desk Exercises?

I keep seeing exercises that are "so easy to do right at your desk." In fact, my trainer demonstrated a whole office chair workout yesterday. Now, while I would love to stretch out from the typewriter monkey posture at midday, I work in a cubicle in a government agency. Would I weird my co-workers out by doing push-ups at my desk?