Should we be worried?

Unless you've been hiding under a rock this week, you know that talk of the Swine Flu has taken over the news and media. My question is, should we be worried about this? Right now, there are 51 confirmed cases of the flu in the U.S. and I am sure there are countless suspected cases. Most of the drama surrounds people who have recently traveled to Mexico, where at least 100 people have died. The government has urged citizens to suspend "non-essential" travel to Mexico for now and also to practice basic precautionary measures such as frequent hand washing and cough etiquette. So far, the mood seems calm but attentive. I want to know what you think... should we be worried?