Should I be eating lunch with my boss?

A few folks in the office will take the time away from their desks and sit with the boss in our conference room and eat lunch.

Am I missing out on work place bonding? Some face time? Is there some subtle information being shared?