When using dashboard it should suppress or have the option to suppress new email notification popups. Then when the timer goes off it should notify you. Constantly seeing emails come in via the notification system removes the utility of the dashboard limiting your email exposure.
Behavior is the same on OS X and Linux Ubuntu. Both screenshots attached.