Well, it really depends on how long it's been since you last detangled.
Also, you should check for breakage vs shedding. Shed hairs are usually long (the length of your hair), and have small white bulbs on the end (the root). Broken hairs are shorter, snapping off somewhere along the hair strand.
The head usually sheds around 100 strands per day, some hair is going to be in your brush/on your hands. Its the broken hairs you should be concerned about. Broken hair is usually a sign of damage/dryness.