Well, without knowing the reasons, sure, its ignorance. The fear comes from experience.
The best candidates, in general, are those currently employed. If you quit, that means you weren't willing to stick it out until you found another job... If you were fired, that's a whole other situation and the reason you were fired is probably the reason I don't want to hire you.