Question about bike panniers?

If you only use one pannier, will you be off balance. Is it better to just use two but not fill them up all the way.
2 answers 2