Is lactic acid really that bad?

I am a swimmer and our coach always makes us cool down after a workout. He says that lactic acid stunts muscle growth. But then somedays after a really tough workout we don't even cool down. Is lactic acid really that bad and if it is, what can I do to get rid of it when we don't cool down after practice?
10 answers 10