Best suggestion I have is those electronic rodent repellers, they do work well. It annoys rodents badly and they pack up an leave. good sides, no traps, no dead mice no poisons or baits,,,just no mice.
Deploy the devices where you find their evidence,,easy, just plug them in.
Not suggested if you keep rodents or caviy's for pets, it will drive them insane.