If you look gaijin enough, living in Japan with a tattoo would probably not be a huge problem, especially now that there's the pressure to accept tattoos for the Olympics. You could occasionally get kicked from an onsen, but rarely. You would have the "gaijin privilege" (gaijins are not expected to follow Japanese rules as strictly as a Japanese), plus they perfectly know that you're not a yakuza (especially since many of them are tied to the far-right) or a burakumin. That's even clearer if you're thinking of a "Western tattoo" like a stupid butterfly, not an irezumi.
Now, your husband could find this very unattractive. That's another issue. You should take your time to discuss that with him, and see if they are some models he can tolerate.