What about framed prints of architectural wonders in the city they'll be calling home? Or a place they have visited, their honeymoon destination, or any other place that has meaning to them.
Etsy has a number of photographers who sell great prints of buildings, bridges, parks, etc. from all over the world. I've bought a few prints there myself, mostly purple doors in Paris.