It's not a Niche Museum but the Reykjavik Art Museum & Reykjavík Art Museum Kjarvalsstaðir both are amazing and worth a visit too, neither are far away in Reykjavik from the Phallological Museum.

Reykjavik is quite nice to visit! It's similar to Ballard, WA, where we have a somewhat niche Nordic Heritage Museum that very nice as well.