You might want to get your camera out and head to Gingras Trading Post State Historic Site— just one of the landmarks located 6.8 mi (10.9 km) from central Walhalla.
Pembina County Historical Museum is 5.5 mi (8.9 km) from central Cavalier, why not stop by during your stay. If you want to experience more of the culture Cavalier has to offer, head to Icelandic State Park.