Custer is located in Yellowstone County on I-94 next to Big Horn, 50 miles east of Billings, along the Yellowstone River. At the junction of the Bighorn and Yellowstone rivers is the site of Fort Manuel Lisa, the first building in Montana built by white men.