Vesper originally was built up around a sawmill built at the site in the 1870s. The village was named for vesper sparrows native to the area. A post office called Vesper has been in operation since 1878. Vesper was platted in 1898, and incorporated in 1948.