James Madison is credited with the idea of creating a congressional library, first making such a proposition in 1783.