James Madison decided that sovereignty ultimately resided with _____. AP US History Chapter 6 James Madison decided that sovereignty ultimately resided with _____. Answer: people Learn More : Share this Share on FacebookTweet on TwitterPlus on Google+