What is the difference between shared hosting and VPS?

Shared and private virtual servers are among the most common servers offered for hosting, but which one should be chosen?