How are VPS and VPN different?

Although both are web-based services and have "Virtual" in their names, they share little else in common. Despite this, many individuals tend to conflate the two. Thus, it's important to clarify their dissimilarities.