Should you use a VPS instead of Vercel, Netlify & co?

There's been some debate whether services like Vercel and Netlify are overpriced and you should use a VPS for hosting websites instead. The answer is a solid "it depends", but there are some obvious decision factors you should consider.