The most common case for failures is frankendebian [0] and just putting some badly designed packages that mess stuff up. I had never had, even on desktop, problems with vanilla Debian install, they all stewed from some 3rd party repo not playing nice.

* [0] https://wiki.debian.org/DontBreakDebian