Gentoo doesn't have a fixation on vanilla packages. In fact it's quite common to see multiple patches going aside your average ebuild.

The combination of USE flags / CFLAGS / LDFLAGS that make sense for individual users is so high that maintaining binary repos doesn't seem feasible.