Search engines have different goals, when they return 10 blue links. One goal is relevance. Another one is variety. Yet another one is freshness. The list if very long.
An axiomatic approach for result diversification is a Microsoft paper providing an axiomatic framework for addressing both relevance and variety. Very interesting paper, indeed.