We characterize all n‐person multi‐valued bargaining solutions, defined on the domain of all finite bargaining problems, and satisfying Weak Pareto Optimality (WPO), Covariance (COV), and Independence of Irrelevant Alternatives (IIA). We show that these solutions are obtained by iteratively maximizing nonsymmetric Nash products and determining the final set of points by so‐called LDR decompositions. If, next, we assume the (set‐theoretic) Axiom of Determinacy, then this class coincides with the class of iterated Nash bargaining solutions; but if we assume the Axiom of Choice then we are able to construct an additional large set of discontinuous and even nonmeasurable solutions. We show however that none of these nonmeasurable solutions can be defined in terms of set theoretic formulae. We next show that a number of existing results in the literature as well as some new results are implied by our approach. These include a characterization of all WPO, COV and IIA solutions–including single‐valued ones–on the domain of all compact bargaining problems, and an extension of a theorem of Birkhoff characterizing translation invariant and homogeneous orderings.