Semi-infinite programming duality for order restricted statistical inference models

The equivalence of multinomial maximum likelihood and the isotonic projection problem: , a convex subset of the probability vectors p} can be established using Fenchel's Duality Theorem and subgradient and complementary slackness relationship of convex analysis, all taking place over the real numbers. In this paper non-Archimedean polynomial subgradients are employed for the case where some of the observed values of the random vector are zero, corresponding to ‘zero counts in the traditional multinomial setting.’ With an appropriate linear semi-infinite programming dual pair it is shown that a vector solves the multinomial problem if and only if it converts to a solution of the isotonic projection problem. The development parallels the one of Robertson/Wright/Dykstra, where for the zero counts case the authors adjoin to the real numbers and define .