A new coalition formation method considers structure generation and payoff division. We prune the search space by the relation of marginal contributions and Shapley values. The coalitions are formed by estimating probability distributions of Markov states. It is experimentally showed that the method proposed is effective and efficient.
