Von Neumann proved that there is a solution for every ZSG with 2 players, though it might require the implementation of mixed strategies (strategies with probabilities attached to every move and outcome).
Together with the economist Morgenstern, he developed an approach to coalitions (cooperative efforts of one or more players - a coalition of one player is possible).
Every coalition has a value - a minimal amount that the coalition can secure using solely its own efforts and resources. The function describing this value is super- additive (the value of a coalition which is comprised of two sub-coalitions equals, at least, the sum of the values of the two sub-coalitions). Coalitions can be epiphenomenal: their value can be higher than the combined values of their constituents. The amounts paid to the players equal the value of the coalition and each player stands to get an amount no smaller than any amount that he would have made on his own. A set of payments to the players, describing the division of the coalition's value amongst them, is the "imputation", a single outcome of a strategy. A strategy is, therefore, dominant, if: (1) each player is getting more under the strategy than under any other strategy and (2) the players in the coalition receive a total payment that does not exceed the value of the coalition. Rational players are likely to prefer the dominant strategy and to enforce it.
Thus, the solution to an n-players game is a set of imputations. No single imputation in the solution must be dominant (=better). They should all lead to equally desirable results. On the other hand, all the imputations outside the solution should be dominated. Some games are without solution (Lucas, 1967).
Auman and Maschler tried to establish what is the right payoff to the members of a coalition. They went about it by enlarging upon the concept of bargaining (threats, bluffs, offers and counter-offers). Every imputation was examined, separately, whether it belongs in the solution (=yields the highest ranked outcome) or not, regardless of the other imputations in the solution. But in their theory, every member had the right to "object" to the inclusion of other members in the coalition by suggesting a different, exclusionary, coalition in which the members stand to gain a larger payoff. The player about to be excluded can "counter-argue" by demonstrating the existence of yet another coalition in which the members will get at least as much as in the first coalition and in the coalition proposed by his adversary, the "objector". Each coalition has, at least, one solution.
The Game in GT is an idealized concept. Some of the assumptions can - and should be argued against. The number of agents in any game is assumed to be finite and a finite number of steps is mostly incorporated into the assumptions. Omissions are not treated as acts (though negative ones). All agents are negligible in their relationship to others (have no discernible influence on them) - yet are influenced by them (their strategies are not - but the specific moves that they select - are). The comparison of utilities is not the result of any ranking - because no universal ranking is possible. Actually, no ranking common to two or n players is possible (rankings are bound to differ among players). Many of the problems are linked to the variant of rationality used in GT. It is comprised of a clarity of preferences on behalf of the rational agent and relies on the people's tendency to converge and cluster around the right answer / move.
This, however, is only a tendency. Some of the time, players select the wrong moves. It would have been much wiser to assume that there are no pure strategies, that all of them are mixed. Game Theory would have done well to borrow mathematical techniques from quantum mechanics. For instance: strategies could have been described as wave functions with probability distributions.
The same treatment could be accorded to the cardinal utility function. Obviously, the highest ranking (smallest ordinal) preference should have had the biggest probability attached to it - or could be treated as the collapse event. But these are more or less known, even trivial, objections. Some of them cannot be overcome. We must idealize the world in order to be able to relate to it scientifically at all. The idealization process entails the incorporation of gross inaccuracies into the model and the ignorance of other elements. The surprise is that the approximation yields results, which tally closely with reality - in view of its mutilation, affected by the model.
There are more serious problems, philosophical in nature.
It is generally agreed that "changing" the game can - and very often does - move the players from a non- cooperative mode (leading to Paretto-dominated results, which are never desirable) - to a cooperative one. A government can force its citizens to cooperate and to obey the law. It can enforce this cooperation. This is often called a Hobbesian dilemma. It arises even in a population made up entirely of altruists. Different utility functions and the process of bargaining are likely to drive these good souls to threaten to become egoists unless other altruists adopt their utility function (their preferences, their bundles). Nash proved that there is an allocation of possible utility functions to these agents so that the equilibrium strategy for each one of them will be this kind of threat. This is a clear social Hobbesian dilemma: the equilibrium is absolute egoism despite the fact that all the players are altruists. This implies that we can learn very little about the outcomes of competitive situations from acquainting ourselves with the psychological facts pertaining to the players. The agents, in this example, are not selfish or irrational - and, still, they deteriorate in their behaviour, to utter egotism. A complete set of utility functions - including details regarding how much they know about one another's utility functions - defines the available equilibrium strategies. The altruists in our example are prisoners of the logic of the game. Only an "outside" power can release them from their predicament and permit them to materialize their true nature. Gauthier said that morally-constrained agents are more likely to evade Paretto-dominated outcomes in competitive games - than agents who are constrained only rationally. But this is unconvincing without the existence of an Hobesian enforcement mechanism (a state is the most common one). Players would do better to avoid Paretto dominated outcomes by imposing the constraints of such a mechanism upon their available strategies. Paretto optimality is defined as efficiency, when there is no state of things (a different distribution of resources) in which at least one player is better off - with all the other no worse off. "Better off" read: "with his preference satisfied". This definitely could lead to cooperation (to avoid a bad outcome) - but it cannot be shown to lead to the formation of morality, however basic. Criminals can achieve their goals in splendid cooperation and be content, but that does not make it more moral. Game theory is agent neutral, it is utilitarianism at its apex. It does not prescribe to the agent what is "good" - only what is "right". It is the ultimate proof that effort at reconciling utilitarianism with more deontological, agent relative, approaches are dubious, in the best of cases. Teleology, in other words, in no guarantee of morality.