- Research article
- Open Access
- Published:

# The evolution of competition and policing: opposing selection within and among groups

*BMC Evolutionary Biology*
**volume 7**, Article number: 203 (2007)

## Abstract

### Background

Although selection favors exploitative competition within groups, a group of hypercompetitive individuals may be less productive than a cooperative group. When competition is costly for group fitness, among-group selection can favor groups with 'policing' individuals who reduce within-group competition at a cost to their own fitness, or groups of individuals who restrain their competitive intensity ('self policing'). We examine these possibilities in a series of explicit population-genetic models.

### Results

By comparing results from models of half and full sib structured populations, we find that increased relatedness increases the strength of among-group selection against competition genotypes, and increases the strength of among group selection favoring policing genotypes. However, the strength of selection favoring costly policing behavior also increases with increased levels of competition. When levels of competition and policing feedback on one another, groups with lower levels of relatedness can favor higher levels of costly policing.

### Conclusion

The result of the joint selection on policing and competition leads to results different from those based on the evolution of policing alone. Our model makes 'long term' predictions equivalent to those of optimization models, but we also show the existence of protected polymorphisms of police and civilians, as well as competitors and non-competitors.

## Background

A major impediment to the evolution of productive social interactions is what Hardin [1] termed "The Tragedy of the Commons" (TOC). Because individual self-interest favors unfettered exploitation of a resource, whenever two or more individuals share a common environment and make simultaneous demands on its resources, conditions are ripe for the TOC. Opportunities for the TOC include groups of microbes living in the same host, offspring within the same family, and genes in the same organism [2]. Wright ([3] p. 129), Wynne-Edwards ([4] p. 623) and Hamilton [5] viewed the TOC as the problem of controlling cheaters, lest they lead to the destruction of the group (see also [6–8]).

Resolution of this tension between the interests of the group and the individual allows major evolutionary transitions, wherein communities of individuals merge into a single functional unit [8–11]. The processes proposed for resolving this tension are kin selection for altruism and enforced cooperation via policing. These are viewed as alternatives, since the former is facilitated by high levels of genetic relatedness among group members, while the latter is favored by low levels of relatedness. Although group selection works best with high levels of relatedness, "contrary to simple expectation" ([12] p. 42), policing theory [13, 14] and data from vespid wasps [15, 16] indicate that the highest levels of policing occur in groups with the lowest levels of genetic relatedness. Hence, policing is viewed as a mechanism for integrating groups of unrelated individuals, while altruism is seen a mechanism for cohesion in related groups [2, 12–14, 17, 18].

In this paper, we use explicit population genetic models to show that costly policing is favored by selection among groups and opposed by selection within groups in proportion to relatedness among group members in the same manner as kin-selected altruism: although altruistic and enforced cooperation may be alternative mechanisms for group cohesion, they evolve by the same evolutionary process. We examine the evolution of individual competitive ability and policing in the first two-trait model of individual and group selection. Individual selection within groups favors enhanced competitive ability but opposes costly policing. Conversely, group selection opposes the evolution of competitive ability but favors the evolution of policing.

Unlike previous optimization treatments of policing, our explicit genetic model reveals stable interior equilibria as well as the rate of progress toward them. Owing to the multiplicative nature of the group-mean fitness function (a pres [13]), many combinations of competition and policing have equal fitnesses. Although mutation analysis reveals that these interior equilibria are invasible and can move toward the global optima found by Frank [13], evolutionary progress toward the global equilibrium is exceedingly slow, on the order of the *square* of the inverse of the mutation rate, because it depends upon the order of occurrence of competition and policing mutations. These global optima may exist but few species will endure long enough to guarantee arrival at them.

Ratnieks [19] coined the term, 'policing' in the context of social insect colonies where worker females lay haploid, male eggs that are often eaten by other workers. Policing behaviors can mitigate the individually beneficial and the communally detrimental effects of individual selfishness ([2, 13, 14, 20]). When individuals engage in mutual policing at some cost to themselves, the group as a whole functions as an evolutionary unit, as in the social insects, where "Worker policing ... may be selected due to the colony-level benefit of conflict suppression" ([21] p. 169). Additionally, policing is thought to be particularly important in the maintenance of sociality in higher primates. Alexander [22] argued that socially imposed rules and traditions favor group-level efficiency in humans, and Flack and colleagues have found evidence for the importance of policing in the coherence of groups of pigtailed macaques [20, 23].

Frank [2, 13, 14, 17, 18] was the first to formally examine the co-evolutionary interplay between competitive and policing behaviors. In the simplest version of his model, Frank [13] envisions that each individual has two quantitative traits, policing and competition. The fitness, w_{ij}, of the j^{th} individual in the i^{th} group is given by the function

where z_{ij} is the competitive ability of the j^{th} individual and z_{i.} is the mean competitive ability of individuals in group i. Similarly, a_{ij} is the amount of policing by the j^{th} individual in the i^{th} group and a_{i.} is the average level of policing within group i. The constant, c, represents the cost of policing to the individual and it is assumed to be the same for all individuals. Individual fitness increases as z_{ij} increases and is favored by selection within groups. However, mean group fitness is a declining function of mean z_{i} and is opposed by among group selection.

Analyzing the optima of eq. [1], Frank found that: (1) mean competitive ability decreases with increasing relatedness; and, (2) mean level of policing increases with increased competition. We use Frank's fitness model in our investigation of the evolution of competition and policing in populations composed of either full or half sib families. We examine these different levels of relatedness in order to explore directly how relatedness affects the evolution of policing and competition. We partition total selection into within and among group components [24] to make the levels of selection explicit and show how the major findings of Frank [13] emerge from the conflicting forces of selection within and between groups. Unlike Frank [11] we find many stable interior equilibria, in which extreme competitors coexist with less competitive genotypes, and effective police coexist with civilians; suggesting that a population need not necessarily arrive at the monomorphic state predicted by Frank [13]. Moreover, we find that like multiplicative selection functions of two-locus individual selection, joint selection on competitive and policing alleles does not generate linkage-disequilibrium, and thus the hyper-competitive genotypes are equally likely to be police or civilians.

## Methods and Results

### General Approach

In our model, policing and competition only occur within sibling groups. This can be visualized as competition over a resource proximal to the location where offspring are raised, or competition over maternal resources. After siblings mature, they leave this locale, mix with other members of the population and mate randomly, with no further selection on levels of competition or policing.

To further simplify analysis, we assume a large population in Hardy-Weinberg equilibrium, and we ignore the effects of mutation, migration, and random genetic drift. For each model, we identify all parental mating types and their respective frequencies, the offspring genotypes from each mating type, and the change in genotype frequencies within each family that result from the fitness costs and benefits of competition and policing. Next, we calculate mean absolute fitness of each family. From these values, we calculate the changes in gene frequency due to selection within sib groups, selection among sib groups, and the total change in gene frequency per generation. We complement our technical treatments by concluding each model with a qualitative summary of our findings.

### Model 1: The Evolution of Competitive Ability

We envision a population with no policing where an individual's level of competition is controlled by one locus with two alleles with additive affects. Let allele A occur in frequency p and the alternative allele, a, in frequency q = (1 - p), so that, after random mating, *AA*, *Aa*, and *aa* individuals are in frequencies p^{2}, 2pq, and q^{2}, respectively. Let *AA* individuals have a baseline competitive ability denoted by z_{0}. Adding an *a* allele to the genotype, increases competitive ability by an amount, z_{a}. Thus, Aa individuals compete at the level z_{0} + z_{a}, while aa individuals compete at the level, z_{0} + 2z_{a}. Mean competitive ability of the population equals z_{0} + 2qz_{a}.

### Model 1A: Competition Without Policing

#### Population-genetic dynamics

Setting a_{i.} = a_{ij} = 0 in eq. [1] (to reflect no policing), the fitness of an individual of genotype j in family-type i is

mean fitness in family i equals

*w*_{
i.
}= 1 - *z*_{i.}

and mean fitness across all families is

We find the frequency of allele *a* after within family selection by taking the product of the frequency of each family type (f_{i}), the change in frequency of allele *a* due to selection within this family (Δq_{i}), and the mean fitness of this family (w_{i}), summing across all family types and dividing by $\overline{w}$ (see [25] for procedure). Assuming weak selection as in Wade [24, 25], we approximate f_{i} from Hardy-Weinberg expectations, and thus solutions in text are approximations. In Additional file 1, we present the exact solutions, which differ only slightly from the approximate solutions as also found by Wade [25] for a very different fitness function.

We subtract the frequency of allele a before selection to find the change in q due to selection among and within groups [26–28]

Total change in frequency of allele *a* (Δq_{total}) is the sum of eqs. [5] and [6]. Values of f_{i.}, Δq_{i.}, q_{i.}, and w_{i.} for full and half sib families are presented in Tables 1 and 2, respectively. Table 3 shows mean fitness, as well as Δq among groups, within groups, and total (discussed below).

Inputting values from Tables 1 and 2 into eq. [5], we find that selection between families always favors a decrease in competition, regardless of gene frequency, degree of competition, or family type (half sib or full sib). For half sib families, $\Delta {q}_{amongHS}=\frac{-pq{z}_{a}}{4\overline{w}}$, and is exactly half as strong as among group selection against competition in full sib families $\Delta {q}_{amongFS}=\frac{-pq{z}_{a}}{2\overline{w}}$ as found in many other theoretical studies of kin selection [26–28].

Inputting values from Tables 1 and 2 into eq. [6], we find that comparing results of selection within groups (Table 3, Row 3) is more complicated. Subtracting Δ*q*_{
within_FS
}from Δ*q*_{
within_HS
}yields $\frac{pq{z}_{a}}{2\overline{w}}\left\{{z}_{a}\left(\raisebox{1ex}{$1$}\!\left/ \!\raisebox{-1ex}{$2$}\right.-q\right)\left(\frac{{p}^{2}}{{Z}_{1HS}{z}_{2FS}}+\frac{2pq}{{Z}_{2HS}{z}_{4FS}}+\frac{{q}^{2}}{{Z}_{3HS}{z}_{5FS}}\right)+\left(\frac{1}{{Z}_{2HS}}-1\right)/2\right\}$. Thus, the difference in the strength of within group selection depends on allele frequency, as well as the level of competition. Specifically, when q < 0.5 and z_{2hs} < 1.0, within-group selection favoring competition will be stronger for half-sib families than it is for full-sib families; however, as q rises above 1/2 and z_{2hs} rises above 1, within-group selection favoring competition can be stronger for full-sib families than it is for half-sib families. Since z_{2HS} cannot exceed 1 in this model, the force of within-group selection can only be stronger in a population of full-sib than half-sib families if the competitive allele is very common.

The formula for total selection on competitive ability is similarly complicated (Table 3, Row 5). Subtracting Δq_{total} full-sib from Δq_{total} half-sib yields $\frac{pq{z}_{a}}{2\overline{w}}\left({z}_{a}\left(\raisebox{1ex}{$1$}\!\left/ \!\raisebox{-1ex}{$2$}\right.-q\right)\left(\frac{{p}^{2}}{{Z}_{1HS}{Z}_{2FS}}+\frac{2pq}{{Z}_{2HS}{Z}_{4FS}}+\frac{{q}^{2}}{{Z}_{3HS}{Z}_{5FS}}\right)+\frac{1}{2{Z}_{2HS}}\right)$. Since selection on competition is dependent on z_{0}, z_{a} and q, it is difficult to interpret the effect of family structure on evolution from this result.

#### Solving for optima

By solving for the equilibrium value of q* (setting Δq_{total} = 0), and comparing results for half and full-sib families (Figure 1), we allow for simple interpretation of the effect of population structure on the evolution of competitive intensity.

Furthermore, with a few simplifying assumptions we show that this approach provides the same results as Frank [13, 14]. We begin with a population fixed for allele p, so that z_{..} = z_{0}. We then introduce a rare mutant carrying allele q and find Δq_{total} for both half and full sib families. Figures 2a and 2b display the sign of Δq_{total} (when q is rare) as a function of z_{0} and z_{a} for half and full sib families, respectively. These figures are similar to the pairwise-invasibility-plots of adaptive dynamics [29]; however, rather than presenting z_{resident} and z_{invader} we present z_{0} (which can be thought of as z_{resident}), and z_{a} (z_{invader} - z_{resident}).

We can then obtain the stable level of competition, z*, by setting Δq = 0 and solving for z_{0} as z_{a} approaches zero. Let z* represent the invasion equilibrium, the value of z_{0} at which an invader with small levels of z_{a} does not change in frequency. This equilibrium equals 3/4 for half sib families and 1/2 for full sib families, coincident with Frank's solution that z* = 1 - r. For both family types, z* is both evolutionarily and continuously stable, meaning that z* cannot be invaded by a rare allele with any nonzero value of z_{a} and, reciprocally, that a rare allele entering any monomorphic population will increase in frequency if the allele increases the level of competition and z_{0} is less than z_{0}*, or if the allele decreases the level of competition and z_{0} is greater than z_{0}*. If the mutant not only invades, but is driven to fixation, then the population becomes monomorphic for a new level of competition, z_{0}' which equals z_{0} + z_{a}. Now if a new mutant allele, z_{a}, has a small effect on the level of competition and z_{0} + z_{a} individuals are closer to z_{0}* than z_{0}' this new value of z_{a} can spread and now the sum of z_{0}' + z_{a} becomes the new z_{0}. A continuation of this process will ultimately lead to the stable level of competition, z_{0}, described above.

#### Population-genetic constrains

However, we are not guaranteed that the evolution of competitive behavior will follow the particular steps outlined above. Of special interest is the observation that, for many combinations of z_{0} and z_{a}, there exist a stable level of q and p such that a dimorphism of competitive behavior is maintained (Figures 1A and 1B display equilibrium values of q for half and full sib families, respectively). We can show that such a stable equilibrium is invasible by a mutant with competitive ability closer to z* and resistant to invasion by mutants with competitive ability further from z* (in Additional file 3 we show the derivation of this result for the full-sib model). However, we have not explored the possibility of a new stable intermediate equilibrium, involving 2 or more alleles, in between these boundary analyses. Additionally, it is widely known that complex genetic systems, with dominance, epistasis and pleiotropy can act as constraints, preventing traits from approaching their optima; we have not formally addressed the influence of these factors in the evolution of competitive intensity.

The evolutionary dynamics of competitive ability may also deviate from the description above if competitive ability interacts with another trait that affects the spread of competition. Frank [2, 13, 14] added policing behavior to the model of competition. Below, we also add a fixed level of policing to this model and examine the evolutionary interaction between these two traits.

### Model 1B: Competition with a Fixed, Nonzero Level of Policing

#### Population-genetic dynamics

With a fixed level of policing (such that a_{i.} = a_{ij} = a in eq. [1]), the fitness of an individual of genotype j in family-type i changes from eq. [2] to become

mean fitness in family i equals

*w*_{
i.
}= (1 - *z*_{i.}(1 - *a*))(1 - *ca*)

and mean fitness across all families is

When policing is absent, (i.e., a = 0) eqs. [6-7] reduce to eqs.[2-4]. Tables 4 and 5 show family characteristics including frequencies, fitnesses and allele frequency change for within full and half-sib families, respectively. In Table 6, we show mean fitness, as well as the Δq approximate solutions for half and full-sib families.

#### Solving for optima

From the Δq total expressions in Table 6 we derived z_{0}* for half and full-sib families. Frank ([13] – figure 1B) shows that, when selection favors any level of policing, (1) policing effort (a) will approach 1, and (2) the level of competition will evolve to $\frac{1-r}{r\left(1-c\right)}$. Here we address prediction 2 by inserting the values, r = 1/2 and 3/4 for full and half sib families, respectively, into Frank's prediction and comparing it to our own derivation of z_{0}*. As a → 1, we find that the two approaches provide equivalent solutions, namely, ${z}_{HS\left(a==1\right)}^{\ast}=\frac{3}{1-c}$ and ${z}_{FS\left(a==1\right)}^{\ast}=\frac{1}{1-c}$. Intriguingly, both solutions result in values of z* > 1, which, in the absence of policing, would result in *negative* fitnesses (see eqs. [2-4]). Values of z* in excess of 1 are only possible with some level of policing already present in the population, so that no families or individuals suffer from w < 0. Frank ([14] p. 1166) explained this result as follows:

*"The high competitiveness in a policing situation is no different from high internal pressure in a fish that lives at great depth. The fish brought to the surface explodes; intense competition and avoidance of repressive policing cause chaos when the same amount of energy is devoted to competition in the absence of repressive policing. "*

Although Frank's and our approaches provide equivalent solutions for the level of competition in half and full-sib structured populations with complete policing, some information is lost in this comparison. Frank's approach allows for the derivation of z* with any quantitative value of r, while we have only solved for two specific values of relatedness, r = 1/2 and r = 1/4. By contrast, our model provides a prediction for the optimal level of competition when the level of policing (a) lies between the two stable solutions (1 and 0). Thus, the two derivations of z* provide complimentary solutions to the evolution of competitive ability in a police state.

### Summary of Model 1: The Evolution of Competitive Ability

We apply a family selection approach to the problem of the evolution of interference competition. In the long term, without 'policing,' we find that mean competitive ability will approach a value of 1/2 for full-sib and 1/4 for half-sib families, in agreement with previous research [13]. However, we also discovered a plane of stable equlibria between competitive specialists and a less competitive class. When a fixed level of policing behavior is added to this model, the regions of stable equilibria are reduced and a sharp increase in competitive ability is favored. In some sense, although policing limits the expression of competitive ability, the innate tendency to compete is enhanced beyond that able to evolve in the absence of policing: policing permits the evolution of more extreme interference competition.

### Model 2: The Evolution of Policing with a Fixed Level of Competition

We now examine the evolution of policing behavior in a population with a fixed level of competition, assuming that an individual's level of policing is controlled by one locus with two alleles with additive affects. Let allele B occur in frequency t and the alternative allele, b, in frequency u = (1 - t), so that, after random mating, BB, Bb, and bb individuals are in frequencies t^{2}, 2tu, and u^{2}, respectively. Let BB individuals have a baseline level of policing denoted by a_{0}. Adding a b allele to the genotype increases policing effort by an amount, a_{a}. Thus Bb individuals police at the level a_{0} + a_{a}, while bb individuals police at the level, a_{0} + 2a_{a}. Mean policing effort of the population equals a_{0}+2ua_{a}.

#### Population-genetic dynamics

In this model, policing decreases the benefit of competition to within-group fitness, and decreases the deleterious effect of competition on between-group fitness. Following [1], and setting z = z_{ij} = z_{i.} = z_{..} to represent a fixed level of competition, the fitness of the j^{th} individual in the i^{th} group equals

*w*_{
ij
}= (1 - *ca*_{
ij
})(1 - *z*(1 - *a*_{i.}))

the mean fitness of group i equals

*w*_{i.}= (1 - *ca*_{i.})(1 - *z*(1 - *a*_{i.}))

and population mean fitness equals

where c and a represent the cost and degree of policing, respectively, *σ*^{2}_{a_AF} represents the among-family variance in policing effort. For both half and full sib families, we find the frequency of allele b after selection among and within families following eqs. [5] and [6] respectively, maintaining the same major assumptions, but substituting u for q. Values of f_{i.}, Δu_{i.}, u_{i.}, and w_{i.} for full and half-sib family-structured populations are presented in Tables 7 and 8, respectively.

We find the surprising result that, unlike the model of competition, with all else being equal, the $\overline{w}$_{
HS
}≠ $\overline{w}$_{
FS
}. This result follows from the emergence of ${a}_{i.}^{2}$ in the derivation of *w*_{i.}(eq. [8]) – in replacing *a*_{
i
}with $\overline{a}$ in eq. [9] we substitute the square of the mean level of policing for the mean of the squared level of policing. We therefore subtract the difference between these values (i.e. the variance in policing) multiplied by c and z. Since multiple mating decreases the variance among maternal families, $\overline{w}$_{
HS
}≥ $\overline{w}$_{
FS
}. The difference between $\overline{w}$_{
HS
}and $\overline{w}$_{
FS
}equals $\frac{zctu{a}_{a}^{2}}{2}$, which is zc times the difference in among-family variance in policing effort for half and full-sib families (Table 9).

Clearly, policing decreases the benefit of competition to within-group fitness, and decreases the deleterious effect of competition on between-group fitness; however, this group-level benefit is mediated by the cost of policing. The direction and magnitude of among-group selection on policing effort (Table 9) reflects these opposing pressures. For both half and full sib structured populations, increased policing is favored by selection among groups when the baseline level of policing [a_{0}] is small – that is, when ${a}_{0}<\left(\frac{z-c}{2cz}+\frac{1-{a}_{a}\left(\raisebox{1ex}{$1$}\!\left/ \!\raisebox{-1ex}{$2$}\right.+3u\right)}{2}\right)$, and all other values are between 0 and 1.

Restricting this analysis to small values of a_{a}, this result reduces to:

Increasing the cost of policing [c] decreases the value of the right hand side (RHS) of the eq. [10], limiting the parameter space for which increased policing is favored by between-group selection. In contrast, increasing the fixed level of competition, [z] increases the RHS of eq. [10], increasing the parameter space under which increased policing is favored by between-group selection. *Thus, increased competition within groups facilitates the evolution of policing by between-group selection*.

A comparison of Δ*u*_{
amongHS
}with Δ*u*_{
amongFS
}shows that among-group selection favoring increased policing effort is approximately twice as strong for full sib families as it is for half sib families (Table 9, row 4). The exact difference between Δ*u*_{
amongFS
}with Δ*u*_{
amongHS
}is $\frac{\Delta {u}_{amongHS}}{2}(1+\frac{cz{\sigma}_{a\_AF\_HS}^{2}}{{\overline{w}}_{HS}})$. The most important qualitative result from our derivation is that policing can be favored by between group selection and increasing relatedness (while keeping all other variables constant) strengthens the force of among-group selection favoring policing.

While among-group selection can favor increased policing, within group selection always favors reduced levels of policing (Table 9) Note that the claim that costless policing does not involve kin selection [30] is not substantiated by our model: when the cost of policing (c) is set to 0, there is no selection within groups and policing evolves solely by among-group selection. The difference between Δu_{withinFS} and Δu_{withinHS} equals

It can be shown that Δu_{withinFS} is greater than Δu_{withinHS} when $z<\frac{1}{1-\overline{a}}$. Since within-group selection decreases the frequency of a policing allele, and since z cannot be greater than one unless there is already a significant level of policing in the population, selection against policing is initially stronger in populations consisting of half-sib families than it is in populations of full-sib families, but as the level of policing increases this difference diminishes. This result partially explains why half-sib families can sustain high levels of policing – within-group selection against high levels of policing is weaker in half-sib based populations than in full-sib based populations.

The difference between populations structured as full and half-sib groups in the total change in policing-allele frequency is the sum the differences between them from selection within and between groups. Under most parameter values, policing is more strongly favored in full-sib than in half-sib structured populations (Figure 3); again, this is contrary to the beliefs that reduced relatedness favors the evolution of policing and that the evolution of policing is a process distinct from kin selection.

#### Solving for optima

Frank [13] found that the co-evolutionary system of competition and policing moves towards one of two equilibria, depending on the cost of policing and the population genetic structure. When relatedness is greater than one minus the cost of policing, Frank's model predicts that there will be no policing and the level of competition (z*) will equal one minus relatedness. From our derivation of Δu_{total}, we find that an allele that increases policing effort will only increase in frequency when $c<\frac{z}{2-2z+3z{a}_{0}z+z{a}_{a}+4uz{a}_{a}}$ for full sib families, and when $c<\frac{z}{4-4z+5z{a}_{0}+z{a}_{a}+8uz{a}_{a}}$ for half sib families.

Inserting values of z* found in the previous section (1/2 for full sib and 3/4 for half sib families) for z, an allele which increases policing effort can increase in frequency when $c<\frac{1}{2+3{a}_{0}+{a}_{a}+4u{a}_{a}}$ or $c<\frac{3}{4+15{a}_{0}+3{a}_{a}+24u{a}_{a}}$ for full and half sib based populations, respectively. Beginning with no policing (a_{0} = 0), a rare mutant (u is small) with a small policing effort (a_{a} is small and positive) will only increase when c < 1/2 for full sib, or c < 3/4 for half sib structured populations. This result is consistent with Frank's first equilibrium prediction – when r > 1 - c, policing will not invade and the system will be stable with z_{ij} = z_{i.} = z_{..} = z* = 1 - r, and a_{ij} = a_{i.} = a_{..} = a* = 0.

We can also solve for the equilibrium value of a_{0}* with a fixed value of competition. For full sib structured populations, ${a}_{0}^{\ast}=\frac{2}{3cz}\left(cz-c+\frac{z}{2}\right)$ and for half sib structured populations ${a}_{0}^{\ast}=\frac{4}{5cz}\left(cz-c+\frac{z}{4}\right)$. Subtracting a_{0}* _{HS} from a_{0}* _{FS} yields $\frac{2}{15cz}\left(c+z-cz\right)$, a number which is generally positive, providing further support for the claim that, all else equal, high relatedness favors higher levels of policing.

### Summary of Model 2: The Evolution of Policing Effort

We apply a family selection approach to the problem of the evolution of policing effort. Selection among families generally increases the frequency of an allele that increases policing effort, while selection within families always decreases the frequency of a policing allele. Under identical parameters, selection among half sib groups favoring a policing allele is twice as strong as the same selection among a population of half-sib groups. By inserting equilibrium values of z* from section 1A into our Δu expressions, we show that a nonzero level of policing can evolve only when c < 1/2 and 3/4 for full and half- sib families, respectively.

### Model 3: The Co-evolution of Policing and Competition

#### Population-genetic dynamics

In this model we examine the co-evolution of competition and policing behavior. In this two-locus model we retain the naming conventions in models 1 and 2. The fitness of the j^{th} in the i^{th} group is given in eq. [1]. The mean fitness of the i^{th} family

*w*_{i.}= (1 - *ca*_{i.})(1 - *z*_{
i
}(1 - *a*_{i.}))

equals and the mean population fitness equals

Family tables are presented in Additional file 2.

The results of this model parallel results from models 1B and 2. Mean population fitness, Δu within families, among families and total are equivalent to values in Table 9 with $\overline{z}$ replacing z. Similarly, Δq within and among families as well as Δq total are equivalent to values listed in 6, with $\overline{a}$ replacing a. No linkage disequilibrium is generated by selection either within or among groups, therefore the dynamics of the co-evolution of policing and competition do not depend on whether they are jointly polymorphic, or if the invasion of a new type occurs while the other locus is monomorphic. As in models 1 and 2, genetic constraints such as mutational step size, and dominance can prevent populations from attaining these equilibrium values.

#### Solving for optima

As in model 2, and as Frank [13, 14] found, policing will only evolve when r < 1 - c. When policing is favored by selection, policing effort will rise above one, the biological cap on the level of policing. By constraining the system to avoid negative individual fitnesses (by keeping a < 1), when policing is favored it will approach one and the level of competition will approach that found in model 1B (above).

#### Population-genetic constraints

Notably, although this two-gene, two-trait model makes equivalent 'long-term' predictions as the single-trait based approaches, this model places additional constraints on the order and size of effect of mutations to competition and policing, which may prohibit a population from achieving the ultimate equilibria. That is large mutational many mutations at one locus, that place a population closer to long-term equilibria may be lost because the appropriate trait values at the other locus do not yet exist.

## Discussion and Conclusion

Conflict between the levels of selection is a classical problem of evolution theory [6, 8, 25, 31–34]. Here, in formal evolutionary genetic models, we investigated the evolution of two traits, interference competition and policing, that, not only, interact to affect fitness but also are affected by selection within and between groups, albeit in opposite ways. The first trait, interference competition, increases the fitness of individuals within groups but does so at a cost to group fitness. The second trait, policing, increases group mean fitness but at a cost to the fitness of policing individuals within groups. By partitioning total selection into within and among group components, we showed how each level of selection contributes to the evolutionary dynamics and long-term evolutionary outcome of selection on policing and competition. We noted that costless policing involves only selection among groups.

We found that competition is opposed by among-group selection and decreases with higher levels of genetic relatedness: over all values of cost and for any given level of policing, there is a negative relationship between competition and relatedness. That is, under identical parameters, the equilibrium values of competition are always higher for half-sib than for full-sib structured populations (Fig. 4a). As has been shown before [13, 14, 27], kin selection opposes competition within kin groups. We also find that interference competition with policing can evolve to a level that exceeds its maximum value (z* = 1) without policing, a finding similar to that of Frank [13, 14]: a high level of policing allows a high level of interference competition.

One of our novel findings is that policing is favoured by among-group selection and it reaches higher values with higher genetic relatedness within groups as we illustrate graphically (Fig. 4). Thus, kin selection favors the evolution of policing: across a range of costs of policing and for a given level of competition, the equilibrium level of policing is higher for full-sib than for half-sib structured populations (Fig. 4b). As well, the rate of increase of a policing allele increases with genetic relatedness (Fig. 3). We conclude that, although policing may be a different mechanism than altruism for ensuring group cooperation, it evolves by the same evolutionary process as altruism, namely, kin selection.

We also find that, owing to the multiplicative nature of the group-mean fitness function, the mean level of competition has a strong influence on the equilibrium level of policing and vice versa (Figs. 4c,d). However, the influences are not strictly reciprocal. The equilibrium level of policing cannot rise above one (where it renders all competition ineffective) and remains at zero until high values of competition exist, while the equilibrium level of competition can get very large and grow very quickly, especially when policing is costly. Together, these trait associations result in a negative relationship between the equilibrium values of policing and relatedness – the high levels of competition favored in populations with low relatedness create a strong selective pressure favoring policing behavior and overcome the weakness of kin selection in less genetically structured groups. Thus, *the joint equilibrium relationship between relatedness and policing is the opposite of the dynamical one*. It is this difference between the dynamic and equilibrium relationship to relatedness that has led some to interpret policing as an alternative to kin selection. Our dynamic model reveals the source of this confusion.

Our evolutionary genetic approach also reveals the existence of planes of stable, interior equilibria. For a fixed level of policing, there exists a plane of stable equilibria with competitive specialists and a less competitive, self-policing class (Figures 3 and 4). Similarly, the evolution of policing with a fixed level of competition gives rise to planes of stable gene frequency equilibria with policing and non-policing individuals (Brandvain unpublished). These non-policing individuals are cheaters or free-riders by virtue of the fact that they bear none of the costs of policing but reap the reward of reduced within-group resource competition. Together, these findings indicate that neither trait may reach the ultimate evolutionary outcome characterized by optimizing the mean fitness function. Our further analyses of the one-trait models, adding mutant alleles causing increased competition or reduced policing, respectively, result in the population moving from one region of stable equilibria to another, toward the ultimate outcomes predicted by Frank's model. Thus, our regions of stable equilibria are invasible by mutations and the ESS coincides with that predicted by Frank and his collaborators. However, rates of evolution can be very slow and depend upon the fortuitous input of a continuing series of mutations with effects of a particular kind occurring in the right order with respect to the equilibrium. Thus, when both traits are evolving simultaneously, there is reason to question whether the ESS can be achieved.

We used a two-locus model to investigate the simultaneous evolution of competition and policing. Like individual selection models with multiplicative fitnesses, selection in this model does not generate linkage disequilibrium between the competition and policing loci. As a result, the evolution of each trait is affected by the genotypic mean value of the other (playing the role of the fixed levels in the one locus model). Hence, we find similar regions of stable two-locus equilibria, with mixed levels of both competition and policing behaviors. Similarly, we find that mutant alleles at either locus can invade these stable equilibria. However, depending on the order and magnitude of the mutational effects introduced, the population can move either toward or away from the ultimate evolutionary outcome. Thus, achieving the joint ESS depends not only on the occurrence of mutations for policing and competitive ability but also on the mutations occurring in the right order, a much more onerous requirement than in the one-locus models. As a result, a population's sojourn away from the ESS may be extremely long and we should expect diversity among species (or among populations of the same species) in levels of competition and policing.

### Biological Implications

In some circumstances, different genes can experience different values of relatedness. For example, maternally inherited mitochondrial genes can be more closely related than diploid nuclear genes and the mating system can change both the absolute and relative values [35]. In genomic imprinting (the differential expression of a gene based on its parent of origin), a similar situation arises within the broods of multiply mated females: siblings are more closely related for maternally derived alleles than they are for paternally derived alleles. High relatedness of paternally derived alleles in monogamous or inbred sib-cohorts selects for self restraint of paternally derived competitive alleles, while low relatedness of siblings from multiple mated mothers will select for increased levels of competitive effort of paternally derived alleles [36]. Because our model allows for the separation of probability of ibd by parent of origin and because we show that policing is favored by selection between groups, we predict that the high competition of paternally-derived alleles will result in increased policing by maternally derived alleles.

Because genes in separate species are not closely related, policing has been invoked in this way: "the study of interspecific mutualistic associations offers the opportunity to explore the mechanisms ...that maintain cooperative behavior even in the absence of kin selection" ([37] p. 254; see also [13] p. 520). This view of policing has motivated the use of non-genetic, economic-optimum models of co-evolution to understand the evolution of symbioses. The evolution of conflict reduction without relatedness appears to provide an important alternative explanation for major transitions in evolution. In this view, policing (sometimes called sanctioning) evolves under very low relatedness and is an alternative to kin selection, which also favors decreased competitive ability. We have shown that policing is not an alternative to kin-group selection, thus, although policing could be an important force in the evolution of symbioses [38], especially in cases of co-inheritance [7, 35, 39], it does not offer a new class of evolutionary explanation.

While the population genetic models of policing and competition presented in this paper highlight both the dynamics of the evolution and the conflicting forces of selection within and between groups, Frank's models are more analytically tractable and both models make the same predictions about the long term evolutionary outcome of natural selection. Thus, these complementary approaches provided a clearer view of the evolutionary forces involved in competition and policing behaviors.

## References

- 1.
Hardin G: Tragedy of commons. Science. 1968, 162 (3859): 1243-1248. 10.1126/science.162.3859.1243.

- 2.
Frank SA: Perspective: Repression of competition and the evolution of cooperation. Evolution. 2003, 57 (4): 693-705.

- 3.
Wright S: Evolution and the genetics of populations: The theory of gene frequencies. 1969, Chicago: Univesity of Chicago Press, 2:

- 4.
Wynne-Edwards VC: Animal dispersion in relation to social behaviour. 1962, New York: Hafner Publishing Company

- 5.
Hamilton WD: Genetical evolution of social behaviour I. Journal of Theoretical Biology. 1964, 7 (1): 1-16. 10.1016/0022-5193(64)90038-4.

- 6.
Maynard Smith J: Group selection + kin selection. Nature. 1964, 201 (492): 1145-1147. 10.1038/2011145a0.

- 7.
Wade MJ, Breden F: The evolution of cheating and selfish behavior. Behavioral Ecology and Sociobiology. 1980, 7 (3): 167-172. 10.1007/BF00299360.

- 8.
Michod RE: Darwinian dynamics. 2000, Princeton: Princeton University Press

- 9.
Maynard Smith J, Szathmary E: The major transitions in evolution. 1995, Oxford University Press

- 10.
Michod RE, Roze D: Cooperation and conflict in the evolution of individuality. III. Transitions in the unit of fitness. Mathematical and Computational Biology: Computational Morphogenesis, Hierarchical Complexity, and Digital Evolution. Edited by: Nehaniv CL. 1999, American Mathematical Society, 26:

- 11.
Wade MJ: The co-evolutionary genetics of ecological communities. Nature Reviews Genetics. 2007, 8 (3): 185-195. 10.1038/nrg2031.

- 12.
Queller DC: Evolutionary biology – To work or not to work?. Nature. 2006, 444: 42-43. 10.1038/444042a.

- 13.
Frank SA: Mutual policing and repression of competition in the evolution of cooperative groups. Nature. 1995, 377 (6549): 520-522. 10.1038/377520a0.

- 14.
Frank SA: Policing and group cohesion when resources vary. Animal Behaviour. 1996, 52: 1163-1169. 10.1006/anbe.1996.0263.

- 15.
Wenseleers T, Badcock NS, Erven K, Tofilski A, Nascimento FS, Hart AG, Burke TA, Archer ME, Ratnieks FLW: A test of worker policing theory in an advanced eusocial wasp,

*Vespula rufa*. Evolution. 2005, 59: 1306-1314. - 16.
Wenseleers T, Ratnieks FLW: Comparative analysis of worker reproduction and policing in eusocial hymenoptera supports relatedness theory. American Naturalist. 2006, 168 (6): E163-E179. 10.1086/508619.

- 17.
Frank SA: Foundations of social evolution. 1998, Princeton: Princeton University Press

- 18.
Frank SA: Social selection. Evolutionary genetics: Concepts and case studies. Edited by: Fox CW, Wolf JB. 2006, Oxford: Oxford University Press

- 19.
Ratnieks FLW: Reproductive harmony via mutual policing by workers in eusocial

*Hymenoptera*. American Naturalist. 1988, 132: 217-236. 10.1086/284846. - 20.
Flack JC, Girvan M, de Waal FBM, Krakauer DC: Policing stabilizes construction of social niches in primates. Nature. 2006, 439 (7075): 426-429. 10.1038/nature04326.

- 21.
Foster KR, Ratnieks FL: Convergent evolution of worker policing by egg eating in the honeybee and common wasp. Proc Biol Sci. 2001, 268 (1463): 169-174.

- 22.
Alexander RD: The biology of moral systems. 1987, New York: Aldine de Gruyter

- 23.
Flack JC, de Waal FBM, Krakauer DC: Social structure, robustness, and policing cost in a cognitively sophisticated species. American Naturalist. 2005, 165 (5): E126-E139. 10.1086/429277.

- 24.
Wade MJ: Kin selection – Its components. Science. 1980, 210 (4470): 665-667. 10.1126/science.210.4470.665.

- 25.
Wade MJ: Evolution of social interactions by family selection. American Naturalist. 1979, 113 (3): 399-417. 10.1086/283398.

- 26.
Wade MJ: Evolution of interference competition by individual, family, and group selection. Proceedings of the National Academy of Sciences of the United States of America-Biological Sciences. 1982, 79 (11): 3575-3578. 10.1073/pnas.79.11.3575.

- 27.
Wade MJ: The effect of multiple inseminations on the evolution of social behaviors in diploid and haplo-diploid organisms. Journal of Theoretical Biology. 1982, 95 (2): 351-368. 10.1016/0022-5193(82)90250-8.

- 28.
Wade MJ: The influence of multiple inseminations and multiple foundresses on social evolution. Journal of Theoretical Biology. 1985, 112 (1): 109-121.

- 29.
Geritz SAH, Kisdi E, Meszéna G, Metz JAJ: Evolutionarily singular strategies and the adaptive growth and branching of the evolutionary tree. Evolutionary Ecology. 1998, 12: 35-37. 10.1023/A:1006554906681.

- 30.
Alonso WJ, Schuck-Paim C: Sex-ratio conflicts, kin selection, and the evolution of altruism. Proceedings of the National Academy of Sciences of the United States of America. 2002, 99 (10): 6843-6847. 10.1073/pnas.092584299.

- 31.
Buss LW: The evolution of indviduality. 1987, Princeton: Princeton University Press

- 32.
Darwin CR:

*On the origin of species*, fascimile of the first edition 1964. 1859, Cambridge: Harvard University Press - 33.
Wade MJ: Kin selection – Classical approach and a general solution. Proceedings of the National Academy of Sciences of the United States of America. 1978, 75 (12): 6154-6158. 10.1073/pnas.75.12.6154.

- 34.
Williams GC: Adaptation and natural selection. 1966, Princeton: Princeton University Press

- 35.
Wade MJ, Goodnight CJ: Cyto-nuclear epistasis: Two-locus random genetic drift in hermaphroditic and dioecious species. Evolution. 2006, 60 (4): 643-659.

- 36.
Brandvain Y, Haig D: Divergent mating systems and parental conflict as a barrier to hybridization in flowering plants. American Naturalist. 2005, 166 (3): 330-338. 10.1086/432036.

- 37.
Bergstrom CT, Bronstein JL, Bshary R, Conner RC, Daly M, Frank SA, Gintis H: Group report: Interspecific mutualism – puzzles and predictions. Genetic and cultural evolution of cooperation. Edited by: Hammerstein P. 2003, Cambridge: MIT Press

- 38.
Frank SA: Models of symbiosis. American Naturalist. 1997, 150: S80-S99. 10.1086/286051.

- 39.
Wade MJ: Community genetics and species interactions. Ecology. 2003, 84 (3): 583-585. 10.1890/0012-9658(2003)084[0583:CGASI]2.0.CO;2.

## Acknowledgements

This manuscript has benefited from comments by S.A Frank, C. Lively, T. Platt, J. Smith, J. Cianciolo, D. Drury, J. Akst, T. Cruickshank, J. D. Van Dyken and N. K. Priest. This research was supported by an NSF pre-doctoral fellowship to YB and NIH R01GM065414 to MJW.

## Author information

### Affiliations

### Corresponding author

## Additional information

### Authors' contributions

YB and MJW conceived of the research and co-wrote the paper. YB conducted the theoretical research, and produced the figures and tables.

## Electronic supplementary material

### 12862_2007_494_MOESM1_ESM.doc

Additional file 1: Exact solution for Δq, half sib families. Here we show the deviation between results assuming Hardy-Weinberg Equilibrium, and the exact solution without this assumption. (DOC 68 KB)

### 12862_2007_494_MOESM2_ESM.xls

Additional file 2: Two-locus family tales. Family tables for full and half sib families with both two alleles segregating at each locus. (XLS 95 KB)

### 12862_2007_494_MOESM3_ESM.doc

Additional file 3: Invasibility of a 3^{rd} allele in a full-sib competition model. Here we present the invasion dynamics of a rare mutant entering a population with a stable two-locus polymorphism. (DOC 168 KB)

## Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

## Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

## About this article

### Cite this article

Brandvain, Y., Wade, M.J. The evolution of competition and policing: opposing selection within and among groups.
*BMC Evol Biol* **7, **203 (2007). https://doi.org/10.1186/1471-2148-7-203

Received:

Accepted:

Published:

### Keywords

- Competitive Ability
- Group Selection
- Fixed Level
- Interference Competition
- Stable Interior Equilibrium