Difference between revisions of "Prediction Bias"

From BIF Guidelines Wiki
Line 18: Line 18:
  
 
Bias generally arises from incomplete information. In example, if selection takes place early in life (e.g., based on  
 
Bias generally arises from incomplete information. In example, if selection takes place early in life (e.g., based on  
weaning weight) such that a non-random group of animals is culled, then subsequent weight trait EPD (e.g., yearling weight) could be biased. This issue can be accommodated through the use of [[multiple trait analysis]]. Another example is incomplete recording of animals within a contemporary group. If only the heaviest animals are reported, then their performance relative to their contemporaries (e.g., contemporary group deviations) is biased downward because the observed average for the group is artificially inflated.
+
weaning weight) such that a non-random group of animals is culled, then subsequent weight trait EPD (e.g., yearling weight) could be biased. This issue can be accommodated through the use of [[multiple trait evaluation]]. Another example is incomplete recording of animals within a contemporary group. If only the heaviest animals are reported, then their performance relative to their contemporaries (e.g., contemporary group deviations) is biased downward because the observed average for the group is artificially inflated.
  
 
<references />
 
<references />

Revision as of 19:07, 11 June 2019

Bias

Estimating Bias

Let be the true progeny difference (TPD) and be our estimate (EPD). From this we could estimate the degree of bias in our estimate by determining the difference in the mean TBD and mean EPD. However, we never observe the TPD. Instead we estimate it using pedigree, performance, and genomic data.

We can approximate the degree of bias and under/over dispersion of EPD by using regression techniques[1] [2]. One such way to do this is to regress the EPD with more information (e.g., genomic EPD) on the EPD with less information (e.g, pedigree-based EPD). Our expectation is that the intercept from this regression is 0 (no bias) given the properties of Best Linear Unbiased Prediction and the slope of the regression is 1 (no over or under dispersion).

A fundamental assumption is that the ratio of variance components used to generate both sets of EPD are the same. if they are not, then the expectation of the regression coefficient being 1 no longer holds.

Another approach is to regress phenotypes after being corrected for systematic effects on EPD. Here the expectation of the regression coefficient is 2. If EBV were used instead of EPD the expectation of the regression coefficient would be 1.

A key assumption is that the phenotype of the individual is not included in the EPD of that individual. Consequently, this approach lends itself to cross-validation or forward in time validation strategies whereby some set(s) of animals have their phenotypes masked in the genetic evaluation.

In similar fashion, average progeny performance (corrected for systematic effects) can be regressed on parent (sire) EPD. This is done annually at the US Meat Animal Research Center as part of the process to update across-breed EPD adjustment factors. The expectation of the regression coefficient is 1 in this case and assumes that the progeny information used is not part of the sire's EPD. A regression coefficient of less than 1 suggests that the EPD are over-dispersed meaning that a one unit change in EPD will generate less than a one unit change in progeny phenotypes.

Sources of Bias

Bias generally arises from incomplete information. In example, if selection takes place early in life (e.g., based on weaning weight) such that a non-random group of animals is culled, then subsequent weight trait EPD (e.g., yearling weight) could be biased. This issue can be accommodated through the use of multiple trait evaluation. Another example is incomplete recording of animals within a contemporary group. If only the heaviest animals are reported, then their performance relative to their contemporaries (e.g., contemporary group deviations) is biased downward because the observed average for the group is artificially inflated.

  1. Reverter, A., B. L. Golden, R. M. Bourdon, and J. S. Brinks. 1994. Technical Note: Detection of Bias in Genetic PredictionsJ. Anim. Sci. 72:34-37.
  2. Legarra, A., and A. Reverter. 2018. Semi-parametric estimates of population accuracy and bias of predictions of breeding values and future phenotypes using the LR method. Genetics Selection Evolution. 40:53.