At derby city 9ball I beat orcollo 9-6, melling 9-8 and Bergman 9-8. These matches were on video. But because the tournament director didn’t take match scores the scores will not be used towards Fargo Ratings. But meanwhile a shit tournament in my hometown played on gaffed up buckets (one match on a Robertson and the next match on a gold crown) will be used towards Fargo. This is a joke.
This is what I wrote on facebook concerning the issue
What is the deal when we know some but not all match scores? This is subtle, but I think people who work with statistics will understand the problem. Suppose a tournament doesn't record match scores for the first half of a tournament and then starts recording them. Is it OK for us to enter half a tournament? Yes, it is OK in this situation because there is no sampling bias. The process for us getting data has nothing to do with the content of the data.
Here is another situation. Match scores are not generally recorded or we don't get them. But a player brings us his match scores after the fact. To make it simple, let's suppose those match scores are verified by video and there is no question about their accuracy. Is this OK to enter? No it is not. Such data comes tainted with a point of view. There is a bias filter even if the person reporting is on the up and up and has the best of intentions. In this particular case, with Donny beating Orcullo 9 - 6, Donny is more likely to have contacted us after the event with that result than if Donny had lost 6 - 9. This is no criticism. It is just that Donny is more likely to be compelled to contact us with one result than another. Had Donny contacted me at the start of his match and said, "this is on video. Can the result go in?" The answer --aside from practical concerns about our time with requests like this--is yes.
Basically we need to decide whether data does in before the results are known to the decision makers--us and those reporting the data.