That whole who is supposed to win prediction thing is just a crock when you have people evenly matched.
That's my whole point. It's good at telling you who is supposed to win when there is a points gap.
What you are essentially saying is that there is a problem with Fargo because it doesn't help to determine who will win a match between two evening skilled players. You might want to think that one out a little bit more. Of course it isn't going to be able to say who is going to win if two players are evenly skilled, lol. It tells you the truth, that since they are evenly skilled, it is a coin flip. And of course the system can actually predict one of the players to be X percentage more likely to win that the other when they are not evenly skilled, because now that they are not evenly skilled one is actually more likely to win than the other.
Fargo might be a good tool for major events, but it won't be legitimate until it encompasses ALL data down to the local level.
I think you have this kind of backwards. Actually, Fargo is the best tool for rating all players of all abilities from all around the world against each other. To do so there are some trade offs that had to be made and it might not be as good at any one specific things as it could have been were it designed for only that one specific thing. If the system was only for rating professional players, Mike could have tweaked it so that it would have been slightly more accurate at rating the pros. But his intention was not to have the all around most accurate system for rating pros. His intention was to have the best all around most accurate system for rating everybody against everybody at any level for all players in the world, not the absolute most accurate system for rating only the pros (you can't have both in one system, but you can have one system that does it all exceptionally well, and that is what he has).
And obviously the larger the sample size of data, the more accurate the rating will be. I am sure if there were a way to ensure you only received legitimate data that Mike would LOVE to get access to all matches that ever occurred between any two people. But one glaring problem with getting "all data down to the local level" is the trustworthiness of the data. You can't just leave it open for anyone to be able to submit results for anything because invariably people are going to send in totally made up stuff just to try to manipulate things for one reason or another.
I would suspect that Mike would love to have and probably has or soon will be working on trying to get all the data from all BCA and APA and TAP and every other major national league and even from all the legitimate city leagues as well, but actually getting them I'm sure is the issue. Most companies or people are not going to spend the time and effort to compile that stuff and give it to Mike unless they are getting something out of it to offset their time and effort. Also, when have you ever seen everybody in pool come together and cooperate for a common goal? So yes I am sure Mike would love to have all data from every league and every tournament that ever occurred at any level, but actually getting it and getting it accurately is an issue I'm sure.
Also, in chess you have "draws"
That is simply not a component of pool, and further separates the 2 because in chess, drawing can also earn you points if you draw against someone that is supposed to slaughter you.
Unless I am remembering incorrectly, Fargo has essentially the same type process in place because it isn't rating solely by who won or lost, but by what the final score was compared to what it should have been based on your rating. If you were to play Orcullo in a tourney, the expected score might be say 9-3 based on your abilities/Fargo rating, so 9-3 is essentially seen as the "draw" by Fargo. If the actual score for the match is you lose 9-8 Orcullo, you did way better than your rating indicates you should have done and your rank is going to go up, and vice versa. I simplified a bit but this is the gist as I recall.
Also, if a player takes off for a period of time, and then comes back, how exactly is their rating determined?
I am guessing here based on what I know about how the system works. We know that the system uses the past rolling ten years of game history, with the most recent being much more heavily weighted than the older. But if there is no recent data I think you essentially stay exactly or relatively near where your rating was on the date the data for your last match was input and only really changes as the earliest data gets to be over ten years old and rolls off completely and is no longer used in the calculation. Maybe Mike will confirm or clarify.
there is no way for the system to be accurate about a game that takes a couple of minutes.
Yes, there is. Obviously a single pool game doesn't mean much, and means less than single game of chess, but when you get hundreds or thousands of those "couple minute games of pool" it starts to mean something, and pretty accurately I might add. Yes, a chess game takes much longer, and means much more than a single game of pool, but there are fewer of them. What a single pool games loses in quality because it doesn't mean as much as a single chess game, it makes up for in quantity and larger sample size because there are a lot more games of pool played for every game of chess. The bottom line is that what really matters is sample size, not the length or meaning of a single game. If you have a large enough sample size it will be accurate regardless of the length or "tellingness" of a single game.
Since individual pool games are a piece of a "set" I would think that there should be some sort of weight given to who actually won the match.
Much in the same way some gamblers pro rate their sets.
Again, I think Fargorate essentially "prorates" already, because it isn't just using who won or lost the match. It is using the exact score the match was won or lost by and losing 9-8 to Orcullo is going to affect your rating differently than losing 9-1 to Orcullo.