I think we would all agree Mr. Jewett is not only one of the most educated folks we have around here but he is also one of the most intelligent. If he leans heavy to the simple then there just might be something to it.
Collecting statistics and handicapping is drop dead simple...until you insert the human factor. Almost everyone wants an edge. If they can manipulate a system and keep their morals/ethics intact then they will most certainly do so. This means that every system which requires a player to tell the system anything more than games won is going to get worked over.
I have an idea how to make a system work but I have a lot of work to do on it before saying anything about it. Hopefully, I can share it in the near future, but for now it is a work in progress.
Ken
Yes, Bob is very well educated and very intelligent. But he's not the only intelligent or educated person here. There are plenty of intelligent and educated folks in this forum, and on this topic none of them are wrong, because there's no absolute right or wrong. In the end, you choose a system that you believe best fits your purpose. Personally, I prefer a system that is as complicated as the participants are willing to tolerate, as long as that complication improves accuracy. I'm willing to do the extra work to try to deal with manipulation.
You are correct in that the human element complicates things. Would you be in favor of or opposed to a system where the human element is considered in the rating? That most likely means more subjectivity.
When you are ready to disclose your system please post it here. These things fascinate me.