Point scoring

Do the points lost/gained correspond to the rank held by each player at the start or end of the game? I think it should be the start because you could begin many games very badly but just hold on for a long time and in other games you are doing great and climbing the rankings. By the time you finish the games you started badly in (as a rookie) you could be a sergeant or higher and lose many more points.