Stevie: We'd need to think it thru, Stevie. How many passes do the other players have. What if one still has all five, etc.
I can already see that there might be a small problem toward the end of the game if one person still has a greater number of passes left than the others, but if that's the situation, then that player has probably outplayed everyone else anyway and deserves to win!
If you think it's a bad idea, please give me an example including how many players, how many points each has remaining, and how many passes each has left.