It seems to me that you have to take over the other colours (yours is purple) and if you have more dice than the other place your are taking over, you have more chance to win (as you can score more points from the throw of the dice) Also, you lose a die everytime you take one over.
Although, like above, i'm not sure what gives you the extra dice.