Your connection speed isn't the only limiting factor for determining how many players you can support, we need system specs too!
That'll just about handle 24 players, your line speed is fine too, just keep your OS as lean as possible and you should be fine