First off, can you ping the server (desktop, whatever - if it's serving, it's a server), then see if sshd is running. Second, see if iptables is blocking it. Third, see if tcp wrappers is blocking it.
There's a bunch of other things, but they're the obvious ones.