On the top toolbar: System -> Preferences -> Preferred Applications
VLC isn't in just one place. The actual binary is in /usr/bin, the libraries are in /usr/lib, and a lot of other stuff is in /usr/share
Not that it would have helped you solve this problem, but to find the location of a program type
which programname
Running which vlc now tells me
/usr/bin/vlc