Visual Studio Remote Debugger and PDB files

When I tried to remote debug a windows service I was wondering why VisualStudio kept telling me that my BreakPoints wouldn't be hit because the symbols haven't been loaded, although the PDB files where on the remote host. Turns out there are a few cases where you need the PDB files both on the remote host and on the client. Here is a brief excerpt from MSDN about this:

The symbol files for native applications must be located on the Visual Studio host computer.

The symbol files for managed applications must be located on the remote computer.

The symbol files for mixed (managed and native) applications must be located on both the Visual Studio host computer and the remote computer.