I ran into this same issue when I came across this page. On my machines, I noticed that pinging the host by its computer routes the ping outside of my home network to my ISP, but when I ping the client by its computer name (from the host) it finds it normally on the network.
Here is the output of pinging the host from the client by its computer name:
Pinging HOSTNAME.nyc.rr.com [67.215.65.XXX] with 32 bytes of data:
Reply from 67.215.65.XXX: bytes=32 time=14ms TTL=51
Reply from 67.215.65.XXX: bytes=32 time=34ms TTL=51
Reply from 67.215.65.XXX: bytes=32 time=14ms TTL=51
Reply from 67.215.65.XXX: bytes=32 time=12ms TTL=51
Ping statistics for 67.215.65.XXX:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 12ms, Maximum = 34ms, Average = 18ms
While pinging the client from the host by its computer name shows:
Pinging CLIENT [192.168.11.32] with 32 bytes of data:
Reply from 192.168.11.32: bytes=32 time=5ms TTL=128
Reply from 192.168.11.32: bytes=32 time=1ms TTL=128
Reply from 192.168.11.32: bytes=32 time=1ms TTL=128
Reply from 192.168.11.32: bytes=32 time=1ms TTL=128
Ping statistics for 192.168.11.32:
Packets: Sent = 4, Received = 4, Lost = 0 (0% loss),
Approximate round trip times in milli-seconds:
Minimum = 1ms, Maximum = 5ms, Average = 2ms
Maybe someone has any more insight on this?
My router is running DD-WRT v24SP2-MULTI (11/20/11) std. I have not forwarded RDP ports because I only use remote desktop internally.
EDIT
It appears the issue had to do with the DhcpDomain registry key. For some reason it was set to nyc.rr.com on one computer and my business's domain on another even though both were my home computers. Setting them to blank fixed the issues I was having.
Edit DhcpDomain="" in HKEY_LOCAL_MACHINE\SYSTEM\CurrentControlSet\services\Tcpip\Parameters\Interfaces\\