I have the same issue, I found this post with a blue response:http://us.battle.net/d3/en/forum/topic/9882018170
Typically these types of issues are the result of your network device (router/modem) or console configuration. Here is a link to our support article on Diablo III Console Connection Troubleshooting, where you will find links to the appropriate Xbox or Playstation 3 support articles:
These issues may also be a result of NAT (Network Address Translation) restrictions as well. For Xbox players, following the steps in the following Xbox support article may also prove helpful for these problems:
Playstation 3 players will need to double check your router or modem's settings to ensure that the appropriate ports are being forwarded, and that any other network settings that would restrict your console's connectivity are disabled.
You can find the information on which ports to forward in the following Playstation support article:
For more information on how to configure your modem or router to allow traffic over specific ports, please see the support information provided by the manufacturer of your specific network device.
Edited by Tsarnis on 9/4/2013 6:27 PM PDT
I spent an hour doing this and it still doesn't work. I used port forwarding for the following ports, copied from the link provided:
TCP Ports: 80, 443, 465, 983, 5223, and 10070 - 10080
UDP Ports: 3478, 3479, 3658, and 10070
We also went through network options to ensure we both had the same region settings/disabled, and invite options the same.
It still doesn't work. Only way I can play with a friend is to take down my entire wireless network and plug my PS3 into the modem. I'll spend another hour screwing around with it double checking that I didn't mistype something.
Surprisingly I can quick-match no problem.
I wonder if blue can highlight what the issue is.
It seems fishy that we have to do port forwarding when multiplayer works fine in other games and seems to work fine when you're not playing a person in your friends list.