So after trying it out, it seems as a temporary solution (PC in my case, should work for consoles too) is to turn off "Cross-platform Play" in Options > System Settings. Others will need to have it turned off aswell if they want to play you. Spread the word!
#GGST