For GDM you can try adding this entry to /etc/gdm/custom.conf with this line:
WaylandEnable=false
Restart the GDM service
sudo systemctl restart gdm.service
This is because XFCE does not support Wayland full yet.
Because it xfce session exists in /usr/share/xsessions/xfce.desktop