This is a horrible issue, and I feel terribly if this is happening to you!..but it is a sadly common problem. Know that you are not alone! Please submit a ticket to http://support.2k.com/hc/en-us/requests/new This helps 2K gather data, since this may well be a server issue they need to fix. I know they will be looking into this! We want to help.
If you are using a PS4 or PC and also suffer this issue, please reply with which system this is happening to you on here as well. Right now this looks more like an XBox One problem.