One-to-one notifications are down ?

What's happening?

Team members are reporting that they are not getting one-to-one conversations email notifications (and the notifications in the drawer ? They will confirm). Concerns @jblemee @calummackervoy @matthieu @manonbou at least.

Steps to reproduce

Don't know anything about the reproduction process.

changed title from One-to-one notifications are down to One-to-one notifications are down ?

assigned to @MattJ

Starting with 1h estimate for investigation. I'm currently already on another high-priority issue for a client, I should be done with that in an hour or so and then I'll look into this.

The activities to jabber are returning 200 but without the expected id in the payload

Local Message notifications haven't been created for a while

changed time estimate to 1h

Is anyone able to provide me with a username and domain that is definitely not receiving notifications?

community.startinblox.com. Every users.

Found the issue and pushed a fix to master, which is deployed on the dev server.

Say the word and I'll roll it out to production.

Unfortunately it requires affected users to be re-saved, as a bug in the last code change meant they lost their stored webids. I would be able to get a list of affected users if needed.

@calummackervoy I also fixed the success and error responses to include the change ids.

Let's go for production so.

List of affected users is welcomed.

Deployed to production. Will get the list of users now.

@jbpasquier I've emailed you a CSV with the domain and (XMPP) username of affected users that were unable to send or receive notifications.

Sorry that we took some time to act on this one. @Cyrilthiriet is on it as we speak.

It's done now, let me know if something is not working please :)

Very cool

added 56m of time spent at 2020-10-28

closed