Yep. Really need to compare the best-practice XMPP clients (e.g. Conversations, Siskin), not half-developed clients more suited to the XMPP landscape of 20 years ago. – Just as Matrix’s ranking in the table is high because only the state-of-the-art clients are considered – there are plenty of Matrix clients which don’t support e2ee, for example.

This list of mistakes isn’t exhaustive, but extending from poVoq’s mentions, here are some things XMPP(conversations) does actually have positive findings for:

• End to end encrypted by default [OMEMO]
• End to end encryption is available [OMEMO]
• Voice/video calls are end to end encrypted [“calls are always end-to-end encrypted with DTLS-SRTP”]
• Utilizes Perfect Forward Secrecy [OMEMO]
• Data is encrypted in transit [TLS and OMEMO]
• You can verify contacts out of band [https://gultsch.de/trust.html]
• There has been a third party code audit [2016]
• Provider can scan for illegal content [If you send content unencrypted, otherwise no different to Matrix/Signal]

I’m not sure there’s much differentiation between any apps when it comes to “What can the apps hand to police?”; if the police have physical access to your device and app, they have access to everything you do on that device/app.