Here’s what Signal says: https://signal.org/blog/contact-discovery/

Signal knows all of their users’ phone numbers.

Only the hash of your phone number.