[…] starting with Signal in the first place doesn’t make sense to me.

If you have the means to choose something more secure/trustworthy/robust than Signal, then I think it would be in your best interest to do so! I personally would recommend SimpleX, if possible.