Hey Nathan,
Even though YOU can see the telephone details in the back end location, Amazon confirmed that is only the Business name and business address which will be shown on your Seller Profile.
This change matches what is already shown on across Amazon stores in Europe, Japan, and Mexico, and if you check you can see that phone numbers are not shown.
To take another look at their announcement – click here: Amazon’s Update on 8th July 2020