Is it possible to prevent content types from other SharePoint online sites to recognized?

When a user from Department A recieve an email from Department B and either open the attachment or save it in SP, it automatically attempts to tag it with the existing Content-Type and Metadata (from Dept B).
Problem is that content type and metadata do not exist in Dept A, and it auto assigns the wrong content type.
Is there a way to prevent SP from recognizing Content Types coming from different sites?

We don’t wan to use Content Hub.