Yes, different kinds of assets might have slightly different needs, but generally speaking as long as your topmost node in the relevant chain/parenting hierarchy is the one you scale for the "perspective" I think it should be fine in most cases. And in the specific cases where it can't work, you will have to find a specific solution then.
But I think it's better to worry about and look for a specific solution when you it edit: hit such a snag, until then just keep working on your project. If you hit a specific snag, then it's worth posting a question about it here and we can try to think of a solution specific to it then.
Worrying about hypotheticals can be a waste of time, since you can't be certain what kind of an issue you might run into later, and spending time on it ahead of time, especially if you might never end up running into that issue at all, would potentially be a expensive investment time-wise.
