Either way, the issue may not be toggle buttons, but explaining a concept. This can apply to any control, which either shifts a view, filters data, or changes a configuration. This issue is clarity.
Is switching this toggle a potentially destructive action?
If this is a UI which is part of a complex configuration, where a choice has some consequences once it’s saved, having a visible info tip could tell them what each choice represents.
Or is this just a view preference?
If this is the case, just having a hover tip when the cursor appears can be enough to tell them what this choice means.