Disable Windows 10 Taskbar App Preview Hover Bring to Front

That setting is not adjustable. If you hover and wait, the app comes to the front and goes to the back when you stop hovering.

If you hover quickly (so just to see) it will not come to the front.

If you wish, you can turn Hovering off. I have learned to manage it.

Turn off hovering

The steps in this article were performed on a laptop computer in
Windows 10. By completing the steps in this guide you will be stopping
the behavior where you see a white window pop up over an icon when you
hover above it.

Step 1: Click the folder icon in the taskbar.

Step 2: Select the File tab at the top-left of the window, then click
the Change folder and search options button.

Step 3: Click the View tab at the top of the window.

Step 4: Scroll down and click the box to the left of Show pop-up
description for folder and desktop items to remove the check mark.

Step 5: Click the Apply button at the bottom of the window, then click