macos – External displays keep getting back in the wrong order

I work with my macbook (16″, 10.15.7) closed and plugged into two external monitors, with two Apple USB-C Multiport Adapter.

One adapter has HDMI, Power and USB-A plugged, and is connected to my main display (the one that should be on the left on the image below.)

The other adapter has only HDMI plugged and is connected to my secondary display (the one that should be on the right on the image below.)

And almost every single time I plug the adapters, the displays are set in the wrong order (left and right are swapped) and I have to go to System Preferences > Displays to organize them correctly again.

Even If I unplug the one that should be on the right, wait and plug it again, macOS keep setting it on the left.

I successfully reset the NVRAM/PRAM but it does not resolve this behavior.

Does anybody have an idea on how to solve this problem?

Display issue