You need confirme if the 4 paths to LUN are across differents Fabrics, cause maybe you have 4 paths trough only one Fabric, and if the switch from this Frabric goes down do you will loose access to storage system.
Do you have two HBA ? Each one connected to a different switch ?
If you confirm that your 4 paths are across differents Fabrics and each HBA has access to all storage system controller processor, you can safety put down one of Fabric and ESXi will manager the paths down.