Hi,,,
I amd suffering from VMware error.
Storage was disconnected step by step from Hypervisor, so our service was unavailable.
To continue our service, we reseat the switch machine.
I suppose that our service was down gradually after these messages.
I want to know the reason and resolution. I want your help.
[vmkernal.log]
2013-12-06T15:32:08.500Z cpu1:4297415)NMP: nmp_ThrottleLogForDevice:2319: Cmd 0x1a (0x412400902840, 0) to dev "mpx.vmhba33:C0:T0:L0" on path "vmhba33:C0:T0:L0" Failed: H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0. Act:NONE
2013-12-06T15:32:08.500Z cpu1:4297415)ScsiDeviceIO: 2331: Cmd(0x412400902840) 0x1a, CmdSN 0x106c3a from world 0 to dev "mpx.vmhba33:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x20 0x0.
2013-12-06T15:32:21.180Z cpu9:4336620)ScsiCore: 63: Starting taskmgmt handler world 4336620/2
2013-12-06T15:32:23.181Z cpu13:4328429)ScsiCore: 63: Starting taskmgmt handler world 4328429/3
2013-12-06T15:32:28.473Z cpu2:8399)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L36
2013-12-06T15:32:28.473Z cpu12:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:36 : Task mgmt "Abort Task" with itt=0x1def96 (refITT=0x1def93) timed out.
2013-12-06T15:32:28.473Z cpu2:8399)ScsiCore: 97: Stopping taskMgmt handler world 83992
2013-12-06T15:32:31.181Z cpu0:4336620)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L0
2013-12-06T15:32:31.181Z cpu12:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:0 : Task mgmt "Abort Task" with itt=0x1def97 (refITT=0x1def95) timed out.
2013-12-06T15:32:33.182Z cpu16:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:38 : Task mgmt "Abort Task" with itt=0x1def98 (refITT=0x1def92) timed out.
2013-12-06T15:32:33.182Z cpu14:4328429)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L38
2013-12-06T15:32:37.186Z cpu7:4336624)ScsiCore: 63: Starting taskmgmt handler world 4336624/3
2013-12-06T15:32:41.182Z cpu4:4336620)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L36
2013-12-06T15:32:41.182Z cpu15:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:36 : Task mgmt "Abort Task" with itt=0x1def99 (refITT=0x1def93) timed out.
2013-12-06T15:32:43.185Z cpu15:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:0 : Task mgmt "Abort Task" with itt=0x1def9a (refITT=0x1def95) timed out.
2013-12-06T15:32:43.185Z cpu12:4328429)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L0
2013-12-06T15:32:47.188Z cpu5:4336624)WARNING: ScsiPath: 6134: Set retry timeout for failed TaskMgmt abort for CmdSN 0x0, status Failure, path vmhba38:C0:T4:L38
2013-12-06T15:32:47.188Z cpu4:8831)WARNING: iscsi_vmk: iscsivmk_TaskMgmtIssue: vmhba38:CH:0 T:4 L:38 : Task mgmt "Abort Task" with itt=0x1def9b (refITT=0x1def92) timed out.