Sorry for belated reply.
This turned out to be an issue with the HP NIC we were using. Nothing to do with settings as we comply with Netapp best practice.
The HP NC522/523 had this issue and it is actually well known by now. I don't think HP still supplies them.
We used different NIC and had no problems whatsoever since