Hi Renjith,
With new bootargs recommended by you, the error was still there.
From the wireshark at NFS host, the board successfully sent ARP request to server. Server replied. But it seemed the board didn't receive or was unable to handle the reply. Is this related to uboot?
Please check the snapshot. Wireshark log is attached as well.