You have to debug your app. Your app may be dropping decode frames. decode link will not drop frames.If you drop frames to be decoded in your app you will see decode errors . The stats doesn't show any performance issue.
You are selecting wrong scaler id. SYSTEM_SW_MS_SC_INST_DEI_SC should be used only for interlaced content.