It turns out that I set the wrong qmss queue in the srio cfg structure , code is like this:
int CORE_NUM=0xFFFF
I used coreToQueue[CORE_NUM] as queue id without setting CORE_NUM as i used core_id to identify core id. So the weired things happens. Case closed.