I didn't look at your projects, but just some ideas:
i think you need to take some additional debugging steps. make a test project that sends each packet with verifiable information (CRC) plus timestamp.
you may be making assumptions such as arrival order, and the timestamp could help you detect that. the crc will help you verify your data integrity.