I tried making some changes to the client / server to fix this, let me know if you see improvements, the changes are live!