Are you mean after wait for 5-10s send UDP data, there will be a increased latency?
(e.g: Client sent UDP data, server received with a big latency maybe received after 20s )
Yes that seems to be the case.
The first UDP package is sent with an expected latency. If I keep sending packages with a delay of about 1 second, the latency stays more or less the same.
If I stop trasmitting for 5-10 seconds and then send another UDP package, this package will have an increased latency. In the range of ~5 seconds, not 20 seconds.