This could cause us to stop sending config updates, since we're still
waiting for the previous one to complete. This is probably the cause
of threshold changes, etc. not being applied.
This fixes the pad flickering when dragging the color slider, because it
could briefly use an out-of-date configuration (only really visible when
going between red and white on the left).