Steps to Reproduce

1. Open the flutter gallery.
2. Go to the material text fields demo.
3. Type something in the first text field.
4. Long-press-drag to select text.
5. See how the selection handles keep flickering as you drag.

The same problem existed for drag-by-mouse and is fixed in #29563. This issue needs a similar solution.