I've never had this issue, so cannot help with specifics. But, I'm going to suggest how you might get some helpful clues to give to the pros on, say, https://discussion.fedoraproject.org.
Open up a terminal app, such as Konsole, and in it run "sudo journalctl -f". Leave it running through at least one of your touchpad problem events. Look through that for suspicious touchpad-related messages.
Good luck!