I think it's pretty random. Their potential could increase or decrease.
Some of it depends on your coaches and how good they are at training that position/skill set. In the case of QBs, it would be your QB Coach, Off Coordinator and Head Coach. Head coach has the most impact.
I'm sure others can elaborate on this better than me.