Leather handbrake cover

[Markusw86]

Hi all, new here, I have a toledo tsi and it's probably a silly question but I accidently got my handbrake stuck up too high , I did get it back to normal but the leather cover now slides past the end is there an easy way to sort it or is it just as simple as keep trying to push it back down to stay?