Been there, done it.
Here's my '09 FX4 with the same panels...hated them right from day one, decided to remove them.
I used a heat gun and a pair of vice grips, and then had to go back over the adhesive that was left on the paint with GooGone.
No worries on the paint coming off, they're only held on with two sided tape, but goddamn, it's friggin' near hurricane proof.
Word of caution though....mine were brand new, on a brand new truck.
Some guy ordered it, wanted the chrome package installed, and then the deal fell through.
I drove it for less than a month before I couldn't take it any more, snapped, and started the removal process.
It's a slow go, might have been better to let the GooGone soak in, but it will work.
I'm not sure how things will go for ones that have been on for over four years though....sucks that bad, strip them off and you can always prep it and paint it.
Here's how my story ended : Best of luck to you.