Can I take the button from one pair of jeans and put it on an other?

I have a pair of jeans that now fit me, but they have no button while I have a pair that are too large that do. I was wondering if anyone could tell me if I can take the button off of the bigger pair and attach it to the smaller and give me instructions on how to do so if it is possible.
I cannot cut it off and sew it on as it is a rivet...

Since it's a pair of jeans, and not a pair of tweed or twill pants, I'm guessing that it's the grommet style button. In that case, unless you are the incredible hulk or just happen to have a grommet separator hanging around the house, you can't do it. If it's a two or four hole button, that's a different matter.

Old Blue Jeans (Karaoke/Instrumental) - Hannah Montana