I have a lemon tree in my sunroom that is currently bearing fruit. Can I re-pot it now or should I wait?

So I have a tiny lemon tree that I got last summer. It's bearing fruit already, but also looks pretty unhealthy so I picked off about half its fruit and buds early on (like, a couple months ago), so it wouldn't be spending all that energy.

It also needs to be re-potted and I have a fancy big pot for it.

Is it safe to re-pot it while its fruiting, or will it panic and go into shock?

Also I acknowledge that I may fundamentally misunderstand how plants work.

image-1466556035010.jpg