Push layer around with joystick?

I know i can map a joystick to xy but is there a way to make the joystick push the layer around rather than directly moving it? for example i have a logo i want to move around with the joystick of a xbox controller but directly mapping it means i cant leave it anywhere on the screen and it will return to center. can i make the xy mapping additive in this way?