I'm buying a house and its seller wants to buy mine: Can I 'gift' it to them and avoid stamp duty?

Would it not be possible for us to do some form of swap where I essentially pay them the difference to reduce the stamp duty?