Former Liberal backbencher Craig Kelly says he's been subject to a "smear campaign" from both sides of politics