The MP for Lichfield and Burntwood has apologised for suggesting he would end up punching a woman in the throat if he appeared on TV alongside her.
Michael Fabricant tweeted his comments about journalist Yasmin Alibhai-Brown.
However, he was criticised from a number of quarters afterwards.
Chris Worsey, who will stand as the Labour candidate for the Lichfield consituency against Mr Fabricant at the next General election, said the MP needed to re-evaluate the way he communicates.
“I condemn his comments,” he said. “The people of Lichfield deserve better from their MP.
“We want our area in the headlines for the right reasons, not for things like this.
“Maybe Mr Fabricant should spend less time on twitter and a bit more time standing up for local people.”
Mr Fabricant has since clarified his comments which came after a debate on Channel 4.
He wrote: “It appears that some people who don’t know me think I actually go round punching in the throat. Not true.
“If anyone believes I would seriously threaten someone with violence, I of course withdraw and apologise.
“So just for the avoidance of any doubt, I am very sorry for the tweet. It was wrong to joke about punching.”
He also said he was “sorry” to Yasmin Alibhai-Brown – but added that she was “utterly infuriating”.