The experienced left-back is approaching the end of a successful loan spell with Hull City, who are keen to sign him for next season.
Any deal however hinges on whether Nottingham Forest will come to an agreement with Rogers over the last year of his contract.
He told the Hull Daily Mail: "I've spoken to my agent and he said that Forest weren't really playing ball. I half expected that but hopefully things could get sorted within the next week.
"I don't want to go back and as daft as it sounds, I'd rather go on gardening leave than return."
Rogers was left in limbo after a bust-up with former Reds manager Gary Megson, and he added: "The league Forest are in next year has no bearing on where I play because I don't want to go back there full-stop.
"I know the two caretakers at Forest and I never had a problem with them - my problem was always with Megson.
"He projected a lot of things to the fans and the board.
"Some of them were hilarious, especially when he said I'd been posting tactics on the Internet.
"Whether Gary Megson believed it or not, I have a life outside football and I certainly don't spend my time playing on the Internet."