How about playtime? Or just spending time with him? If he's inside his crate unless you're training him, then of course he's not going to like it. He wants to be outside the crate, with you.when hes inside he gets put in his crate if we aren't training him.
And the fact is, you want a dog who's really housetrained. Six months from now, a year from now, do you really want to have a dog you can't trust out of his crate for fear of peeing accidents? Better to work on it now.
Try keeping him tethered to you. Stay right by his side, and when he shows any sign, get him out ASAP. You really have to be vigilant in the early stages of training. Boy, do I remember that with NO fondness. It's not fun, but it's necessary.