I use the crate with: a bed inside, food bowl, water bowl, safe toys, something safe to chew on.
Being your pup is such a baby yet some crying is expected and also the newness of the whole adventure period.
I take my pups/dogs out to go potty every 2 hours at the most ... but generally like to take them out every hour when they are this little. I take them out after they eat or drink a lot, wake up from a nap, or play. I like to play with them for 30 minutes before returning them to their crate. I then put them into the crate and give them a small treat such as a biscuit so they associate the crate with all good things. It is also a good idea to put a kong toy with a few kibbles in it for them to keep busy with .... which also stimulates their little brain. Their brain is a sponge right now at this age. Once again ... a positive experience. Every experience in that crate should be made positive.
If you know your pup has eaten and is full and has gone potty and got to play for a bit and then begins to whine after you put him in the crate ... ignore. When the pup gets quiet ... praise and take out of the crate. The pup will eventually learn that being quiet is the only way out.
Good luck ... and remember you have just a baby yet. It takes time and patience and all will fall into place if you work hard and try the best you can with positive reinforcement.
Oh ... and congratulations on your new addition!