I'm always amazed at how few people have read The Making of the Atomic Bomb by Richard Rhodes.

It covers the physics, politics, motivation, cultural implications, and so much more. It's one of those books where being extremely long is a feature because it's unbelievably interesting. I highly recommend it.