For your wife and yourself what it boils down to is deciding which do you value most: A quiet and peaceful life or a world of endless possibilities and stimulation?
You mentioned moving to Chiba. This may sound good in theory, but In reality you will end up with worst of both worlds- all the limitations of the countryside without the benefits of a metropolis. Depending on where you live you might have to own a car or take a bus which will needlessly devour your time and earnings. Also, if you find a job in Tokyo your commute would be much more hellish than if you lived close to your job in the city.
If living near Tokyo Disneyland is your only reason for this decision, remember that you can get there from most places in downtown Tokyo in about an hour. Also, if you have children they may I love it when they are young but as they get older they may grow to hate its superficiality and unattainable version of the world.
You said you did not enjoy Shinjuku and Shibuya. I would suggest taking some time to explore the all of the 23 core Tokyo wards. There’s truly something for everyone. The mere fact that Haneda International Airport is, at most, 45 minutes away from most areas is a game changer if you love to travel. Unlike most megacities Tokyo is probably as safe or safer than living in the countryside. This in addition to access to a larger choice of quality housing, international schools, medical care, entertainment, socializing, dining, the list goes on…
You also said you wanted to start a family. Raising children in Japan is problematic. Unless you have the resources to send them away to foreign school, for at least part of high school and most of University, there’s a good chance that they will be intellectually and culturally stunted. (Living in Tokyo’s 23 wards may somewhat mitigate the cultural problem). With a few rare exceptions Japanese universities are (how should I put this diplomatically) the object of ridicule among developed world academia. Your children’s opportunities for life and employment would most likely be relegated to Japan only.
Lastly, like someone else on the thread said, your profession affords you with a great deal of flexibility. You’re in high demand so there’s no reason tie yourself down to a commuter cultural wasteland prefecture like Chiba or Saitama. Also, as a caretaker your shifts are available 24 hours a day. You could thus easily avoid rush-hour. Good luck and let us know how it goes.