Considering moving across the country with baby... twice...

My (34m) girlfriend (30f) is currently pregnant with our first child. We currently live in Georgia. Before I met her, I started remodeling a house in Colorado to add an additional rentable unit onto the property. I don't think I will have the money to afford paying someone to finish my work. The work required is quite extensive, I have extensive remodeling experience myself, and I have friends who are plumbers and electricians who have been able to tell me how to correctly finish each step to finish the project. If I do the work myself, I could probably save somewhere between $60,000 to $100,000.

I'm considering moving with my girlfriend and child (after it is a couple of months old) to Colorado, living there for 6 months to a year while I finish the work, and then moving back to Georgia. We would be driving. Would driving across the country and back be something that could cause my very young child any psychological or developmental issues?

More details:

The house out there is currently rented, so it is paying for itself in the meantime. But it would make a lot more money once the other unit is completed. There are also long term things on the rest of the house that need to be addressed as I'm finishing the new unit. Completing this project needs to happen at some point, and I'm thinking it would be wiser to do it now rather than when the child is any older.

I still work for a company out in Colorado, just remotely. So employment during our stay wouldn't be an issue. I also make a little bit of money from other investments. I make about $80,000 a year, so the cost of paying someone else to do the work would be quite the burden. Completing this project would definitely help us financially and set us up to have my girlfriend stay home full time with our child permanently.

The remodeling work could be contained to a separate wing of the building, so the concerns with construction dust around a small child aren't *too* concerning to me as long as we are responsible with keeping everything under construction sealed off and the rest of the house filtered. The sound will likely be more of an issue as I'd probably have to do a lot of the noisey work while the baby is out of the house.

We would be able to take our time driving across the country as needed to give the baby (and us...and the dogs...) breaks. I would be planning to take at least a week on the drive. We have relatives to stop and see along the way too.

We want to move back to Georgia because that is where her family is, and the cost for buying a forever home for ourselves is significantly cheaper than in Colorado. We have no connections to Colorado other than its where I got my job and I have this house remodeling project that I need to finish. We don't plan to live there permanently in any scenario.

Ask me any questions you have.