The process with Godaddy took about a week. Between Yola releasing the Domain and Godaddy completing the move. Then it took about 48 hours for all of the forwarding to really work properly between Godaddy and Google sites.
I learned a valuable lesson here. Always back your site up and own that domain.