No, you don't because it's not a proper noun. if you said "As he traveled around the United States," that would be capitalized.
Do You Capitalize The Word "Country" When Referring To The United States Of America? E.g., As He Traveled Around The Country, He Ate A Lot.