You have to get an invite from the other guild in order to get into the new one, so pm the guild leader, and they'll help you out. (you'll find invites in your events tab and the same spot you found "Your Guild")
P.S. you may want to edit that title :p