After you fight the Galactic team boss, Cyrus and capture Palkia, Dialaga get the power orb, the farmer that you saw earlier is now gone and you can go directely the SunyShore city P.s. There are about 5 to 10 players on your way.