Haha I know I'm not Australian. That advice was coming from a fellow foreigner who has lived a decent amount of time in Australia and any one of us will definitely advise fellow newcomers to stay away from vegemite.
I KNEW IT! Remove that Brisbane from your profile at once!
Don't listen to her OP, Vegemite is fantastic! Vegemite on toast is how the vast majority of Australians start their day. Although Tim Tams are a little bit more easy on foreign taste buds, particularly given that they come in about 20 varieties these days which include white chocolate and pink.