Obviously horses for courses - Canto was the first non-European language I studied, and I found the spoken form SOOOO much easier than any of the European languages I had worked on over the years!! Those included Romance, Germanic, and Finno-Ugric ones, in the unlikely event that anyone is interested. One 3 week intensive course taught me all there is to know about the grammar, tones, and enough basic vocab for me to pick up the rest on my ownWritten Chinese is a whole 'nother ball game.
Anyway, different people's brains work differently, but I'd certainly at least give Cantonese a chance.