What do kumquats taste like? Are kumquats sour? You might be asking. I find raw kumquats to be a downright assault on my tastebuds but roasting them completely changes things. I love them like this. They remind me of little jewels in their looks and general intriguing, mysterious appeal. They become sticky and chewy with better texture than craisins or raisins.