Yes, chocolate milk is generally considered yummy.
Chocolate milk is a popular beverage, especially among children, largely because of its sweet and appealing flavor. The reference states that "Chocolate milk is loved by kids (and adults) because of its delicious flavour." While taste is subjective, the widespread appeal of chocolate milk suggests a generally positive perception of its taste. Furthermore, the reference points out that nutrition guidelines for school-aged children support flavored milk as a regular choice, likely due in part to its palatability and its ability to encourage milk consumption.