Thanks for your feedback I completely agree with you, plenty of open-source projects are easily comparable with their closed-source competitors, and Umbraco definitely falls into this category.

From what I’ve seen of the product so far, I wouldn’t hesitate to use Umbraco in a live production environment.

Thanks for mentioning umbraco. Even though it’s free (open source) we’re actually more and more often used in projects where the two systems mentioned above where mentioned too

Some open source projects have matured so much that they can be compared to closed source projects (I don’t use the term commercial, as umbraco in many ways is a commerical product – I do get paid from developing and supporting umbraco). As licensing usually only covers around 20% of a CMS budget (according to leading cms experts like cmswatch.com or bnp.dk) I do believe that you should benchmark open source in the exact same way as closed source systems.

That way you can either be surprised how much they look like each other. No matter if you look on a closed or open source system I believe that activity and openness (evaluation, support, status as in open bug repository etc) should be among the top criteria when evaluating a cms.

Cheers,
Niels / umbraco.org