The crowds eliminate the errors of a editorial statistical sample of one but there is a point at which UGC is too hard to navigate. Ever tried surfing YouTube? Just going to the YouTube homepage with no plan in mind and looking around for something to watch rarely produces entertainment. Compare that experience to going to Break.com or Digg Videos where an editor or technology backed by the community has produced an easy list to tell you what they think you should watch. There are less videos on Digg and Break, and you may not like the ones you see, but you can be certain that you will find easily something to watch that does not involve a cat or an idiot miming Justin Timberlake.
Travel reviews and content are similar. As much as I shift from giving Lonely Planet a good and a bad time for their online activities there is a sense of comfort and certainty you get from reading a Lonely Planet story or recommendation. This comfort comes from their brand, their readership but mainly from their editorial rigour. They send someone to everywhere they review and they send them back again and again. This is the pure editorial model. The positive of it is that trust is already established and time and energy is spent maintaining that trust. The downside is that it is less reactive. The editorial based product sometimes misses updates because its research or publishing cycle is...well.. by definition a cycle and not immediate.
In the wisdom of the crowds model you throw as many human beings as you can at a problem/issue/thing/wall and hope that the accumulation of knowledge produces the right answer and that the right answer can be filtered by those looking for it. This is what TripAdvisor does and there is a point at which for every hotel they have their is a terrible review (room sucks, staff awful, never again), a brilliant review (love it...oh my God I love it) and a whatever review (it was ok, kinda, sorta, you know). I discussed this my "Who you callin' ugly post" about Travelpost.com.
As with all these things it is about balance. You need the crowds to give you the immediacy of updates and the statistical spread but you need the editors or trusted uber user to help you sift and order the information. This has problems of scale (how do you balance controlling quality across a huge range of destinations and information) and openness (to be an editor involves cutting out some of the crowd - a crowd that can get ugly when you cut them out).
My thoughts on how to balance this are the same as for a transactional site/intermediary that has thousands of hotel/supplier options. In the early days of hotel/air intermediaries there was discussion that as some point a limit to the number of choices would arise. How could a consumer possibly look through 10,000 hotels, then 20,000 hotels, then 30,000? Now people like HRS and hotel.de are claiming 200,000+ hotels. The answer is more than better search technologies. It is combing technology, merchandising/rev management smarts and user reviews to generate sort order biasing. This is the approach that content companies need to follow. Match UGC with editorial biasing.
This thinking came to me in an email exchange with a startup pitching itself as the review/information site that has found the balance. The email exchange was with Jim Johnson Vice President of Product Management of LocalGuides.com - itself a spin off from a local search company called LocalMatters. The LocalGuides site is a site that wants to provide...well...local guides. Detailed information on destinations about activities, restaurants, hotels etc. Jim and I had a very interesting mail exchange on the how they would find the balance. Here is what he had to say...
"Our approach to Local Guides has been to seed the site with the key editorial content to provide users a starting point to iterate based on their own local expertise. The interesting transformation is the community has used the tools to create a personal publishing platform (think blogging on steroids) in ways beyond what we originally thought. Guides have been created around making sushi at home, best concert venues and how to get out of the doghouse with your wife. We expected more top 10 restaurants’, hotels and bars to be the norm. The distinguishing focus on Local Guides is in its “personal local publishing” orientation; rather than aggregating all user’s content into one summary view of a business or place, it supports each user’s unique views as “guides”, and builds community around exploring, sharing and relating to “individual voices”. While sites like TripAdvisor, while highly useful for opinion aggregation, we aim to retain the opinion and viewpoint of each individual. Somewhat more of a “reporter’s view”, if you will."Their view is that the editors set up the framework, provide the basic facts and guidance and then let the crowd fill in the detail with more freedom than you see on TripAdvisor. It is hard to provide much commentary on their approach and whether it will work as the site is in beta - though I would call it very early beta maybe even alpha as there is a lot more content that they need (editorial or otherwise). I like the idea but not sure if that will provide the balance I have discussed. If you give the crowd too much control you risk looking like the comment list in a popular video on YouTube.
Been a bit of a long post but would be interested to hear your thoughts on getting the balance between the crowd and the editor.