WordPress and Democratizing Algorithms

In discussing how the newly released Jetpack Search fits with Core WordPress search I veered off into discussing algorithms in general. That generated some healthy discussion on the WPTavern Podcast. I wanted to expand on what I was saying a bit about democratizing algorithms. This is very much related to what JJJ called “race car technology makes its way down to everybody” on the podcast.

I think some of the negative reaction is a personal preference where many readers loudly prefer reverse chronological because it is easy to understand and they feel in control. I think that is a very common opinion among WordPress developers. I’ve had that discussion many, many times. I also think that user control is important.

However, it is very clear that ON AVERAGE having some algorithm filter or reorder the content is much more engaging. It boosts visitor engagement.

Let’s look at some top examples: Twitter, The New York Times, The Washington Post, and Amazon (30% of humans use Facebook, so let’s stipulate that algorithmic is working pretty well for them).

Twitter

Many people are loudly complaining about Twitter not being completely reverse chronological. However, as a product and service, they just had their first profitable quarter ever. And it wasn’t because they have more users. Monthly active users is flat. But daily active users increased 12% year-over-year. They have steadily made their product more engaging to the average user. So while yes many people dislike the algorithmic changes they are making, they also seem to be working.

New York Times and Washington Post

nytimes-top.pngwashpost.pngBeyond even human “algorithms” that order which articles are on the front page, it is very common to have algorithmic sections of the front page of major news sites. Sometimes it is “most emailed stories”, or sometimes it is the most viewed. The current NYT’s home page has a section which looks like the top posts from across the past few days in a nice scrollable display. Maybe they are hand picked, but I bet there is data influencing them. The Washington Post has “Most Read” and “Live Discussions” sections.

Even on this blog I’m using Jetpack’s top viewed posts widget and Jetpack related posts. Both are things that WordPress Core can’t do.

Amazon

Algorithms are everywhere on Amazon. Let’s look at the dog food I buy. The reviews are clearly sorted by what will get me to buy it.

dog-food.pngHow could I not buy it!

It is about Engagement!

None of these examples are easy (or cheap) to deploy right now. It is still pretty hard to build an engaging website. Maybe building an engaging website is plugin territory. That sounds great for Jetpack which has more and more of these features. I’m not sure it is great for the Web though.

This even comes up with simple websites. Gutenberg opens up very interesting questions about how blocks should be organized on a web page. Chris Lema mentioned this when discussing the future of web publishing:

The future can’t continue to be a unidirectional dynamic where someone in marketing determines the best articulation of their message in a single-focused and static design.

The future of publishing is that different people can get different content depending on their behavior, demographics, interest and more.

I think framing it as personally preferring algorithmic vs chronological is really the wrong way to think about it. The question is, if you could flip a switch and get your visitors to spend 20% more time on your website, then would you?

Right now, only big expensive web sites can toggle that switch. Many of them are effectively monopolies. Let’s democratize algorithms so any website can choose to build a highly engaging user experience.

An Aside

While we can and should talk about filter bubbles and the impact that these algorithms have on the world, a world where only monopolistic tech giants can deploy these algorithms is not one where publishing is democratic.

 

Struggling with Content Ordering

I agree in freedom of speech. I agree in democratizing publishing. I agree with giving a voice to everyone with as small a barrier to entry as possible. I’m not sure anymore what I think about “neutral” algorithms, code, and design. Optimizing only for what users interact with, or click on or what can be measured is always problematic, but maybe its bigger than that.

Neutral unbiased ranking of content is what is currently building and reinforcing the bubbles on the Web. Treating one like as being just as important as another, one comment as just as important as the next. Treating one vocal community’s ideas as just as important as a comment by someone who’s spent their life focused on deeply studying something. Letting that vocal community then shape and reinforce the opinion and content of the web. Forcing others to spend their time fighting back because “someone is wrong on the Internet”. The lack of context around who is speaking is glaring.

If the medium is the message, then what does it say that our mediums use collaborative filtering so that users never see anything other than what is within their own bubble?

But simple reverse chronological sorting fails on so many levels. It is transparent and easy to implement, but it does nothing to combat information overload. Nothing to engage users.  It optimizes for people who have the time to keep up with some particular stream of content. Or for those who are online all the time and so can keep up with an infinite stream. It can only ever engage those users who are already super engaged with that topic or website. A chronologically sorted website seems unlikely to create the level of engagement that a site like Facebook creates by optimizing to keep users within their own bubbles.