Rouven Leuener

Group head of digital product at Neue Zürcher Zeitung

Warning: Liveblogging. Prone to error, inaccuracy, and howling crimes against syntax and grammar. Post will be polished up over the next 24 hours

The Cambrian explosion in the planet’s pre-history led to a dramatic growth in species and biology. This isn’t a biology lesson - but at NZZ we achieved things, and created a sort of Cambrian Explosion.

The advantage of the digital age is that you can be customer-focused and data-informed. Take advantage of that to build something that works, because you nee the right model. There is plenty to admire about the New York Times for example, but I don’t think it’s a good example of paywall. In Switzerland, we have fewer people to stuff the end of the funnel with - so that’s we came up with the dynamic paygate model.

The site gains about 10,000 registrations per month - and has increased conversion five-fold over the past the last few years. Here’s how.

Iterating the paygate

Between 2012-14 the paygate was IT managed and inflexible, and changes took weeks to make. The conversation rate during this period was 0.5% - they were converting fans.

From 2015-17 they moved to a flexible metered paygate, taking into account a range of factors, including the number of pages viewed per user, the sorts of stories read , the source of the traffic and so on. That brought conversion up to 1.2%.

From that data, they build some hypotheses, and used machine learning to identify patterns - and then iterated again and again from there. That got them up to a 2.5% conversion rate. For example, they changed personal greetings based on the source of the traffic. They showed different groups different pricing periods (week, month, year) based on their modelled likely interest.

By 2018 they moved to propensity modelling - for every user they calculate their propensity to convert every night. Again, they’re using as much data as they can. If a user is not into the top 20% of the propensity score, they see the standard rules set. That top 20% is split into A/B testing between the standard ruleset and a specialised rule set.

They’re now in phase 5, the Omnigate, where they’re aiming for a conversation rate of >5% based on a mix of retention and conversion models.


  1. You don’t sell on Saturdays
  2. Mornings: a lower price on a previously seen offer converts better
  3. At lunchtimes, economic and local content reforms better
  4. Accounts between 18 months and 2 years old have the greatest chance of converting


They decided to build their own personalisation system, because the systems they saw out there were unsatisfactory in many ways. They wanted a system that was both algorithmically and rule-based. Their aim was to allow people to ind relevant content ore easily NOT increase page view per session.

They use a mix of an editorial score, a crowd score and the user’s interest history to generate recommendations. The editorial score helps counter the filter-bubble effect. It’s important to use hybrid modelling to balance all these elements.

They create a personalised list from the articles since your lats visit - in three, time-dependent forms.


They built a text-to-speech engine because there was a clear desire from the readers for alternative ways of consuming articles. The audio articles count towards the paywall.

An Agile Organisation

The company uses agile approaches to interstate prototypes rapidly and ship them facts. They use co-creation with users. They use scrum for development, and work in multi-disciplinary teams in design sprints - including editorial.

OKR is the goal-setting tool they use. It manages priority setting, communication and accountability.

Key Advice?

  1. Generate velocity
  2. Focus and adaptive strategy
  3. Pushing Flexibility