Viana Pulse

Method

This page describes how we work rather than what we have achieved, which is why it can be published in full today.

1. Record the baseline first

The measurement taken before anything changes is the only one that cannot be reconstructed afterwards. It is the first deliverable on every engagement, and where a baseline cannot be established we say so before starting rather than reporting on activity instead.

2. Write the expectation down

Every change carries a stated expectation: what should move, by roughly how much, and by when. Written in advance, it is a test. Written afterwards, it is a description — and descriptions always fit.

3. Measure at 7, 14 and 28 days

Three windows, because a single reading cannot separate a result from ordinary variation. This is also why retainers carry a three-month minimum: a one-month engagement cannot demonstrate anything, and charging for one would be selling a report rather than a result.

4. Measure independently of the channel being judged

An advertising platform reporting on its own performance has an obvious interest in the answer. Conversion tracking is set up so the figures we report can be checked outside the system that produced them.

5. Publish the negative results

An approach that did not work is a finding. We record it, stop, and say so. A programme that only ever reports success is not measuring anything — and it makes every other number it reports worth less.

What we will not do

Where this is being tested hardest

We are building a system that runs this loop with as little human time as possible, and testing it on our own site before anywhere else. Its baseline was recorded at launch. It has produced no results yet, and this site claims none.

Talk about your baseline