Currently we create a new state for every pipeline,
however this doesn't provide coverage for states that
were already in use. Keeping a long lived state for
each branch will give us more confidence that changes
are backwards compatible.