DATA & ANALYTICS

Creating a Trusted Data Foundation

VYSoft White Paper · 11 min read

DATA & ANALYTICS

Data programmes are among the most frequently restarted initiatives in large organisations. This paper argues that the usual failure is one of sequencing — governance introduced as policy rather than grown from a working example — and sets out an alternative.

In brief

Start from decisions, not from platforms. Define the small number of terms that appear in leadership conversations, give them owners, make the data behind one important decision trustworthy, and let that become the pattern. Covers definitions, ownership, quality, integration and the measures that show whether trust is improving.

1. Why comprehensive programmes struggle

The standard approach — catalogue everything, define everything, consolidate onto one platform, then resume — is defensible on paper and fragile in practice. Benefits arrive late, so funding is exposed for a long period. Scope is enormous, so progress is hard to demonstrate. And by completion the business has changed, so some of the work is already stale.

More fundamentally, it treats data quality as a project with an end. It is an operating property, sustained by people who notice when it slips.

2. Start from a decision

Choose a decision that is made regularly, matters, and is currently made with difficulty. Then work backwards: what information does it need, where does that come from, and what is wrong with it today?

This produces a bounded scope with a visible beneficiary, and it surfaces exactly the definitional and ownership problems a general programme would spend months cataloguing. The work is the same work; it is simply prioritised by something other than completeness.

3. Definitions before tooling

Most disputes about data are disputes about meaning. Two teams both report customer numbers correctly under different definitions.

For the fifteen or twenty measures that actually appear in leadership discussion, record: what it counts and excludes; the authoritative source; how it is calculated; who owns the definition; and when it last changed.

Keep this somewhere people will actually look, and treat changes as decisions with consequences. This is not a catalogue exercise — it is a short, high-value document, and the discipline is in maintaining it rather than in producing it.

4. Ownership that means something

Stewardship fails when it is assigned without authority or time. Real ownership means a named person who can decide what a term means, is accountable for the quality of that domain, is consulted before changes affecting it, and has capacity allocated for the work.

Better to have three domains genuinely owned than twenty nominally assigned. The nominal version is worse than nothing, because it creates the appearance of governance while leaving the same gaps.

5. Quality at the point of capture

Quality problems are cheapest to fix where data is created and most expensive downstream. A field entered inconsistently by a hundred people produces reconciliation work forever; the fix is usually a form design change and a conversation about why the field exists.

A workable order: fix capture where it is causing the most downstream effort; monitor quality continuously against agreed rules rather than auditing periodically; make quality visible to the teams whose data it is; and remediate historical data only where a specific use requires it. Comprehensive historical cleansing is expensive and, absent a fix at the source, temporary.

6. Integration patterns

Integration approach should follow how the data is used.

Analytical use — batch movement into a warehouse or lakehouse is usually appropriate; latency requirements are modest and query patterns are broad.

Operational use — where a process needs current data from another system, event-driven or API integration is generally right. Batch replication for operational purposes produces the staleness problems that make people distrust systems.

Master data — entities that exist in many systems need a deliberate approach to which system is authoritative, how changes propagate and how conflicts resolve. Left implicit, this is a recurring source of contradiction.

The common mistake is applying one pattern everywhere, usually the one the current platform makes easiest.

7. Access and privacy as foundations

Consolidation increases both usefulness and risk. Classification, access model, retention and the ability to answer requests about personal data should be established as the foundation is built, not added once it holds something sensitive.

Where personal data is involved, the practical questions are: do you know where it is, can you explain why you hold it, can you find all of it for one individual, and can you delete it where required. Retrofitting affirmative answers is materially harder than designing for them.

8. Analytics people will actually use

Adoption failures are usually not tooling failures. Common causes: answers arrive after decisions; nobody trusts the numbers because definitions are disputed; the interface assumes analytical fluency users do not have; or the analysis does not map to a decision anyone makes.

The remedy is to design from the decision backwards, which also settles latency and granularity requirements that are otherwise guessed at.

9. Measuring trust

Data quality metrics are necessary but insufficient — they measure the data, not whether anyone believes it. Better indicators:

  • Time from question to trustworthy answer.
  • Frequency of disputes about whose number is right.
  • Volume of manual reconciliation still being performed.
  • Proportion of critical terms with a documented definition and a named owner.
  • Whether decisions are made on the reported numbers or on instinct.

10. A first ninety days

Weeks 1–3. Choose the decision. Map the data behind it. Identify definitional conflicts and manual reconciliations.

Weeks 4–8. Agree definitions and owners for the terms involved. Fix capture where it is causing most downstream work. Build the integration the decision needs.

Weeks 9–12. Put it in front of the people making the decision. Measure whether it is used and whether it is trusted. Document the pattern so the next domain is faster.

The output is one decision better supported, and a demonstrated pattern. That is a stronger position from which to seek broader investment than any assessment document.

How VYSoft can help

VYSoft works with organisations on data strategy, governance design, integration and analytics delivery — with a preference for incremental foundations built around real decisions.

Talk with VYSoft about this topic →