An evidence-based assessment is a vendor review in which every conclusion is tied to a specific source, such as a clause, page or test result in the vendor's documents, rather than to unverified questionnaire answers or reviewer judgement alone.
What Evidence-based assessment means
The approach starts from what the vendor can show. Each requirement is checked against a document, and the result records where the answer came from. A missing document or an unsupported claim becomes a finding in its own right. Gaps stay visible.
It makes reviews repeatable and auditable. Two reviewers checking the same requirement against the same evidence should reach the same result, and an internal auditor or supervisor can trace an approval back to the page it rests on. DORA and the EBA outsourcing Guidelines both expect financial entities to document their pre-contract assessments.
Evidence-based does not mean automated. Judgement still decides what a finding means for this relationship, but the judgement is recorded with its reason next to the evidence. The result is a review that a new team member, an auditor or a supervisor can follow without asking the original reviewer what they meant.
What to check in vendor documents
- Each requirement for the tier has a reference to a source document.
- The evidence is current and in scope for the service.
- Claims without evidence are recorded as gaps, not as passes.
- Reviewer decisions include the reason.
In ProcureCortex
ProcureCortex is built on this approach: every finding names its rule and keeps the excerpt and page, and a reviewer accepts or overrides it with a recorded reason.
How an assessment worksRelated terms
- Explainable AI findingAn explainable AI finding is a result produced with AI assistance that shows its basis: the rule it was checked against, the evidence excerpt and location it relies on, and enough context for a human reviewer to verify or reject it.
- Vendor due diligenceVendor due diligence is the assessment an organisation carries out before contracting with a vendor, and again at renewal, to confirm the vendor can deliver the service safely and meet the legal, security, financial and operational requirements that apply.
- Vendor questionnaireA vendor questionnaire is a structured set of questions sent to a vendor about its security, privacy, resilience and compliance practices, used to gather information for a risk assessment, often alongside or instead of documents.
- Risk acceptanceRisk acceptance is a documented decision by an authorised person to proceed with a known risk without further treatment, recording the risk, the reason, any conditions and when the decision will be reviewed.
- SOC 2 report (SOC 2)A SOC 2 report is an independent CPA firm's attestation report, under AICPA standards, on a service organisation's system and its controls relevant to security, availability, processing integrity, confidentiality or privacy, measured against the AICPA Trust Services Criteria.
Sources
- Interagency Guidance on Third-Party Relationships: Risk Management, 88 FR 37920 (June 2023)www.govinfo.gov/content/pkg/FR-2023-06-09/html/2023-12340.htm
- Regulation (EU) 2022/2554 (DORA)eur-lex.europa.eu/eli/reg/2022/2554/oj
- EBA, Guidelines on outsourcing arrangements (EBA/GL/2019/02)www.eba.europa.eu/activities/single-rulebook/regulatory-activities/internal-governance/guidelines-outsourcing-arrangements
Summarised for practitioners, not legal advice. Check the source text for your own obligations.