A compliance output that cannot be verified is not evidence. It is an assertion. Regulators do not accept assertions.
Describes the ProfytAI evidence architecture for in-product obligations and workflows. Your institution remains responsible for legal interpretation, scope, and supervisory engagement.
“The FI should configure system events or alerts to provide an early indication of issues.”
Banks ask whether tools like Copilot, ChatGPT, Claude, or Gemini can replace a purpose-built compliance evidence system. This is not a question of capability. It is a question of architecture.
“Show Me Your Record for This Obligation.”
OBL-001 · Face-to-Face Contact · BSP MORB Part IX
It Improvises an Answer
Input · A Compliance Question
Searches for Fragments
Finds pieces that seem related, not the full obligation.
Generates a New Answer
A different answer every time you ask.
Nothing Is Stored
The session ends and it is gone.
Cannot Be Traced
No source text, no audit trail.
Session Ends
Dead End
Nothing stored or versioned.
It Maintains the Register
Input · The Full Regulation
Retrieves the Stored Obligation
Every obligation preserved word-for-word.
Returns Verbatim Output
The same obligation ID returns the same text.
Stored and Versioned
Persistent, reproducible, retrievable.
Fully Traceable
Source text, mapped controls, evidence.
Artifact Stored
OBL-001 · v1 · p. 412
Versioned, reproducible record.
These Are Not Two Versions of the Same Tool.
General-Purpose AI is a search and summarisation assistant. ProfytAI is a compliance evidence system. They solve fundamentally different problems.
Standard examination questions. Any compliance tool that cannot answer them is a liability, not an asset.
General-Purpose AI
Copilot · ChatGPT · Claude
ProfytAI
Evidence System
“Show me the exact regulatory text your control satisfies.”
Every examiner asks this first. The answer must be verbatim. Paraphrasing is not acceptable.
Cannot Comply
Paraphrases source text. The regulator's exact words are not preserved.
Verbatim Source Text
Stored word-for-word at ingestion. Retrievable on demand.
“Reproduce this compliance output exactly as it was generated.”
Reproducibility is a core examination requirement. If the output changes on re-run, it is not evidence.
Cannot Comply
Probabilistic by design. Every run produces a different output.
Reproducible on Record
Once generated, the output is pinned as a versioned record and returns identically on every retrieval.
“Provide the audit record and evidence chain for this finding.”
Without a stored record, there is no audit trail. Without an audit trail, there is no compliance.
Cannot Comply
Session-based. When the session ends, nothing is stored. No record exists.
Versioned Artifact
Every output is stored, versioned, and retrievable. Always.
0 / 3
General AI · Failed
3 / 3
ProfytAI · Passed
Verdict of the Test
General AI was designed to answer questions. ProfytAI was designed to produce evidence that withstands examination. These are not the same system.
These are properties of how language models work. No model, no prompt, and no configuration removes them.
Failure 01
Same query. Different output. Every time.
Under Examination
When the examiner asks you to reproduce your evidence, the output will differ. A record that cannot be reproduced on request is not a record.
Can This Be Fixed by Configuring the AI Differently?
No. Language models sample from probability distributions. Even at temperature zero, outputs vary across sessions and model versions. There is no mechanism that guarantees identical output.
Run 1
Institutions are expected to maintain a classification framework.
Run 2
Institutions should implement a data categorization process.
MAS TRM § 7.7.4 · Verbatim Governing Text
“The FI should configure system events or alerts to provide an early indication of issuesthat may affect its IT systems’ performance and security.”
AI Output
“Financial institutions are expected to configure appropriate monitoring mechanisms to ensure early detection of system issues.
Failure 02
The regulator's words, rephrased by a model.
Under Examination
The examiner asks for the exact words of the obligation your control satisfies. The AI output does not contain them. A paraphrase of a statute is not that statute.
Can This Be Fixed by Configuring the AI Differently?
No. Language models generate text. Generation means producing new words. The original regulatory text is lost in the process, even with retrieval-augmented generation.
Failure 03
A reference with nowhere to go.
Under Examination
You cite the obligation. The examiner asks for the source text your system retrieved. You cannot produce it. The citation was generated, not retrieved.
Can This Be Fixed by Configuring the AI Differently?
No. The AI infers what the citation should be based on patterns in its training data. It does not retrieve a verified source record. The reference is a prediction, not a retrieval.
“Refer to MAS TRM, Part IV (data management section)for the applicable requirements.”
Citation
Extracted
Source Text
Retrieved
Verbatim
Confirmed
Record
Stored
Not a Model Problem
Changing models does not resolve these failures. Every large language model is non-deterministic, produces paraphrase, and cannot retrieve a verified citation because these are properties of the architecture, not limitations of any specific model. No amount of prompting, fine-tuning, or configuration changes this. An evidence system requires a different architecture entirely.
Verbatim
Source Text Preserved
Every obligation stored exactly as written in the regulation. No paraphrasing. No summarization. The regulator's exact words, retrievable on demand.
Reproducible
Same Output Every Time
Any compliance artifact can be reproduced identically at any point in time. The output is the same output that was produced at ingestion.
Traceable
Every Citation Verified
Every obligation links directly to its source clause. Every control maps to the obligation it satisfies. Every evidence item is attached and retrievable.
The Four Guarantees
Every obligation is traceable to its exact source clause
Every output is reproducible on demand
Every artifact is stored, versioned, and retrievable
Every citation is independently verifiable
These properties apply to content and workflows delivered through the ProfytAI platform for covered regulatory material. They do not replace your policies, sign-offs, or external legal advice.
A language model produces answers. An evidence system produces proof. The difference is not quality. It is architecture.
ProfytAI is not a compliance assistant. It is a compliance evidence system, the layer between your institution and your regulator that makes examination a process of retrieval, not reconstruction.
Request a Demonstration
We will walk through a live compliance artifact:
obligation ID, verbatim source text, evidence chain, and audit record.