Verification Logs

Answer the question six weeks later.

Fraud decisions are never argued about on the day. They are argued about when the chargeback arrives, when a customer complains about a hold, or when someone asks why the team let that one through.

Verification logs

AllLowMediumHighCriticalLast 24 hours
  • #104209:1478High risk
  • #104109:0254Medium risk
  • #104008:4724Low risk
  • #103908:3112Low risk
  • #103808:1291Critical risk
The gap

The decision is made in a minute and defended for a year.

Somebody looks at an order, decides it is fine, and ships it. Six weeks later the chargeback lands and nobody can reconstruct what they were looking at.

The same thing happens in reverse. A held order turns out to be a real customer, and the only record of why it was held is a Slack message that has scrolled away.

So every assessment is kept: the score, the findings, the reasoning, and the recommendation, against the order reference you supplied. A second run on the same order adds a row rather than replacing one.

What is held

The assessment, not the customer

The log is deliberately thin on personal data. It holds the conclusion and the evidence for it, and joins back to your system on the order reference you sent.

Order reference
The order ID you supplied. It is the join key back to your own system, and it is the only piece of the order payload that is written down.
The assessment
Score, level, every risk factor with its severity and category, the written reasoning, and the recommendations.
Organization and time
Which workspace the verification belongs to, and when it ran. Every run is its own row, whether it came from the dashboard, the API, or the Shopify app.
Cost, separately
What the verification consumed is recorded on the credit ledger and the AI usage record rather than on the log row, so billing and evidence stay independent of each other.
Not held
Customer names, emails, phone numbers, addresses, payment details, IP addresses, and user agents. These are used for the analysis and are not written to the database.
What it is for

Four uses, in order of how often they come up

Most common

Representing a chargeback

The findings from the day the order shipped, in writing. That is a stronger position than a memory of a decision.

Second

Tuning your own threshold

Compare what scored high against what actually turned into fraud, and move the line your team acts on.

Third

Explaining a hold

A real customer asking why their order stopped deserves a specific answer, and the reasoning is written for exactly that.

Fourth

Watching an account over time

Repeated runs on the same customer show the pattern rather than the snapshot.
Alongside the log

The dashboard reads the same data

Volume, band distribution, and credit consumption over time, so the question “is this working” has a number rather than an impression.

Orders scored

this month

Share in each band

against last month

Credits consumed

and what is left

Logs

Retention and access

How long are logs kept?
For the life of the organization. There is no rolling window that quietly deletes the assessment you need, because the chargeback that makes you want it arrives months after the order.
Can we export them?
Yes. The logs are readable through the dashboard and through the API, so pulling them into a warehouse or a reporting tool is a scheduled script rather than a project.
What happens when we re-verify an order?
A new row is written to the log, and the earlier one stays, so you can see that an order which scored 40 in March scored 82 in June. The panel on the Shopify order page is a cache of the latest result, so it shows the new score; the history lives in the log.
Who in our team can see them?
Every member of the organization. Logs are scoped to the workspace, so an agency running one organization per client keeps each client’s history separate by construction rather than by permission.
Do the logs contain customer personal data?
No. Only the order ID you supplied plus the AI output. That is a deliberate limit: it makes a data subject request straightforward and it means a breach of this database does not expose your customers.

Score a week of orders and read the log.

Five free credits is roughly twenty orders. Enough to see whether the scores agree with what you already know happened.

5 credits on signup · no card required