
Reviews
Part of Why short form video reviews need a method you can audit
How to assess short form video agency reviews in the UK
A practical UK method for checking short form video agency reviews, spotting weak or incentivised claims, and comparing evidence before you choose.
What to take away
- The ICO's direct marketing guidance, updated in 2024, is the reference point for the lawful basis behind any data-driven short form video campaign.
- Most published agency reviews describe creative output and account management, not measurement, data handling or contract terms.
- A review is a claim, not evidence. Treat it as a lead, then verify separately against your own brief.
- Under the Data Protection Act 2018, the agency processing your audience data carries duties you remain accountable for.
What these reviews actually cover
This piece reviews how agency reviews are written, not how any named agency performs. No agency was briefed, tested or contacted. Nothing here is hands-on testing, and no vendor supplied material for it.
Agency reviews and client comments appear on Google, Trustpilot, Clutch and G2; discussion and recommendations also appear on Reddit and LinkedIn, while trade press covers agencies and campaigns. Most assess three things: creative quality, speed of response and value for money. These are editorial judgements based on somebody else's experience, so compare reviews from different places rather than treating a platform rating as proof.
Check whether a reviewer identifies a real client and a specific campaign, whether the account has a credible history, and whether many reviews appear together with repeated wording or generic praise. Look for disclosure of a free service, payment, other incentive, agency connection or affiliate commission; weigh disclosed promotion accordingly. These are warning signs, not proof of fabrication: verify claims through an independently contacted reference and dated campaign evidence, and remember that a platform verification label cannot establish results.
What reviews rarely assess is harder to judge from the outside. That includes pixel and tag governance, retention of audience data, and who owns the raw footage. It also includes what happens to your accounts when the contract ends. Ask about those directly rather than searching for a review.
Vendor claims versus independent evidence
Agency case studies are vendor claims. An award shortlist is a third-party signal, though it usually reflects one campaign rather than a repeatable process. A named client reference you can telephone is stronger than either.
Evidence Strength Compared
Vendor claim
- Source
- Agency case study
- Scope
- Self-reported
- Verification
- None
- Strength
- Weakest
Third-party signal
- Source
- Award shortlist
- Scope
- One campaign
- Verification
- Partial
- Strength
- Medium
Independent evidence
- Source
- Written method
- Scope
- Repeatable process
- Verification
- Dated report
- Strength
- Strongest
Independent evidence looks different. It includes a written method, a dated performance report and a clear statement of what the agency will not do. If a review repeats a claim about reach or conversion, check whether the reviewer saw the underlying dashboard.
When a review praises targeting, ask what lawful basis the campaign used. The ICO's guidance on choosing your lawful basis for direct marketing explains why consent and legitimate interests lead to different obligations.
Data handling questions to ask
Short-form video work often involves audience lists, lookalike audiences and retargeting pixels. That means personal data changes hands. The Data Protection Act 2018 sets the framework your agency must work within.
Data Handling Questions
- Who is controller and who is processor?
- Where is audience data stored?
- How long is data kept?
- What happens to custom audiences at exit?
- Is there a written processing agreement?
- Can retention schedule be stated plainly?
Ask who is controller and who is processor, where data is stored, what lawful basis is used, how long it is kept, and how custom audiences are deleted when the engagement ends. Request the written retention schedule and a data processing agreement, including how deletion is documented. If the agency is required to pay the data protection fee, check the ICO's public register of fee payers; an entry is not an endorsement.
If an agency cannot describe its retention schedule in plain language, that is a finding in itself. There is no universal retention period for every audience list: require a purpose-based schedule and a clear deletion trigger. Record the evidence and any gap in your scoring notes.
Creative standards to expect
Reviews tend to reward work that looks polished. Buyers should also check whether the creative follows recognised advertising standards. The IAB UK introduction to creative best practice for digital ads sets out expectations that apply to vertical video as much as to display; the CAP Code, the UK Code of Non-broadcast Advertising and Direct & Promotional Marketing, applies to advertising claims and disclosures, and the ASA administers and enforces it.
Ask to see the first three seconds of five recent assets. Then ask what the brief was and how performance was judged. A review that only shows finished films tells you little about process.
A scoring method you can defend
Use this model for every agency, keeping the evidence beside each rating. Give each criterion one of three evidence ratings—verified, partly verified or not evidenced—and apply the priority tiers below rather than averaging away a critical gap.
- Critical weight:lawful basis; controller and processor roles; the data processing agreement, retention and deletion arrangements; and independent evidence for claimed performance.
- Important weight:a written measurement method, named client references, asset and account ownership, and exit arrangements.
- Supporting weight:creative fit, responsiveness and value for money.
- Decision rule:a critical criterion rated “not evidenced” means hold the decision until it is resolved. Important criteria distinguish otherwise viable agencies; supporting criteria break ties. Do not let polished creative compensate for missing data protections or unverified results.
Separate what you verified from what you were told. A reference call is verification. A pitch deck is not. Note the date of every figure you record.
Worked example (hypothetical): a candidate's dated report and callable client reference verify its performance claim, but its retention schedule only partly explains deletion and its data processing agreement does not state the deletion trigger. Mark performance “verified”, retention “partly verified” and deletion “not evidenced”; because deletion is critical, record the outcome as “hold” until resolved rather than allowing other strengths to offset it.
Use a checklist so nothing is skipped when three agencies are compared at once. The short form video selection checklist is a companion; use the checks below when gathering evidence:
- Save the review's platform, source, date and exact claim; note any incentive, affiliate link or commercial relationship disclosed.
- Ask for the written measurement method and a dated report tied to the campaign objective; verify the evidence and speak to a named client reference.
- Confirm the lawful basis, controller and processor roles, data processing agreement, retention schedule and deletion process.
- Ask who owns the raw footage, accounts and audience data, and what happens to each when the contract ends.
- Check the creative and its claims against IAB UK best practice and the CAP Code.
Decision table
Choose
- First campaign, small budget
- Agency with a written method and named references
- Regulated sector, audience data involved
- Agency that documents lawful basis and retention
- In-house team needs capacity
- Agency offering training and handover
- Fast turnaround on vertical video
- Agency with a dated production schedule
- Long-term brand building
- Agency with quarterly measurement reviews
Avoid
- First campaign, small budget
- Agencies whose only proof is awards
- Regulated sector, audience data involved
- Agencies that cannot name a processor
- In-house team needs capacity
- Agencies that keep account ownership
- Fast turnaround on vertical video
- Agencies promising same-day edits
- Long-term brand building
- Agencies reporting only views
Common questions
Are online agency reviews reliable?
They are opinions, usually based on one client relationship. Treat them as leads to verify, not as evidence of fit for your brief.
What should I check that reviews miss?
Data processing terms, asset ownership, retention periods and exit arrangements. Ask for these in writing before you score any agency.
Do I need a lawyer to review the contract?
For campaigns handling personal data, legal review of the processing terms is sensible. The ICO guidance above is a starting point, not legal advice.
How many agencies should I score?
Three is workable for most teams. Score all of them against the same weighted criteria so the comparison stands up internally.



