camera, cinema, video, film, camera rig, video camera, equipment, movie, media, cinematography, production, technology, recording, cinematography, cinematography, cinematography, cinematography, cinematography
Photo by IvanAstashkin on Pixabay

Reviews

Part of Why short form video reviews need a method you can audit

How to assess short form video agency reviews in the UK

A practical UK method for checking short form video agency reviews, spotting weak or incentivised claims, and comparing evidence before you choose.

What to take away

  • The ICO's direct marketing guidance, updated in 2024, is the reference point for the lawful basis behind any data-driven short form video campaign.
  • Most published agency reviews describe creative output and account management, not measurement, data handling or contract terms.
  • A review is a claim, not evidence. Treat it as a lead, then verify separately against your own brief.
  • Under the Data Protection Act 2018, the agency processing your audience data carries duties you remain accountable for.

What these reviews actually cover

This piece reviews how agency reviews are written, not how any named agency performs. No agency was briefed, tested or contacted. Nothing here is hands-on testing, and no vendor supplied material for it.

Agency reviews and client comments appear on Google, Trustpilot, Clutch and G2; discussion and recommendations also appear on Reddit and LinkedIn, while trade press covers agencies and campaigns. Most assess three things: creative quality, speed of response and value for money. These are editorial judgements based on somebody else's experience, so compare reviews from different places rather than treating a platform rating as proof.

Check whether a reviewer identifies a real client and a specific campaign, whether the account has a credible history, and whether many reviews appear together with repeated wording or generic praise. Look for disclosure of a free service, payment, other incentive, agency connection or affiliate commission; weigh disclosed promotion accordingly. These are warning signs, not proof of fabrication: verify claims through an independently contacted reference and dated campaign evidence, and remember that a platform verification label cannot establish results.

What reviews rarely assess is harder to judge from the outside. That includes pixel and tag governance, retention of audience data, and who owns the raw footage. It also includes what happens to your accounts when the contract ends. Ask about those directly rather than searching for a review.

Vendor claims versus independent evidence

Agency case studies are vendor claims. An award shortlist is a third-party signal, though it usually reflects one campaign rather than a repeatable process. A named client reference you can telephone is stronger than either.

Evidence Strength Compared

Vendor claim

Source
Agency case study
Scope
Self-reported
Verification
None
Strength
Weakest

Third-party signal

Source
Award shortlist
Scope
One campaign
Verification
Partial
Strength
Medium

Independent evidence

Source
Written method
Scope
Repeatable process
Verification
Dated report
Strength
Strongest

Independent evidence looks different. It includes a written method, a dated performance report and a clear statement of what the agency will not do. If a review repeats a claim about reach or conversion, check whether the reviewer saw the underlying dashboard.

When a review praises targeting, ask what lawful basis the campaign used. The ICO's guidance on choosing your lawful basis for direct marketing explains why consent and legitimate interests lead to different obligations.

Data handling questions to ask

Short-form video work often involves audience lists, lookalike audiences and retargeting pixels. That means personal data changes hands. The Data Protection Act 2018 sets the framework your agency must work within.

Data Handling Questions

  • Who is controller and who is processor?
  • Where is audience data stored?
  • How long is data kept?
  • What happens to custom audiences at exit?
  • Is there a written processing agreement?
  • Can retention schedule be stated plainly?

Ask who is controller and who is processor, where data is stored, what lawful basis is used, how long it is kept, and how custom audiences are deleted when the engagement ends. Request the written retention schedule and a data processing agreement, including how deletion is documented. If the agency is required to pay the data protection fee, check the ICO's public register of fee payers; an entry is not an endorsement.

If an agency cannot describe its retention schedule in plain language, that is a finding in itself. There is no universal retention period for every audience list: require a purpose-based schedule and a clear deletion trigger. Record the evidence and any gap in your scoring notes.

Creative standards to expect

Reviews tend to reward work that looks polished. Buyers should also check whether the creative follows recognised advertising standards. The IAB UK introduction to creative best practice for digital ads sets out expectations that apply to vertical video as much as to display; the CAP Code, the UK Code of Non-broadcast Advertising and Direct & Promotional Marketing, applies to advertising claims and disclosures, and the ASA administers and enforces it.

Ask to see the first three seconds of five recent assets. Then ask what the brief was and how performance was judged. A review that only shows finished films tells you little about process.

A scoring method you can defend

Use this model for every agency, keeping the evidence beside each rating. Give each criterion one of three evidence ratings—verified, partly verified or not evidenced—and apply the priority tiers below rather than averaging away a critical gap.

  • Critical weight:lawful basis; controller and processor roles; the data processing agreement, retention and deletion arrangements; and independent evidence for claimed performance.
  • Important weight:a written measurement method, named client references, asset and account ownership, and exit arrangements.
  • Supporting weight:creative fit, responsiveness and value for money.
  • Decision rule:a critical criterion rated “not evidenced” means hold the decision until it is resolved. Important criteria distinguish otherwise viable agencies; supporting criteria break ties. Do not let polished creative compensate for missing data protections or unverified results.

Separate what you verified from what you were told. A reference call is verification. A pitch deck is not. Note the date of every figure you record.

Worked example (hypothetical): a candidate's dated report and callable client reference verify its performance claim, but its retention schedule only partly explains deletion and its data processing agreement does not state the deletion trigger. Mark performance “verified”, retention “partly verified” and deletion “not evidenced”; because deletion is critical, record the outcome as “hold” until resolved rather than allowing other strengths to offset it.

Use a checklist so nothing is skipped when three agencies are compared at once. The short form video selection checklist is a companion; use the checks below when gathering evidence:

  • Save the review's platform, source, date and exact claim; note any incentive, affiliate link or commercial relationship disclosed.
  • Ask for the written measurement method and a dated report tied to the campaign objective; verify the evidence and speak to a named client reference.
  • Confirm the lawful basis, controller and processor roles, data processing agreement, retention schedule and deletion process.
  • Ask who owns the raw footage, accounts and audience data, and what happens to each when the contract ends.
  • Check the creative and its claims against IAB UK best practice and the CAP Code.

Decision table

Choose

First campaign, small budget
Agency with a written method and named references
Regulated sector, audience data involved
Agency that documents lawful basis and retention
In-house team needs capacity
Agency offering training and handover
Fast turnaround on vertical video
Agency with a dated production schedule
Long-term brand building
Agency with quarterly measurement reviews

Avoid

First campaign, small budget
Agencies whose only proof is awards
Regulated sector, audience data involved
Agencies that cannot name a processor
In-house team needs capacity
Agencies that keep account ownership
Fast turnaround on vertical video
Agencies promising same-day edits
Long-term brand building
Agencies reporting only views

Common questions

Are online agency reviews reliable?

They are opinions, usually based on one client relationship. Treat them as leads to verify, not as evidence of fit for your brief.

What should I check that reviews miss?

Data processing terms, asset ownership, retention periods and exit arrangements. Ask for these in writing before you score any agency.

Do I need a lawyer to review the contract?

For campaigns handling personal data, legal review of the processing terms is sensible. The ICO guidance above is a starting point, not legal advice.

How many agencies should I score?

Three is workable for most teams. Score all of them against the same weighted criteria so the comparison stands up internally.

More in Reviews