Animates — 5 Year Customer

When the Scraping Tool Failed on the One Site That Mattered

How New Zealand's Leading Pet Retailer Switched When Their Tool Failed on Pet.co.nz — And Stayed for Five Years

Animates is New Zealand's leading pet retailer. They run a price-match guarantee program: if a customer finds a lower price at a competitor, Animates matches it.

To make that promise work, they need reliable competitor pricing data they can trust — on schedule.

They were tracking four competitors — Animates' own site (for accuracy checks), PetDirect, PetStock, and Pet.co.nz. But their scraping tool couldn't access the one competitor that mattered most.

If you miss the competitor customers cite in-store, you don't actually have a price-match program — you have a guess-match program.

The Tool That Failed on the Critical Site

Animates was using Import.io, a DIY scraping platform where you build and manage your own scrapers.

It worked on three of their four competitor sites. But Pet.co.nz — a key competitor — blocked their attempts completely. The anti-bot protection was too strong. Import.io couldn't get through.

Here's what that meant: every time a customer came in with a Pet.co.nz price to match, Animates had no data to verify it. They were flying blind on a major competitor.

And even on the sites that worked, there was another problem: pet retail pricing is complex. A single product page might show four different prices:

Their Import.io setup captured headline prices but missed subscription and loyalty tiers. They were getting partial data even from sites that "worked."

This is what happens when tools hit their limits. They work until they don't — and then you're stuck.

24 Hours to Solve What Import.io Couldn't

Animates found us through a search for scraping tools. They reached out with two requirements: crack Pet.co.nz and capture tiered pricing.

Within 24 hours, we delivered a working proof across all four competitors — including Pet.co.nz — and captured the required pricing tiers for the agreed scope.

That POC changed everything. This wasn't a tool they'd have to configure and maintain. This was a managed service that delivered what they actually needed: decision-ready data from every competitor, including the one they'd given up on.

What We Provide

Every week, Animates receives structured pricing data across all four in-scope competitor sites. Here's what that includes:

FieldExample
Page URLpet.co.nz/product/dog/adult-oral-care-dry-dog-food/6017
Product NameHill's Science Diet Adult Oral Care Dry Dog Food
One-Time Price Range$44.99 - $159.99
Repeat Delivery Price Range$38.24 - $135.99
First Delivery Price$38.24
Future Delivery Price$42.74

For PetStock, we also track price-per-kg — so Animates can compare across different pack sizes, not just sticker prices.

These fields feed directly into their dynamic pricing algorithm via REST API. When competitor prices change, Animates sees the update in the next scheduled feed and can respond automatically.

The Complexity Behind "Every Week, On Schedule"

Pet retail pricing looks simple until you try to capture it reliably.

Anti-bot protection Pet.co.nz uses aggressive blocking that stopped Import.io entirely. We maintain access using multiple collection approaches and monitoring.
Multi-tier pricing A single product can have four different prices depending on purchase type. We capture all of them from a single page — not just the headline price.
Page structure variation Each competitor structures their pages differently. Some use infinite scroll, some pagination, some "load more" buttons. We handle all variations.
Ongoing maintenance These sites change their HTML structure regularly. We detect changes and fix scrapers before scheduled delivery so Animates never sees a gap.

Five Years Later: 150 SKUs → 500 SKUs

Animates has been a customer for five years — our longest relationship.

They started with 150 SKUs across four sites. They now track 500 SKUs with up to four pricing tiers each — thousands of tiered price fields per run, without Animates maintaining scrapers.

The expansion happened because the data worked. Every week, on schedule, complete for the agreed scope. No maintenance on their end. No wondering whether Pet.co.nz data will come through this time.

Their workflow now: pricing data flows via REST API directly into their dynamic pricing system. Pricing decisions are based on fresher, more complete competitor inputs — especially for subscription and loyalty tiers. The price-match guarantee runs on reliable information.

The Results

"Pet.co.nz data — previously inaccessible — now delivered weekly. The competitor that Import.io couldn't crack is now consistently covered for the in-scope SKUs."
"ProWebScraper helped us to develop some customized scraping templates to accommodate these requirements. They provide excellent support, and their solution is flexible and easy to use."

"We are the leading Pet Retailer in New Zealand and were looking for a solution to monitor competitor pricing across our range of products. The challenge we had was to scrape products from numerous types of web pages, so we needed flexibility to change templates when necessary and sometimes scrape multiple prices from one web page."
JF
Jason Fowell, Data & Insights Manager at Animates NZ

Who This Helps

Animates' story resonates with retailers facing similar challenges:

See What This Looks Like for Your Products
We'll scrape your actual products from your actual competitors. You'll see real data — not a demo dataset — within 48 hours.
Request Sample Data
No commitment. No setup on your end.