NEW ZEALAND BUSINESS NEWS

Empowering Kiwi Businesses
NZ Business News logo

AI assistants name big consultancies first, study of 176 answers finds

News Desk
AI assistants name big consultancies first, study of 176 answers finds

An Auckland consultancy that sells AI services has tested how six AI assistants answer buyer-style questions about New Zealand AI providers. The outcome depended heavily on which assistant was asked and whether it could search the web. Ez-AI put 22 questions to ChatGPT, Claude, Gemini, Perplexity, Grok and Amazon Nova with web search switched on, repeated them on GPT and Claude with search off, and logged 176 answers in all, recording every page cited.

The exercise matters to any business that now finds itself being shortlisted by a machine rather than a person. Where an assistant draws its answer from decides who gets named, and the study suggests that pool of sources is narrower than many suppliers would assume.

A handful of lists carry the recommendations

Three web pages supplied much of the sourcing. Each was an article ranking New Zealand’s best AI consultants, and each showed up in 12 to 14 answers. Company websites and agency directories accounted for most of the remainder.

Deloitte appeared most often, turning up in 41 of the 176 answers. Datacom followed with 39. PwC, Enterprise DNA, and AI New Zealand each drew 36 mentions, while Harkness AI and Automate AI appeared 25 times apiece and Theta 23 times.

Those totals come from a tracking list drawn up in earlier runs of the test, covering 39 businesses here and overseas. Companies not on that list were not counted in the name tallies, though pages they publish could still appear among the cited sources.

Each assistant has its own habits

The assistants did not behave alike. ChatGPT favoured larger, longer-established businesses: Datacom and Theta each appeared in 10 of its 22 answers. Grok, Amazon Nova and Claude leaned more on published rankings and agency directories, which pushed more specialist providers into their answers. Gemini pulled more often from Google results and government material.

Turning web search off changed the picture again. Without it, GPT and Claude mostly named the big consultancies, among them Datacom, Deloitte, PwC, and Accenture, plus a smaller set of well-established New Zealand technology companies. The study concludes that the material a model was trained on, and whether it can search live, can materially change which providers a business user sees.

Government material came up often. Across 14 of the 22 questions, Business.govt.nz was cited in 28 answers, and it frequently appeared before any consultant was suggested – especially where the question concerned advice for small businesses.

Some questions drew thin answers

Several prompts produced little of use. One asked which New Zealand agency could get a business found on ChatGPT and Gemini; no assistant named any of the 39 tracked businesses, and more than three of the six cited no agency at all. A prompt about an AI consultant for a law firm drew nothing from Claude – no businesses, no sources. On AI automation for an insurance broker, ChatGPT named no provider and cited only government and regulator sites.

Ez-AI was part of the tracked set itself and appeared in 28 of the 176 answers. Grok, Amazon Nova, Claude and Perplexity accounted for nearly all of those mentions; ChatGPT never named it.

What it means for businesses

For professional services companies and digital agencies, the findings point to a shift in where supplier searches now happen. If an assistant’s shortlist is built from a small set of rankings, directories, and indexed pages, a business’s own website may count for less than where else it appears online.

Ez-AI founder Skene Bennellick has urged businesses to check AI-generated shortlists rather than accept them, pointing out that several of the most-cited rankings are written by a consultancy that places itself at the top. He also recommends asking more than one assistant, since the overlap between them in this test was lower than expected.

On visibility, Bennellick argues that third-party sources carry more weight than a company’s own description. In his view, inclusion in the lists and directories assistants cite, independent reviews they can see, indexing by Google, Bing, and Brave, and a clear statement of what a business does, where, for whom, and at what price determine who gets named.

Related Articles


NZ Business News logo

NZ Business News: Empowering Kiwi Businesses

NZ Business News reports on the decisions, deals and numbers shaping New Zealand business — the companies making them, the policy and market conditions they work within, and what it means for the people running businesses here.

Leave a Reply

Your email address will not be published. Required fields are marked *

Comments