There's a new colleague at work. And something about this hire doesn't quite add up.
Nobody remembers interviewing them. Nobody seems sure what their job description is, either. Yet they're working in every department, with the full support of senior management. Who hired them? Who do they report to? How did they get access to…
Nobody remembers interviewing them. Nobody seems sure what their job description is, either. Yet they're working in every department, with the full support of senior management.
Who hired them? Who do they report to? How did they get access to everything on their first day?
It's almost as if there's a family connection behind this hire.
To be fair, they're fast, never complain, never take a day off, and seem willing to try anything. Some of their work is genuinely brilliant.
But they also make things up, get facts wrong, sound absolutely sure of themselves, and leave us to clean up.
So what do we make of this person?
Well, for a start, it's not a person. It's AI.
Research suggests we have a complicated relationship with it.
In a 2019 study, Jennifer Logg and colleagues found that people gave more weight to identical advice when they thought it came from an algorithm rather than another person. In one experiment, 88% chose an algorithm's prediction over another person's. When the alternative was their own prediction, that fell to 66%.
We seem happy to trust AI's judgment. Until we have a judgment of our own.
A 2015 study by Berkeley Dietvorst and colleagues found something different. People lost confidence in algorithms after seeing them make mistakes, even when they were more accurate than human forecasters.
In one experiment, 65% chose the algorithm without seeing its past performance. After seeing it make predictions, including mistakes, only 26% chose it.
Even when the new hire is better at the job than we are, we seem to have very little patience for their mistakes.
And in a 2026 study, Sofoklis Goulas and colleagues asked 1,339 teachers to check deliberately incorrect grades.
When teachers were told that an unfairly low grade came from AI, they were less likely to correct it. When told the same grade came from another teacher, they corrected it more. This difference wasn't found when the grade was too high.
Apparently, we're more willing to challenge a harsh colleague than a harsh algorithm.
One thing worth noting: these studies examine how people respond to algorithms and their advice, rather than today's AI tools at work.
Still, there's something familiar here. We form opinions about AI, change them quickly when something goes wrong, and sometimes trust it for reasons unrelated to whether it's right.
Perhaps we're too quick to label AI as brilliant or useless. We need better ways to judge what it delivers, including its mistakes and the work others do to fix them.
Meanwhile, our new colleague has been assigned another three departments.
So, while we figure out how to measure its performance properly, how about we give AI its first collective performance review?
Think about the AI you use most often at work: What does it do well? What could it do better?
Let's compare notes.
Originally published on LinkedIn