Overview
There is a moment in almost every senior hiring process when a shortlist gets narrowed down and someone in the room says, “This person just has the right feel.”
The candidate came from a recognised company, held an impressive title, spoke fluently about strategy, and carried themselves with authority. The decision felt rational. The data seemed to support it.
And yet, six months later, the hire hasn’t quite landed. The team is unsettled. Results are slower than expected.
The leader who looked so right on paper is struggling to find traction in the actual environment.
We’ve seen this play out more times than we’d like. And in our experience, the reason usually isn’t that the candidate lied, or that the process failed at the obvious checkpoints.
It’s that the process was measuring the wrong things entirely, and it is one of the most consequential leadership assessment mistakes organisations make, and far more common than most realise.
The Comfort of Observable Signals
Leadership evaluation is genuinely hard. Unlike a technical role where you can review code or audit a financial model, assessing whether someone can lead well in a specific context requires judgment calls that feel uncomfortably subjective.
So organisations compensate with proxies, and this is where leadership assessment mistakes quietly begin.
They look for signals that are easy to observe, straightforward to compare, and feel reassuring to justify in a board presentation. The problem is that many of these signals correlate more with how familiar a candidate looks than with how effective they’re likely to be.
Here are the ones we encounter most often.
“They Came From a Great Company”
Brand association is probably the most widely trusted signal in leadership hiring. The logic feels sound: if they thrived at a high-performance organisation, they must be capable.
What this reasoning often misses is that sustained performance at a well-resourced, structurally sound company frequently reflects the environment as much as the individual.
Leaders who have operated inside strong systems, deep talent pools, and category-defining brands can genuinely struggle when those scaffolds are removed. The skills required to lead inside a scaled, process-rich organisation are meaningfully different from those needed to build, stabilise, or turn around one.
We’ve seen leaders with stellar CVs arrive in a mid-market or growth-stage company and spend their first year trying to import a playbook that doesn’t fit the context, a pattern that traces back directly to leadership assessment mistakes made before day one.
“They’ve Held the Right Titles”
Closely related to brand association is title mapping. If a company is hiring a CFO, they naturally look for candidates who have been CFOs before. On the surface, that’s sensible.
But over-indexing on titles is one of the major leadership assessment mistakes in itself, as they mask enormous variance in actual scope and ownership.
A CFO at a 200-person startup navigating their first institutional fundraise is doing fundamentally different work from a CFO at a 5,000-person listed company managing investor relations and a large finance function.
The same title, held at different types of organisations, can represent a decade of growth experience or a decade of consolidated process management.
What tends to matter more than the title held is what decisions the person actually owned, what they built from scratch, and what broke on their watch and how they handled it.
“They Interviewed Brilliantly”
Interview performance is probably the most seductive false signal of all, and the hardest to argue against in the moment.
The issue is structural. Leadership interviews, especially at the senior level, often reward preparation, articulateness, and social confidence, none of which are especially strong predictors of on-the-job effectiveness.
Candidates who have been through many senior processes know how to speak fluently about strategy, frame failures as learning, and signal cultural alignment in ways that feel authentic.
Research in behavioural science has consistently found that over-relying on interview performance is one of the quieter leadership assessment mistakes. Unstructured conversations, however fluent, are among the weaker predictors of actual on-the-job effectiveness.
“They Have an Impressive Network”
Social proof from credible sources is valuable. But there’s a difference between a candidate who is well-regarded because of sustained results, and one who has simply navigated professional circles well.
Reference calls, particularly those provided by the candidate, are routinely optimistic. Most leaders have cultivated a set of advocates who know them in their best contexts and are unlikely to raise structural concerns.
The signal is further distorted when the people checking references are evaluating social currency rather than specific evidence of performance.
The question worth asking isn’t whether a candidate is liked or respected in their network. It’s whether the people who respect them have seen them actually lead through difficulty.
“They’re Confident and Decisive”
Decisiveness and executive presence are real leadership qualities. But the display of confidence in an interview setting tells you very little about how someone makes decisions under real uncertainty, with incomplete information and competing stakeholder priorities.
We’ve found that some of the most effective leaders we’ve placed operate with a degree of intellectual humility that can read, superficially, as tentativeness.
They ask more questions before drawing conclusions. They surface dissent from their teams. They acknowledge what they don’t know.
In an interview optimised for projecting authority, they can lose out to someone who sounds more certain.
The underlying capability being sought is sound judgment, and mistaking confidence for it is one of the most common leadership assessment mistakes of all. It rarely surfaces in how confidently someone speaks about their strategy in a 90-minute interview.
What More Reliable Signals Look Like
Avoiding leadership assessment mistakes isn’t about abandoning instinct. It’s about supplementing it with structured evidence.
The shift we’ve found most useful is from retrospective impression to contextual evidence. Rather than asking what someone did, or where they did it, the more productive line of inquiry tends to be: how did they actually think and behave inside a specific situation that resembles the challenge ahead?
A few patterns that tend to hold up, and they help organisations move past leadership assessment mistakes rooted in surface observation:
Contextual decision-making history. When pushed for a detailed account of a decision they made with incomplete information, genuinely strong leaders can walk through their reasoning in granular, nuanced terms. They remember what they didn’t know at the time, not just what worked out.
Adaptability markers. Leaders who have navigated genuine discontinuity, whether a market shift, a structural failure, or an unexpected team departure, tend to have a more grounded relationship with uncertainty than those who’ve operated in relatively stable environments.
Evidence of impact at the team level. How people around them grew, how often direct reports were stretched and promoted, what culture they left behind. These tend to be more durable indicators than headline results that may have had multiple contributing factors.
Consistency between structured and unstructured contexts. When a candidate’s reasoning in a casual conversation is as coherent as in a prepared one, that’s a signal worth noting. The ability to think on one’s feet, without polish, is often more relevant to the role than the ability to present beautifully.
The Structural Problem Behind Leadership Assessment Mistakes
The deeper challenge is that most hiring processes are designed to minimise the wrong kind of risk. They prioritise defensibility over accuracy.
A candidate from a well-known company who interviewed well is easy to justify. If the hire doesn’t work out, the decision still looks reasonable on paper.
What this approach systematically underweights is fit to context. Not just cultural fit in the vague sense, but the specific combination of capability, operating style, and experience that the role actually demands in this company, at this stage, with this team.
Behavioural assessment frameworks, structured reference conversations, and evidence-based evaluation approaches exist precisely because observable signals have a poor track record as predictors.
They take more time and discipline to implement, but in our experience, the quality of hire improves meaningfully when the process is designed around what actually matters rather than what’s easiest to see.
A Few Thoughts to Take Away
The signals that feel most compelling in a hiring process aren’t always the ones with the most predictive value, and that gap is where most leadership assessment mistakes go unnoticed.
Brand recognition, title history, interview fluency, and executive presence are all observable, legible, and easy to discuss in a shortlisting meeting. But they’re often measuring presentation rather than capability.
The companies we see make consistently strong leadership hires, the ones who avoid these leadership assessment mistakes that derail others, tend to do a few things differently: they define the role context in specific terms before they begin searching, they design evaluation processes around evidence of behaviour under relevant conditions, and they’re willing to look uncomfortable in the room by challenging a candidate who interviews well but whose pattern of decision-making raises questions.
That’s not a rejection of intuition. Experienced leaders and HR professionals develop real pattern recognition over time.
But the most reliable version of that intuition is built on structured evidence, not on how right someone looked at first glance. Steering clear of leadership assessment mistakes, in the end, comes down to that discipline: measuring what predicts performance, not just what’s easy to see.
Where Do You Start?
None of this requires reinventing your hiring process. It requires asking better questions, earlier, and having a framework built around context rather than credentials.
Vellstone works alongside leadership teams and HR heads who want more from their executive search than a polished shortlist. If you’re working through any of this, we’d be glad to share how we approach it differently.
