UK

United Kingdom · Technology and data · Senior Leadership (16-20 years experience)

Director of Search & Discovery

Here is the whole job, in plain words. What it is, what you decide, how you're judged, how people get here and where they go next. Then the part no course gives you: twelve AI tutors who learn your work.

See how AI is changing this job, and get the full read by email.

Start my free Automation Fluency module

As a Director of Search & Discovery, a good place to start on Generative AI Integration & Strategy is Planning Automation Across a Department, a free Future Fluency module at Level 5. You'd practise working out what in your department's work could be automated, what should not be, and what to recommend.

Free to start, no card.

Keep this job description

Where should we send it?

One email: what AI is changing in this job, the new skills it asks for, where it leads, and where to start free. With a link back here. Nothing else follows unless you confirm your address.

Your employer, or 'self-employed'

Leading a team? Try this with up to five of them for 14 days, free.

  • Experience bandSenior Leadership (16-20 years experience)
  • Direct reports3-5 reports
  • Reports toVP of Engineering or Chief Technology Officer (CTO)
  • UK framework levelUsually a director, accountable for a division and its numbers

Also advertised as VP of Search Engineering · Head of Search Platform · Senior Director, Information Retrieval

Built on 43,079 real UK job descriptions we analysed · grounded in what real qualifications cover

Two short quizzes about you

1From this job to a course

The qualifications matched to this job

OTHM Level 7 Diploma in Data Science OTHM Qualifications · Level 7 · covers 1 of 2 standards
NCC Education Level 5 Extended Diploma in Computing with Data Science NCC Education Limited · Level 5 · covers 1 of 2 standards
Level 6 Award in Data-led Decision Making Institute of Sales Professionals · Level 6 · covers 1 of 2 standards
Level 6 Certificate in Professional Sales Institute of Sales Professionals · Level 6 · covers 1 of 2 standards
Level 6 Diploma in Professional Sales Institute of Sales Professionals · Level 6 · covers 1 of 2 standards

Matched from the standards this job is measured against: a suggestion, not an official ruling.

The units you would start with

Data Science Foundations OTHM Level 7 Diploma in Data Science
Introduction to Data Science and Big Data NCC Education Level 5 Extended Diploma in Computing with Data Science
Data-led Decision Making Level 6 Award in Data-led Decision Making
Apply the Concepts of Data Science to Computer Engineering NOCN Level 5 Diploma in Computer Engineering (Information Technology and Data Science)

The future skills this job leans on

AI Fluency working with AI as a thinking partner
AI Governance Fluency using AI responsibly
Your Plan Illustration

Built for Director of Search & Discovery

4 units that map to this job, from the qualifications that cover it.

  1. Data Science Foundations OTHM Qualifications · covers 1 of 2 standards Level 7
  2. Introduction to Data Science and Big Data NCC Education Limited · covers 1 of 2 standards Level 5
  3. Data-led Decision Making Institute of Sales Professionals · covers 1 of 2 standards Level 6
  4. Apply the Concepts of Data Science to Computer Engineering NOCN · covers 1 of 2 standards Level 5
These are the real units behind this job, in the order they rank for it. Nothing here is marked done, because this plan has not been started by anyone yet. Yours would fill in as you go.

2AI and this work

Will AI change your work as a Director of Search & Discovery?

Nobody can say exactly how. Here is what this job is being asked for next, and where to start.

The new skill this role is being asked for

  • Generative AI Integration & Strategy
Why each one is rising

The future skills this job leans on

We'll only ever tell you what we can actually back up. No hype, no scare tactics.

What happens when you start

Next, a free account. We build your Director of Search & Discovery plan as you set up, starting with the free Automation Fluency module. No card.

Your first Future Fluency module is free. After that, your AI tutor is £70 a month.

Ready to pay? Subscribe for £70 a month

Keep this read. One email with what AI is changing in this job, the new skills it asks for and where to start free. Nothing else follows unless you confirm your address.

3What this role really is

A Director of Search & Discovery shapes how customers find what they need, setting the vision for search technology and leading the teams that build it.

4What you'd actually use

The tools this job runs on, and how well you'd need to know each one.

Elasticsearch / OpenSearch Expert

Making strategic decisions on version upgrades, plugin adoption, and overall search platform evolution. Evaluating alternatives like Solr or Vespa. Governing architectural choices for multi-tenant, multi-region cluster topologies.

Python (w/ libraries like `elasticsearch-py`, `sentence-transformers`) Expert

Designing and overseeing the Python framework for all search-related services. Setting coding standards, mentoring junior engineers, and integrating search services with broader MLOps pipelines. Guiding the development of robust data processing pipelines and evaluation harnesses.

AWS (S3, EC2, Kinesis, Lambda) Expert

Architecting the entire cloud infrastructure for the search platform. Making build-vs-buy decisions (e.g., managed OpenSearch vs. self-hosted on EC2). Focusing on cost optimisation, security, and scalability at an enterprise level.

Apache Kafka Expert

Architecting the enterprise event-streaming strategy that feeds the search platform. Governing schema evolution (using Avro/Protobuf) and ensuring data lineage and quality from source to search index.

Docker & Kubernetes Expert

Designing the CI/CD pipeline for search services on Kubernetes. Managing cluster resources (resource quotas, node pools), planning scaling strategies (Horizontal Pod Autoscaler), and ensuring observability for the entire stack.

Vector Databases (e.g., Pinecone, Weaviate, Milvus) Expert

Leading the strategic decision to adopt a vector database. Evaluating vendors, designing the architecture for integrating it with the existing search stack, and defining the roadmap for semantic search capabilities across the organisation.

Observability (Prometheus, Grafana, Datadog) Expert

Defining the entire observability strategy for the search platform. Implementing distributed tracing (e.g., using OpenTelemetry) to track a query across multiple services. Using observability data to drive architectural decisions and capacity planning.

5What you get to decide, and how that grows

Power in a job isn't your title. It's what you're allowed to decide. Here's how it grows as you move up.

The choiceComing in Where you are nowThe step above
Strategic Technology Adoption (e.g., new vector database) Escalate for guidance and approval. Propose options with recommendations, seek approval from Senior/Lead. Lead evaluation, make recommendations to Director, get approval.
Organisational Design & Key Hires No authority. No authority. Provide input on team structure, participate in interviews.
Major Architectural Changes (e.g., re-platforming search) Escalate technical issues. Propose minor improvements within existing architecture. Design and propose significant architectural improvements within a workstream.

6How you'll be judged

The scoreboard, and what is not on it. The hard targets, how often each is actually looked at, and the quiet signals that never reach a dashboard.

Search-Driven Revenue/Conversion
The percentage of total revenue or conversion events directly attributed to users interacting with our search function.
Target · Increase search-driven conversion rate by 10% year-on-year, or contribute £5M+ in incremental revenue.

If Q2 search-driven revenue was £15M, we'd expect to see £16.5M+ in Q2 next year, or a clear path to that growth based on initiatives you've led.

Core Relevance Metrics (e.g., nDCG, MRR)
Industry-standard metrics that tell us how good our search results actually are, considering both position and relevance.
Target · Improve nDCG@10 by 5% quarter-on-quarter for our top 1,000 queries.

If our current nDCG is 0.75, we'd aim for 0.7875 next quarter, driven by the new LTR model you've championed.

Operational Efficiency & TCO
How efficiently we're running the search platform, looking at infrastructure costs versus the value it delivers.
Target · Reduce total cost of ownership (TCO) for search infrastructure by 15-20% through architectural improvements and smart vendor management, while maintaining or improving performance.

If our current annual infrastructure spend for search is £1M, you'd be looking to bring that down to £800K-£850K without sacrificing quality or scalability.

Team Growth & Capability
Building and retaining a high-performing team, and measurably improving the organisation's overall search maturity.
Target · Achieve a 90% retention rate for high-performing search engineers and managers, and successfully onboard 10 new hires within 12 months.

Successfully hiring 3 Senior Search Engineers and 2 Search Engineering Managers in H1, with positive feedback on their onboarding and early contributions, alongside retaining all existing top talent.

Strategic Vision & Roadmap Clarity
How well you articulate a clear, compelling, multi-year vision for search that aligns with broader company goals, and how effectively that vision is translated into an actionable roadmap.
  • Regular positive feedback from the CPO and VP of Engineering on roadmap presentations
  • your team understands the 'why' behind their work
  • the search strategy is consistently referenced in broader company planning documents.
Cross-Functional Influence & Collaboration
Your ability to get other senior leaders and teams (Product, Data, Marketing) on board with search initiatives, and to ensure search is a truly integrated part of the overall customer experience.
  • You're proactively consulted on major product launches and data initiatives
  • other VPs champion your search projects
  • there are clear, documented agreements on shared goals and dependencies between your teams and others.
Organisational Development & Mentorship
How effectively you build, mentor, and empower your leadership team and the wider search organisation, fostering a culture of innovation and continuous improvement.
  • Your direct reports are visibly growing in their roles
  • you have clear succession plans in place for key positions
  • your team's engagement scores are consistently high
  • you're seen as a trusted advisor and coach by your managers.
Technical Governance & Architectural Soundness
Ensuring the search platform's architecture is robust, scalable, secure, and future-proof, avoiding technical debt and making smart build-vs-buy decisions.
  • Minimal critical production incidents related to search infrastructure
  • successful adoption of new technologies (e.g., vector databases) without major disruption
  • clear, well-communicated architectural principles for the search domain
  • positive reviews from security and platform engineering teams.

7Would you like it

Both sides. What people enjoy, and what grinds them down.

What people enjoy
Shaping the Future of Discovery

You'll spend time thinking about how users will interact with information in 3-5 years, then work backwards to define the technical roadmap. This means evaluating new AI models, exploring novel interaction patterns, and challenging the status quo.

Leading the charge to integrate generative AI into our search results, moving beyond simple keyword matching to conversational discovery, and seeing that vision start to take shape in early prototypes.

Building High-Performing Teams

A significant part of your day will involve mentoring your managers, coaching senior engineers, and strategising on talent acquisition and retention. You get a real kick out of seeing your people grow and succeed.

Successfully hiring a new Search Engineering Manager who quickly becomes a key leader, or seeing a Principal Engineer you've mentored present their architectural vision to the CTO with confidence.

Driving Tangible Business Impact

You're always connecting technical work back to business outcomes: increased conversion, improved customer satisfaction, reduced operational costs. You'll present these impacts to executive leadership and the board.

Presenting quarterly results to the executive team, showing how a new search feature you championed has directly contributed to a 15% uplift in a key revenue metric, or saved £500K in infrastructure costs.

What frustrates people
  • Dealing with executive-level political battles over resource allocation or strategic direction, where search might not always be the top priority.
  • Managing underperforming managers or engineers, which takes a significant amount of emotional energy and time.
  • The constant 'Google expectation' from senior leaders who don't fully grasp the scale and complexity differences.
  • Having to make difficult trade-offs between technical excellence and immediate business needs, knowing that some technical debt will accumulate.
  • The long cycle times for strategic initiatives; it can take years to see the full impact of your architectural decisions.
What this role does not give you
  • A daily coding fix (you'll be leading, not coding).
  • A quiet, heads-down environment (expect constant interaction and problem-solving).
  • The ability to unilaterally implement every technical idea you have (it's about influence and alignment).
  • A static, predictable environment (the tech landscape and business priorities are always shifting).

8Who you work with

This role directly drives customer engagement, conversion rates, and overall revenue by ensuring users can effectively discover products and content. It also significantly impacts operational efficiency, data quality, and our ability to innovate quickly in a competitive market. You're essentially the steward of one of our most critical user interaction points.

Inside the business
  • Chief Product Officer (CPO)
  • Chief Marketing Officer (CMO)
  • VP of Data & Analytics
  • VP of Product Management
  • Senior Engineering Leads across other functions
  • Finance Leadership
Outside the business
  • Key technology vendors (e.g., Elasticsearch, AWS)
  • Industry analysts and thought leaders
  • Potential acquisition targets for search technology

9What you need before you start

Not a wish list. The things you would be expected to already have.

  • Proven track record of leading and scaling large-scale search or information retrieval platforms (100M+ documents, 1M+ queries/day).
  • Extensive experience (5+ years) managing multiple engineering teams and managers, with a focus on talent development and organisational growth.
  • Demonstrable experience owning and managing significant technology budgets (£2M+).
  • Deep expertise in distributed systems architecture and cloud platforms (AWS, Azure, GCP).
  • A strong history of influencing executive-level stakeholders and driving strategic alignment across an organisation.
  • Experience with M&A integration from a technical leadership perspective (or equivalent experience leading large-scale system migrations).

10What to practise next

Where the job is going, and what to do about it starting this week.

Advanced Observability & AIOps for Search

As search systems become more complex (hybrid, vector, generative AI components), traditional monitoring isn't enough. We need to move towards predictive analytics and automated incident response, using AI to anticipate and resolve issues before they impact users.

Distributed Tracing & OpenTelemetry · Anomaly Detection & Predictive Monitoring · Automated Incident Response & Self-Healing

  • This quarter: Review current observability stack with your Principal Engineers; identify gaps in predictive capabilities and automated alerting.
  • Next 6 months: Define a strategic initiative to integrate AIOps principles into our search platform, starting with a proof-of-concept for anomaly detection.
  • Next 12 months: Invest in tools and training to build out advanced distributed tracing capabilities across all search services.
  • Ongoing: Foster a culture of 'observability as code' within your teams, ensuring all new services are built with robust telemetry.

Quick win: Challenge your teams to integrate a new, more granular metric into an existing Grafana dashboard this month, focusing on a subtle aspect of search performance that's currently hard to track.

11Staying current once you are in

What people here do to keep up
  • Regularly attend and speak at industry conferences (e.g., Berlin Buzzwords, Lucene Revolution, RecSys) to stay current and build your professional network.
  • Participate in executive leadership programmes or peer groups to hone your strategic and organisational development skills.
  • Mentor emerging leaders and senior engineers, both within and outside of our organisation.
  • Contribute to open-source projects or publish articles/papers on search and information retrieval to establish thought leadership.

12The rising capability

The rising capability

Zavmo analysis

What's rising in its place

This is where the work is heading, and the higher pay with it. Get fluent here and the shift stops being a threat and starts being your edge.

Generative AI Integration & Strategy

Generative AI (like LLMs) is fundamentally changing how users expect to interact with information. It's moving beyond keyword matching to conversational search, summarisation, and personalised content generation. If we don't embrace this, we'll be left behind by competitors.

  • RAG (Retrieval Augmented Generation) Architectures
  • LLM Fine-tuning & Prompt Engineering at Scale
  • Ethical AI & Bias Mitigation in Search
  • Cost Optimisation for LLM Inference

13What you’ll use

What you’ll use

Skills this role draws on

Technical

  • Information Retrieval (IR) Strategic Direction
  • Relevance Tuning & Ranking Governance
  • Vector Search & Embeddings Roadmap
  • Distributed Systems Architecture for Search
  • Search Analytics & A/B Testing Strategy

14The pathway

The pathway

How you actually get there, here

How you become one varies far more by country than what one does. This is the UK route. Most people take one of these ways in; the right one depends on where you're starting from.

  1. 1

    Principal Search Engineer / Staff Engineer

    3-5 years as Principal/Staff

    Skills to master

    • Moving from deep technical expertise to broader architectural influence, cross-team technical leadership, and mentoring. You'll need to demonstrate the ability to drive technical strategy for major components.

    You're ready to move on when

    • Successfully architected and delivered multiple large-scale, complex search features or platform components.
    • Consistently provided technical leadership and mentorship to other senior engineers.
    • Demonstrated ability to influence technical direction across multiple teams without direct authority.
    • Proven ability to anticipate and mitigate future technical challenges for the platform.
  2. 2

    Senior Search Engineering Manager (leading multiple teams)

    3-5 years as Senior Manager

    Skills to master

    • Developing strong people management skills, managing managers, building organisational capability, and owning the delivery of major programmes. You'll need to show you can scale teams and manage budgets effectively.

    You're ready to move on when

    • Successfully managed multiple engineering teams, including other managers, achieving consistent delivery.
    • Proven track record of hiring, retaining, and developing high-performing talent.
    • Demonstrated ability to manage significant budgets and resources effectively.
    • Strong collaboration skills, successfully partnering with Product and other Engineering leaders.
  3. 3

    Head of Engineering (related domain, e.g., Recommendations, Data Platform)

    2-4 years as Head of Engineering

    Skills to master

    • Broadening your leadership scope beyond search, understanding different technical domains, and applying strategic leadership principles to new areas. You'll need to show adaptability and a quick learning curve.

    You're ready to move on when

    • Successfully led an engineering function in a related, complex technical domain.
    • Demonstrated ability to quickly grasp new technical challenges and build effective strategies.
    • Strong leadership presence and ability to inspire and motivate diverse engineering teams.
    • Proven ability to deliver significant business impact in a different technical context.

15Where this role leads

The long view: This role can lead to positions such as Chief AI Officer, board level technology advisor, or founding a company in search, AI or data.

The ten Future Fluencies

Zavmo analysis

The credential is what you can do today. These are what keep you valuable.

A qualification proves you can do the job as it's defined today. These ten are what decide whether you're still the obvious person for it in five years. They're the capabilities employers are now writing into senior roles faster than people are learning them. Zavmo weaves them through whatever you study, so you come out with both: the credential and the fluency.

The highlighted ones are the Fluencies your role leans on hardest, from how Director of Search & Discovery is actually changing.

Where it leads

Roles this leads to

Also named as a next step, with no page in the catalogue yet:

  • Chief Product Officer (CPO) / Head of Product

How you would learn this

One to one, on the work you already do

A tutor sets the task against your own job and marks the reasoning, at your pace. There is no cohort to fall behind.

A lesson from Data Science Foundations, worked against Director of Search & Discovery.

Data Science Foundations Level 7

Applied to your work in Director of Search & Discovery

1. To enable the learner to define the scope and landscape of Data Science and differentiate the roles of Data Scientists from other IT professionals. 2. To enable the learner to evaluate key topics within Data Science, including data administration, governance, and big data sources. 3. To enable the learner to describe the architecture and core elements of Apache Hadoop. 4. To enable the learner to analyse the advantages and disadvantages of utilising Artificial Intelligence techniques in a business context. 5. To enable the learner to critically analyse the impact of Big Data on digital transformation within organisations and its effects on users. 6. To enable the learner to review strategies for ensuring data compliance and explain the responsibilities and challenges faced by data specialists.

How the thinking builds
  1. 1 Remember
  2. 2 Understand
  3. 3 Apply
  4. 4 Analyse
  5. 5 Evaluate
  6. 6 Create
An illustration of a Zavmo lesson, built from this role’s own route. The unit, its objective and every criterion above are the awarding body’s own words, not an example.

It is £70 a month, billed monthly. Your free first module is Future Fluency, and you can cancel any time.

See Your Progress Grow Illustration
Director of Search & Discovery
  • Information Retrieval (IR) Strategic Direction
  • Relevance Tuning & Ranking Governance
  • Vector Search & Embeddings Roadmap
  • Distributed Systems Architecture for Search
  • Search Analytics & A/B Testing Strategy
This is your Mind Palace on learn.zavmo.ai. Every skill above comes from this role's own record, not an example borrowed from another job. A node lights up when you evidence it, and what you build stays yours between jobs. That is the part a course cannot do.

16The detail, folded away

Everything else the record holds

The career branches in full, how AI is already showing up in the day-to-day, and the questions people ask about this job. Here when you want them, out of the way while you decide.

Where it leads next, rung by rung

Where it leads

The career path, and where it branches

Director of Search & Discovery is a start, not a ceiling. Each step below asks for new skills and hands back more autonomy.

  1. VP of Engineering / Chief Technology Officer (CTO)

    3-5 years

    L7 (C-Suite)

    • Strategic oversight of all engineering functions (not just search).
    • Defining and driving company-wide technology culture and innovation.
    • Managing relationships with key technology partners and industry bodies.
    • Leading large-scale organisational transformation initiatives.

  2. Chief Product Officer (CPO) / Head of Product

    4-6 years

    L7 (C-Suite)

    • Leading and scaling a large product management organisation.
    • Defining the overall company product vision and strategy.
    • Managing the full product lifecycle from ideation to launch and iteration.
    • Driving product-led growth and innovation across the entire business.
Working with AI on the job

Working with AI

Where AI is starting to help

As a Director, your time is gold. Imagine reclaiming hours spent on strategic analysis, cross-functional communication, and even talent scouting. AI isn't just for engineers; it's a powerful co-pilot for leaders, helping you amplify your strategic impact and focus on what truly matters.

In Technical_roles, especially at a leadership level, AI can help you cut through the noise, make faster, more informed decisions, and communicate your vision with unparalleled clarity. We're talking about AI as a force multiplier for your leadership, not just a coding assistant.

AI-Powered Strategic Analysis

Use advanced LLMs to quickly synthesise market research, competitive intelligence reports, and internal performance data. Ask for SWOT analyses of new search technologies, identify emerging trends, or get a concise summary of a complex vendor proposal in minutes, not hours. This helps you make faster, more informed strategic bets.

Cross-Functional Communication AI

Draft executive summaries, board presentations, and strategic alignment documents in a fraction of the time. Feed AI your technical roadmap and ask it to generate a compelling narrative for the CPO, focusing on business value. It's like having a personal communications advisor on demand, ensuring your message lands perfectly every time.

AI for Talent Scouting & Development

Use AI to analyse industry talent pools, identify key skills gaps in your organisation, and even help draft personalised development plans for your managers. It can summarise candidate profiles, highlight relevant experience, and suggest interview questions tailored to specific leadership competencies. This frees you up to focus on the human connection.

Predictive Scenario Planning

Leverage AI to model the potential impact of different strategic decisions—e.g., 'What if we invest £5M in vector search vs. £5M in query understanding?'. Get probabilistic outcomes for revenue, customer retention, and operational costs, helping you stress-test your strategic choices before committing significant resources.

Common questions

Common questions

How do you become a Director of Search & Discovery?

Common routes in include Principal Search Engineer / Staff Engineer (3-5 years as Principal/Staff), Senior Search Engineering Manager (leading multiple teams) (3-5 years as Senior Manager) and Head of Engineering (related domain, e.g., Recommendations, Data Platform) (2-4 years as Head of Engineering). Times vary with prior experience.

Where can a Director of Search & Discovery progress to?

This role can lead on to VP of Engineering / Chief Technology Officer (CTO) (3-5 years) and Chief Product Officer (CPO) / Head of Product (4-6 years), depending on the skills you build.

What new skills matter most for a Director of Search & Discovery?

Increasingly, Generative AI Integration & Strategy. These are the skills our record of this role lists as growing.

Free tools

Want a read on where you stand?

Three free tools, no account needed. Each one ends with a role, a level and a way in.

Read the Zavmo manifesto to understand how you will be taught Meet your tutors

Or try another one

17Where to go from here

Other roles at Level 7

Same depth of qualification, different job. Useful if the work appeals but this particular role does not.

 More jobs in technology and data

Stay in the field you know and move sideways rather than up.
If you leave this industry

The skills built in this role, strategic leadership, large-scale systems, AI and machine learning, and organisational development, transfer across most technology-driven industries, from e-commerce and media to fintech and healthcare. Expertise in discovery and search applies widely.

This role profile is © 2026 Growth Engineering Technologies Ltd. Built from UK occupational standards and regulated qualification data, and written for Zavmo.

You're not behind. You're right on time. The shift is only just beginning. Your role won't look the same in two years. Be the one who leads the change, not the one it happens to. Start my free Automation Fluency module What happens next: a free account, then we build your plan as you set up. No card. Build your plan, see your roadmap and meet the twelve tutors matched to you. All free. When you're ready to start learning, it's £70 a month, billed monthly. Cancel any time and billing stops.