BLOG ยท

26 MIN READ

10 Best AI Agent Development Companies in 2026: An Engineering-Led Buyer's Guide

An engineering-led guide to AI agent development companies, production agent architecture, RAG, fine-tuning, evals, observability, reliability, and vendor selection.

Drew Brooker

ML Engineer

  • AGENTIC WORKFLOWS
  • RAG
  • EVALS
  • PROCUREMENT

AI agents are moving from experiments into production systems that search company knowledge, operate software, call APIs, coordinate tasks, and complete work across multiple steps.

The engineering challenge has changed with them.

A useful production agent needs a capable language model, the right context, reliable tools, permissions, state management, evaluation, observability, failure handling, and clear boundaries around the actions it can take.

Recent production data makes those priorities visible. A 2026 study based on 20 case studies and 306 practitioners across 26 domains found that reliability remains the leading challenge in production agent development. Sixty-eight percent of deployed agents executed no more than 10 steps before human intervention, 70% primarily used prompting with off-the-shelf models, and 74% still depended primarily on human evaluation.

This guide explains what companies should evaluate before hiring an AI agent development company, how production agent architecture works, where agents fail, when RAG or fine-tuning belongs in the system, and which development companies are worth examining in 2026.

THIS IS AN UNRANKED SHORTLIST

The short answer

The right AI agent development company depends on the system you need to build.

CompanyModelRelevant capabilitiesProject profile
Zeton Specialized AI engineeringAgentic workflows, RAG, fine-tuningBespoke systems around proprietary workflows
AccentureGlobal consultancyEnterprise agents, AI consultingLarge cross-functional programs
IBMPlatform + servicesAgent orchestration, enterprise AIPlatform-centered enterprise deployments
ThoughtworksTechnology consultancyAI + software engineeringAI embedded in broader software systems
CognizantTechnology servicesEnterprise agentic systemsLarge operating environments
CapgeminiGlobal consultancyEnterprise AI engineeringMulti-system enterprise programs
GlobantDigital engineeringAI products and agentsAgents embedded in digital products
LeewayHertzAI development companyCustom generative AI and agentsBespoke AI development
SimformProduct engineeringAgentic AI + application engineeringCustom applications with agent capabilities
InData LabsAI/data engineeringML, generative AI, data engineeringData-intensive AI systems

This is an unranked shortlist. Public material can establish capabilities and positioning. It cannot tell you how well the team assigned to your project will perform. The rest of this guide gives you a framework for evaluating that capability directly.

HOW MUCH CONTROL OVER EXECUTION THE MODEL RECEIVES

What is an AI agent?

An AI agent is a software system that uses a model to decide how to progress toward a goal and can interact with external systems while doing so.

That definition matters because many products described as agents are conventional software workflows with an LLM inserted somewhere in the process. Consider invoice exception handling. A conventional automation reads an invoice, extracts a vendor ID, checks the purchase order, compares totals, and routes mismatches to a person. An agentic system can receive the broader objective and decide which information it needs, which tools to use, whether additional investigation is necessary, and when a case needs human review.

The defining architectural question is how much control over execution the model receives. A production system surrounds that model with several other layers.

Anatomy of a production AI agent

Anatomy of a production AI agent

FIGURE 1

A practical production-agent architecture.

The model provides reasoning capability. The surrounding architecture determines what the model knows, what it can do, how much authority it receives, what happens when something fails, and how the team knows whether the system worked. That is why production agent development is a systems-engineering problem.

PRODUCTION RELIABILITY DEPENDS ON THE COMPLETE STACK

What does the AI agent development stack contain?

A useful way to inspect an agent is to separate the system into layers.

LayerPurposeTypical failureEngineering question
ModelReasoning and generationIncorrect reasoningWhich model performs the task reliably?
InstructionsGoals, policies and behaviorAmbiguous executionAre instructions explicit and testable?
ContextCurrent task informationMissing informationDoes the agent receive what it needs?
RetrievalExternal knowledgeWrong evidence retrievedAre retrieval and reranking tested?
ToolsAccess to systems and actionsWrong tool or parametersAre calls validated?
OrchestrationMulti-step executionLoops or bad routingHow are state and stopping handled?
GuardrailsConstrain actionsUnauthorized behaviorWhich actions are blocked?
Human controlApproval and escalationWrong escalationWhere does a person intervene?
ObservabilityRecords executionInvisible failureCan operators reconstruct a run?
EvalsMeasures behaviorRegressions reach productionWhat is tested before release?

The model remains important. Production reliability depends on the complete stack. A 2026 IBM-led study interviewed practitioners and surveyed 306 people across 26 domains. Reliability emerged as the leading development challenge. The same research found that deployed agents favor simple, controllable architectures.

What production agent systems actually look like in 2026

Selected production-agent findings

FIGURE 2

Selected findings from 306 production-agent practitioners. Source: Pan et al., Characterizing Agents in Production, ICML 2026.

Three findings stand out. First, 68% of agents execute no more than 10 steps before human intervention. Second, 70% primarily use prompting with off-the-shelf models. Third, 74% depend primarily on human evaluation.

These numbers challenge the idea that production agent engineering is primarily a race toward greater autonomy. Current deployments put considerable weight on control.

A more useful question for a development partner is:

WHAT DOES THE AI AGENT DEVELOPMENT STACK CONTAIN?

Which decisions should the model control, under which conditions, and which should remain deterministic or human-controlled?

AGENT ARCHITECTURE EARNS ITS ADDITIONAL ENGINEERING BURDEN

When should you build an AI agent?

Agent architecture earns its additional engineering burden when a workflow contains decisions that fixed software handles poorly. Strong candidates combine contextual judgment, repeatable work, accessible company systems, historical examples, and outcomes that can be tested.

Workflow characteristicLower suitabilityMedium suitabilityHigher suitability
FrequencyRareRecurringHigh volume
Judgment requiredLittleModerateFrequent
InputStructuredMixedUnstructured
ExceptionsFewSomeNumerous
Systems involvedOneSeveralMany
Process pathFixedBranchingContext-dependent
Historical examplesFewSomeMany
OutcomeSubjectivePartly measurableClearly testable
Error consequenceSevereReviewableReversible
Human reviewUnavailablePossibleBuilt into workflow

Take an insurance claim. The workflow can contain policy documents, written descriptions, images, previous claims, customer records, deterministic eligibility rules, and unusual exceptions.

Deterministic software checks fixed conditions. Retrieval supplies current policy language. A model interprets unstructured evidence. Tools retrieve customer data. A person handles cases that exceed a defined risk threshold. The agent becomes one component of the operating system.

THEY SOLVE DIFFERENT PROBLEMS

AI agent vs. workflow vs. RAG vs. fine-tuning

Agent development sits alongside several related AI architectures. They solve different problems.

ArchitectureMain purposeChooses next step?Takes actions?External knowledge?Learned specialization?
LLM callGenerate or reasonNoNoPrompt contextNo
RAGRetrieve knowledge before generationLimitedNoYesNo
Fine-tuned modelLearn specialized behaviorLimitedNoTraining dataYes
Deterministic workflowExecute known processRule-basedYesOptionalNo
AI agentDecide and act across stepsYesYesOftenOptional
Multi-agent systemCoordinate specialized agentsYesYesOftenOptional

These architectures can work together.

An enterprise agent can use RAG to retrieve current company policy, a specialized model for classification, deterministic software to validate an account number, an API to update the CRM, and human approval before issuing a large refund. The workflow determines the architecture.

RAG SUPPLIES INFORMATION AT RUNTIME. FINE-TUNING CHANGES LEARNED MODEL BEHAVIOR.

RAG or fine-tuning for an AI agent?

RAG supplies information at runtime. Fine-tuning changes learned model behavior.

RequirementRAGFine-tuning
Access current internal knowledgeStrong fitPoor fit
Update facts frequentlyStrong fitPoor fit
Return citationsStrong fitPoor fit
Enforce document permissionsStrong fitPoor fit
Learn specialized output behaviorLimitedStrong fit
Learn domain-specific patternsLimitedStrong fit
Standardize recurring behaviorLimitedStrong fit
Supply changing factual informationStrong fitPoor fit

The IBM-led 2026 study found that 70% of surveyed practitioners primarily used prompting with off-the-shelf models. LangChain's 2026 survey also found that a majority of respondents were not fine-tuning models.

Fine-tuning still has a role. Its presence should correspond to a specific behavioral requirement and suitable training evidence.

EVERY ADDITIONAL AGENT SHOULD HAVE A REASON TO EXIST

Single-agent vs. multi-agent architecture

Adding agents can create specialization and parallelism. It also creates additional communication, state, routing, failure paths, and testing requirements.

A bounded workflow needs one agent with several well-designed tools. A larger workflow separates naturally into research, analysis, review, and execution roles.

DimensionSingle agentMulti-agent
ArchitectureSmallerLarger
State managementSimplerMore demanding
SpecializationLowerHigher
Parallel workLimitedStrong
Coordination overheadLowerHigher
DebuggingEasierHarder
Evaluation surfaceSmallerLarger
Failure pathsFewerMore
Typical fitBounded workflowDecomposable complex work

The number of agents should follow the structure of the work. Every additional agent should have a reason to exist.

LONGER EXECUTION PATHS CREATE MORE OPPORTUNITIES FOR FAILURE

Why reliability gets harder as agents perform more steps

Longer execution paths create more opportunities for failure.

Consider a simplified system where every required step succeeds independently 95% of the time. If all steps must succeed, the end-to-end probability is:

P(success) = pโฟ

where p represents step-level success and n represents the number of required successful steps.

Required stepsEnd-to-end probability at 95% per-step reliability
195.0%
290.3%
385.7%
577.4%
1059.9%
1546.3%
2035.8%
Illustrative step reliability curve

FIGURE 3

Illustrative compounding of step-level errors. This is a mathematical illustration with no empirical benchmark behind it.

The illustration assumes identical success rates and independent failures. Real agent actions violate both assumptions. It still exposes an important engineering property: reliability at the component level does not automatically produce the same reliability at the workflow level.

Long-running systems benefit from validation, deterministic checks, retries, checkpoints, idempotent actions, stopping conditions, and recovery mechanisms.

A DEMO ASKS WHETHER A SYSTEM CAN SUCCEED

How should an AI agent be evaluated?

A demo asks whether a system can succeed. Production evaluation asks how reliably it succeeds across the distribution of situations it will encounter. That requires testing more than the final response.

The production agent evaluation stack

Production agent evaluation stack

FIGURE 4

Agent evaluation from model output through business outcome.

Evaluation layerQuestionExample measure
OutputWas the final answer correct?Accuracy
GroundingDid the answer follow available evidence?Groundedness
RetrievalDid the system find useful information?Recall@k / relevance
Tool selectionDid the agent choose the right action?Tool-selection accuracy
Tool argumentsWas the tool called correctly?Argument validity
TrajectoryWas the execution path acceptable?Trace evaluation
PolicyDid behavior remain inside defined boundaries?Violation rate
EscalationDid a human enter at the correct point?Escalation accuracy
OutcomeWas the task completed?Task success
RuntimeWas execution economically viable?Cost / execution time

This layered structure matters because a correct final answer can hide a poor execution path. An agent can retrieve the wrong source, call an unnecessary tool, recover by chance, and still produce the expected answer.

Testing only the final answer records that run as a success. Testing the trace reveals a system that will fail when circumstances change.

A useful eval dataset should contain normal cases, difficult cases, known failures, boundary cases, missing information, conflicting evidence, tool failures, and cases where human escalation is the correct outcome. Production failures should then become regression tests.

A FAILED PRODUCTION TRACE BECOMES A NEW TEST CASE

Observability and evals are becoming production infrastructure

LangChain's 2026 survey of more than 1,300 engineers, product managers, business leaders, and executives provides another view into production agent engineering. It found that 57.3% of respondents already had agents running in production.

Agent observability and evaluation adoption

FIGURE 5

Share of surveyed organizations reporting agent observability and evaluation practices. Source: LangChain, State of Agent Engineering, June 2026.

Nearly 89% reported some form of observability. Offline evaluation reached 52.4%, while online evaluation was lower at 37.3%.

OBSERVABILITY AND EVALS ARE BECOMING PRODUCTION INFRASTRUCTURE

Observability tells you what happened.Evaluation tells you whether what happened was acceptable.

A mature system connects the two. A failed production trace becomes a new test case. The team reproduces the failure, fixes the responsible layer and adds regression coverage before the next release.

THE ACTUAL DEFECT CAN SIT SEVERAL STEPS EARLIER

Where AI agents fail

A wrong final answer is only one type of failure. The actual defect can sit several steps earlier.

FailureExampleLayerPossible control
Context failureImportant account history is absentContextContext construction
Retrieval failureAgent retrieves outdated policyRAGRetrieval tests + freshness
Ranking failureCorrect document ranks too lowRAGReranking
Tool-selection failureAgent chooses the wrong systemToolsTool-selection eval
Argument failureCorrect API receives wrong customer IDToolsParameter validation
Reasoning failureAgent misreads an exceptionModelEvals + better context
LoopingSame action repeatsOrchestrationStop conditions
State failureEarlier information disappearsStateState management
Permission failureRestricted document is exposedAccessPermission-aware retrieval
Action failureExternal system fails midwayToolsVerification + safe retries
Escalation failureAgent proceeds when approval is requiredWorkflowApproval policy
Silent failureAgent reports success after incomplete actionObservabilityOutcome verification

The taxonomy changes how teams debug agents. If the wrong answer came from an outdated document, rewriting the system prompt attacks the wrong layer. If the correct tool received an invalid identifier, retrieval is irrelevant. If the agent completed the task but violated an approval policy, output accuracy does not capture the failure.

AGENT AUTHORITY SHOULD CORRESPOND TO THE CONSEQUENCE AND REVERSIBILITY OF THE ACTION

How much autonomy should an AI agent have?

Agent authority should correspond to the consequence and reversibility of the action.

Reading a document and transferring money are both technically tool calls. They should have radically different controls.

ActionConsequenceReversibilityTypical control
Search documentationLowHighAutomatic
Categorize support ticketLowHighAutomatic
Draft customer emailLowHighAutomatic or sampled review
Change CRM fieldMediumHighValidation
Send external emailMediumPartialConditional approval
Cancel customer accountHighPartialHuman approval
Approve large refundHighLowHuman approval
Execute paymentVery highLowStrong authorization

This turns a vague phrase such as "human in the loop" into a system specification.

The team can define which actions require approval, the threshold that triggers it, who can approve the action, which evidence the reviewer sees, what happens when approval is unavailable, and whether execution can be reversed.

REDUCE MANUAL REVIEW WHILE KEEPING FINANCIAL AUTHORITY CONTROLLED

Worked example: an invoice exception agent

Imagine a company processing thousands of invoices each month. Most are routine. A smaller share contain discrepancies involving purchase orders, quantities, payment terms, vendor details, duplicates or approval limits.

The objective is to reduce manual review while keeping financial authority controlled.

Invoice exception agent workflow

FIGURE 6

Example architecture for an invoice exception agent.

Several parts of this workflow do not need model judgment. Required-field validation can remain deterministic. Vendor identifiers can follow strict formatting rules. Transactions above a defined threshold can always require human authorization.

The agent becomes useful where contextual interpretation begins.

Suppose an invoice total differs from its purchase order. The agent can retrieve the PO, inspect the vendor record, read the purchasing policy, review previous communication and determine which exception path applies.

ToolReadWritePurpose
Invoice systemYesLimitedRetrieve invoice and status
ERPYesControlledRetrieve PO / update workflow
Vendor databaseYesNoValidate vendor
Policy retrievalYesNoRetrieve approval rules
EmailYesDraft onlyPrepare clarification
Approval systemYesYesCreate review request

Building the eval set

Test caseExpected behavior
Exact invoice/PO matchContinue normal path
Quantity mismatchInvestigate supporting records
Duplicate invoiceFlag duplicate
Missing PORequest or escalate
Unusual payment termsCheck policy
Conflicting recordsEscalate or investigate
API unavailableStop safely / retry according to policy
Above approval thresholdRequire approval
Restricted vendor recordRespect access boundary
Insufficient evidenceAvoid unsupported resolution

Each case can have explicit success criteria. The team can evaluate the final resolution, retrieved evidence, selected tools, tool parameters, escalation decision and resulting system state.

That is the difference between evaluating a language response and evaluating an operational agent.

RETRIEVAL QUALITY BECOMES PART OF AGENT QUALITY

Retrieval architecture for enterprise agents

Many enterprise agents need information that the base model cannot reliably know.

Contracts, current policies, customer records, inventory, internal procedures, support histories and proprietary research can all sit outside the model's training data.

RAG supplies that information during execution. A production retrieval path can contain query generation, semantic search, keyword search, metadata filtering, reranking, permission filtering and evidence selection.

Every stage creates a measurable surface.

  • Did retrieval find the correct source?
  • Did reranking place useful evidence high enough?
  • Did the permission layer remove information the current user cannot access?
  • Did the agent use the evidence correctly?
  • Did the system recognize when sufficient evidence did not exist?

A powerful model cannot reason from information the system never retrieved. Retrieval quality becomes part of agent quality.

THOSE DIFFERENCES ARE WHAT MATTER

10 AI agent development companies to examine in 2026

The market contains several provider types. Specialist AI engineering firms focus on custom systems. Large consultancies can coordinate wider enterprise programs. Platform companies supply reusable agent infrastructure. Product engineering companies can embed agents inside larger software applications.

Those differences are what matter.

COMPANY TYPE
Specialized AI engineering
RELEVANT CAPABILITIES
Agentic workflows, RAG, fine-tuning
PROJECT PROFILE
Custom AI systems built around proprietary business workflows

1. Zeton

Zeton's relevant practices span agentic workflows, retrieval-augmented generation and fine-tuning. That combination is useful because an agent project can require all three disciplines.

The agent layer determines how work progresses. RAG supplies current or proprietary knowledge. Fine-tuning can address specialized learned behavior where the use case and available examples support it.

For a buyer, the useful starting point is the workflow.

Take one process currently performed by experienced employees. Document its inputs, decisions, systems, exceptions, outputs and failure cases. Then determine which steps should remain deterministic, which require model reasoning, which need retrieval, which require tools and where human approval belongs.

That process also creates the foundation for evaluation. Historical cases can become tests before the agent reaches production. Common cases establish baseline capability. Difficult cases expose weak points. Known failures create regression tests. Cases where a person should intervene test the escalation layer.

What to examine with Zeton

AreaQuestion
WorkflowWhich decisions genuinely require model reasoning?
ArchitectureWhich steps remain deterministic?
RAGWhich proprietary information must be retrieved?
Fine-tuningDoes the task require learned specialization?
ToolsWhich company systems can the agent access?
PermissionsWhat can it read and modify?
EvalsWhich historical cases become tests?
Human controlWhich actions require approval?
ObservabilityCan operators reconstruct a failed run?
ProductionHow are regressions caught after changes?

Companies with proprietary workflows that do not map cleanly onto packaged agent products are the clearest candidates for this custom engineering model.

COMPANY TYPE
Global consultancy
PROJECT PROFILE
Large programs spanning technology and business functions

2. Accenture

Accenture becomes relevant when an agent initiative reaches beyond one application into a wider enterprise program. Such work can involve several business units, existing technology vendors, legacy systems, data platforms, security requirements and internal engineering teams.

Scale creates an important procurement question: determine who will actually design and build the agent.

The technical quality of the finished system still depends on the people implementing its tools, orchestration, retrieval, evaluation, permissions and production controls. Ask for an architecture walkthrough from a comparable deployment and evidence showing how agent behavior was evaluated before release.

COMPANY TYPE
Enterprise AI platform + services
PROJECT PROFILE
Organizations seeking agent development inside a wider enterprise AI stack

3. IBM

IBM approaches agents through both technology and services. Its ecosystem makes it relevant when a company wants reusable infrastructure for building, orchestrating, governing and operating agents alongside the initial application.

IBM's research organization is also producing empirical work on deployed agents. Its 2026 production study documents the emphasis practitioners currently place on reliability, controlled execution and human evaluation.

Determine which parts of the system depend on IBM technology, which remain portable, how external models and systems connect, how agents are evaluated and how much control your engineering team retains.

COMPANY TYPE
Technology consultancy
PROJECT PROFILE
AI systems embedded inside broader software engineering programs

4. Thoughtworks

Thoughtworks becomes relevant when an agent represents one component of a larger software system. Such a project also needs application interfaces, data infrastructure, APIs, internal platforms, cloud architecture and testing.

General software engineering depth matters because many production-agent failures occur outside the model. Ask how the proposed team handles state, tool design, retrieval, evals, traces, retries, model changes and failure recovery.

COMPANY TYPE
Global technology services
PROJECT PROFILE
Enterprise agent systems connected to established operations

5. Cognizant

Cognizant works across enterprise technology, operations, data and AI. That breadth can fit deployments interacting with existing enterprise systems and processes.

During procurement, separate platform configuration, custom engineering and operational work. Ask which components are being built for your workflow, which come from third-party platforms, how behavior will be tested and what your company retains after the engagement.

COMPANY TYPE
Global consulting and technology services
PROJECT PROFILE
Enterprise AI initiatives spanning multiple systems or functions

6. Capgemini

Capgemini combines consulting, engineering, cloud, data and AI capabilities.

For a narrower project, ask to meet the technical team responsible for the build. Have them map the proposed tools, knowledge architecture, state, approval controls, evaluation framework and production monitoring.

Judge the provider by the specificity of the answer.

COMPANY TYPE
Digital engineering
PROJECT PROFILE
Agents embedded in software products

7. Globant

Globant becomes relevant where agent functionality sits inside a larger customer-facing or internal product.

Examine the complete execution path. Where does context come from? Which systems can the agent access? How do permissions propagate? What happens after an API error? How does a user recover from a failed action? How are regressions detected after a model change?

COMPANY TYPE
AI development company
PROJECT PROFILE
Bespoke generative AI and agent projects

8. LeewayHertz

LeewayHertz has a visible custom AI development practice that includes generative AI and agent systems.

Ask for a comparable architecture and inspect the tools available to the agent, state management, retrieval architecture, evaluation method, human checkpoints, observability and deployment process.

A working demo establishes possibility. Repeated evaluation establishes reliability.

COMPANY TYPE
Product engineering
PROJECT PROFILE
Custom applications combining agents with wider software engineering

9. Simform

Simform combines application engineering with agentic AI work.

Ask how the team decomposes failures. Tool-selection accuracy, argument validity, retrieval quality, escalation behavior, execution traces and business outcomes should be observable separately where the workflow permits it.

COMPANY TYPE
AI, ML and data engineering
PROJECT PROFILE
Data-intensive AI systems

10. InData Labs

InData Labs is relevant when data engineering forms a large part of the proposed system.

Company knowledge sits across databases, documents, internal applications and inconsistent formats. Buyers should examine ingestion, metadata, retrieval, permissions, freshness, evaluation and the process for keeping the knowledge layer current.

EVERY PROVIDER HAS TO ANSWER THE SAME TECHNICAL QUESTIONS

How to compare AI agent development companies

A vendor comparison becomes more useful when every provider has to answer the same technical questions.

DimensionEvidence to look for
Workflow engineeringCan map real processes, decisions and exceptions
Agent architectureCan justify agent boundaries and orchestration
Tool engineeringDesigns narrow, reliable model-facing tools
RAGTests retrieval, reranking, permissions and grounding
EvaluationUses representative cases and repeatable graders
ObservabilityCaptures enough execution data to diagnose failures
Human controlDefines approval and escalation precisely
SecurityLimits access and action according to permissions
Systems workCan connect existing enterprise software
OwnershipDefines code, data and infrastructure ownership
OperationsHas a process for model changes and regressions
Business measurementConnects technical success to workflow outcomes

A numerical vendor score can imply precision that the available evidence does not support. These criteria are more useful as a diligence framework.

A CREDIBLE ESTIMATE FOLLOWS WORKFLOW DISCOVERY

What determines AI agent development cost?

A single market-wide price range tells a buyer very little.

A support agent that reads tickets and suggests categories has a much smaller engineering surface than an agent that investigates financial exceptions across five enterprise systems and can initiate transactions.

Cost driverWhy it matters
Workflow breadthMore branches create more behavior to design and test
Number of connected systemsEvery system adds engineering and failure paths
Legacy softwareMay require custom connectors or computer interaction
Data conditionPoor information needs preparation
Retrieval requirementsSearch, reranking and permissions add another subsystem
Action riskConsequential actions require stronger controls
Agent countCoordination adds state and testing work
Evaluation burdenMore behavior requires more representative cases
Security requirementsIdentity and permissions can become major workstreams
Production volumeRuntime cost, latency and scaling become material
Regulatory requirementsAudit and data controls can change architecture

A credible estimate follows workflow discovery.

PLATFORMS REDUCE THE INFRASTRUCTURE A TEAM HAS TO BUILD

Build internally, use a platform, or hire an AI agent development company?

SituationInternal buildAgent platformDevelopment company
Strong internal AI teamStrongStrongOptional
Proprietary workflowStrongVariesStrong
Standard business processPossibleStrongPossible
Many custom systemsStrongVariesStrong
Limited AI engineering capacityDifficultPossibleStrong
Need architecture controlStrongVariesStrong
Need packaged capability quicklyWeakStrongPossible
Heavy customizationStrongVariesStrong
Long-term internal developmentStrongStrongDepends on handoff

Platforms reduce the infrastructure a team has to build. Custom development becomes more relevant as the workflow becomes more proprietary, systems become more unusual, or the organization needs tighter control over behavior and architecture.

WORKFLOW ยท KNOWLEDGE ยท TOOLS ยท HUMAN CONTROL ยท EVALUATION ยท OPERATIONS ยท OWNERSHIP

AI agent development procurement checklist

Workflow

  1. 1What exact process will the agent perform?
  2. 2What constitutes successful completion?
  3. 3Which decisions require model judgment?
  4. 4Which operations can remain deterministic?
  5. 5Which exceptions occur today?

Knowledge

  1. 6Which information does the agent need?
  2. 7Where does that information live?
  3. 8How frequently does it change?
  4. 9Which permissions apply?
  5. 10How will retrieval quality be tested?

Tools

  1. 11Which systems can the agent read?
  2. 12Which systems can it modify?
  3. 13What is the minimum authority each tool requires?
  4. 14How are tool parameters validated?
  5. 15What happens when a tool fails midway through execution?

Human control

  1. 16Which actions can execute automatically?
  2. 17Which actions require approval?
  3. 18What triggers escalation?
  4. 19What happens after repeated failures?
  5. 20Can consequential actions be reversed?

Evaluation

  1. 21Which historical cases form the first eval set?
  2. 22How is task success measured?
  3. 23Are tool calls tested?
  4. 24Is retrieval tested independently?
  5. 25Are multiple trials used where model behavior varies?
  6. 26Are execution traces inspected?
  7. 27How do production failures become regression tests?

Operations

  1. 28Can operators reconstruct a failed run?
  2. 29How are model changes tested?
  3. 30How are prompts and tools versioned?
  4. 31How is runtime cost monitored?
  5. 32What is the rollback process?

Ownership

  1. 33Who owns the source code?
  2. 34Who owns the eval dataset?
  3. 35Who controls the production infrastructure?
  4. 36Can the model provider be changed?
  5. 37Can your internal team operate the system after handoff?

These questions reveal how a vendor builds and runs production AI.

Frequently asked questions

An AI agent development company builds systems in which AI models can reason about tasks, access information, use software tools and make decisions across multiple steps.

Production work can include workflow analysis, RAG, tool engineering, orchestration, permissions, human approval, evaluation, observability, deployment and ongoing testing.

Sources and methodology

PAN ET AL., CHARACTERIZING AGENTS IN PRODUCTION
Quantitative production-agent statistics in this guide come from Pan et al., Characterizing Agents in Production, an ICML 2026 study based on 20 in-depth case studies and a survey of 306 practitioners across 26 domains.
LANGCHAIN, STATE OF AGENT ENGINEERING
The observability and evaluation figures come from LangChain's 2026 State of Agent Engineering survey of more than 1,300 professionals.
STEP-RELIABILITY CHART
The step-reliability chart is a mathematical illustration with no measured production data behind it. Its assumptions are stated alongside the figure.
COMPANY CAPABILITIES
Company capabilities should be checked again during procurement because services, platforms, models and technical capabilities change over time.

LET'S TALK

Go fromproductionin weeks,not quarters.

Book a 15-minute working session. Bring one process that hurts. We'll leave with a plan for it, and an honest answer on whether we're the right neolab.