What we are working on.
How can AI agents reliably prepare technical enquiries? We examine how company knowledge, tools and human review work together — measured by result quality and total cost.
From enquiry to professional approval.
We aim to establish where AI helps with a technical enquiry: which information from the drawing and product requirements is reliable, what is missing, and what must a person check before the result is passed on?
Evaluation plan defined · comparison pending
The workflow under consideration
- 01Enquiry & drawing
- 02Check data & rules
- 03Prepare a draft
- 04Professional approval
Define the task and acceptance criteria
Select approved example data for a bounded class of tasks, record the current workflow and define professional success criteria. Missing information and exceptions belong in the test scope.
Compare using the same cases
Compare a fixed workflow and a single agent on the same tasks. For agent onboarding, also compare a general setup with an onboarded version using the same model and permitted access, documenting context and tools. Multiple agents follow only where additional value is justified. Professional acceptance criteria remain the same.
Assess permissions and operations
Test unauthorized actions and recovery in an isolated environment. For professionally suitable variants, then assess local, hybrid and cloud operations against data requirements, workload and total cost.
What the comparison should establish
- Result quality, clarification, errors and required rework.
- Time and total cost to an accepted result.
- Effective permission boundaries and approval effort.
The next evidence will be a documented comparison with a clear system boundary and stated limitations. Quality and authorized data access are prerequisites; effort is compared only within those constraints. Test cases and measurements are still pending.
AI for reliable product work.
How does a drawing, product rule or requirement become a professionally useful result? We examine four aspects of the same task: collaboration and system design, together with economics and security in operation.
Working with agents
Specialists provide goals, drawings and references; agents support the work. We ask how context and feedback improve the quality of design variants, checks and drafts.
Open question
Which instructions, references and feedback does an agent need for a specific professional task?
Questions and approach
- Prompting is evolving: goals, references and success criteria are gaining importance. For tasks such as drawing extraction or variant comparison, we aim to test which context helps and where additional rules make the work harder.
- Company knowledge should be available when needed. For us, context engineering means selecting the relevant information and keeping it current. Skills package recurring domain knowledge, instructions and tools for reuse.
- People set priorities, assess results and provide feedback. We examine which feedback should become better references or checks so that the next task needs less micromanagement.
- Recent Anthropic publications show how guidance changes as models improve. These approaches are to be tested against each process; shorter prompts are not a quality goal in themselves.
Building agent systems
Agent onboarding provides a concrete starting point: we set up agents for a specialist task with product knowledge, working instructions and suitable tools. We assess their value through the results.
Open question
When is a simple workflow enough, and when does greater autonomy or collaboration between agents justify the extra effort?
Questions and approach
- We start with the business process: which data is reliable, which systems must be accessible and which actions are permitted? We clarify responsibilities, access rights and the steps requiring human approval.
- For known processes, we first consider fixed workflows. The same test tasks are to establish whether a single agent helps with variable inputs or clarification. Multiple agents become relevant when separate tasks or independent review can reasonably be expected to offer a measurable benefit.
- Repeated work cycles need a verifiable goal, stop conditions and limits on runtime and token use. Tokens are the text units processed by a language model. The next step must be clear when uncertainty arises or the budget is exhausted.
- The planned comparison uses representative test tasks, known as evals, to assess output quality, errors, duration and cost together. It is to examine actual outcomes in the target system and the steps requiring a human decision. A model change also calls for a fresh review of the system design.
- Neon illustrates an onboarding pattern: skills guide agents to relevant documentation and working practices, while connected tools enable actions. We apply this principle to specialist business tasks. The example demonstrates the technical approach; it does not yet establish benefits in our client processes.
Agent onboarding: preparing AI agents for work in your company.
An agent needs orientation: which sources are authoritative, how is work done, and who resolves uncertainty? We start with one business process, one agent role and a responsible team. Onboarding combines company knowledge, working practices and system access with a practical acceptance review.
- 01
Define the assignment
Agree on the task, owners and expected result. Define together what useful work looks like.
- 02
Make knowledge accessible
Provide access to authoritative sources, specialist terms and product rules. Load knowledge as needed and assign responsibility for keeping it current.
- 03
Explain how work is done
Describe recurring steps in skills, examples and templates, including clarification and exception handling.
- 04
Set up the tools
Connect the required systems, enforce access limits and build human approvals into the workflow.
- 05
Pass a practical review
Work through normal cases and faulty inputs. Specialists assess results; permitted and prohibited actions are tested.
- 06
Stay up to date
Train the team, maintain sources and skills, and test again after changes. Access revocation and recovery are part of the handover.
Example: preparing a technical enquiry
An employee supplies an enquiry with a drawing. The agent finds the current product rules, cites evidence for its findings and flags gaps. It drafts clarification questions; the responsible person reviews them and decides whether to pass them on.
Our evaluation question: does onboarding reduce repeated explanations, clarification and rework? We compare the same tasks using the same model and permitted access, documenting context and tools. We assess professionally accepted results, effective authority limits and total cost including upkeep. The comparison is still pending.
Operating AI economically
Drawing checks, variant generation and quote preparation have different requirements. These inform the choice of models, operating environments and hardware. Result quality and total cost are the deciding factors.
Open question
Which combination of architecture, hardware and operations produces a professionally accepted result at a reasonable total cost?
Questions and approach
- The task, quality target, data requirements and workload determine the operating architecture. Our hypothesis is that many companies will operate such AI applications on an ongoing basis. Here, “AI factory” means the environment of data, models, tools and checks required to do so; scope and operating model must be determined for each application.
- Model architectures are to be compared against the task: dense models use their components throughout computation; mixture-of-experts models (MoE) activate selected subnetworks. Quantization stores model values at lower precision. Application tests must show whether this saves memory and cost while preserving the required quality.
- Model routing assigns tasks to suitable models. Caching reuses previously computed context, while batching groups requests. These methods are to be evaluated alongside response time and quality: the measure of token economics is cost per professionally accepted result, including failed attempts and rework.
- Hardware depends on the model and workload: a CPU as the main processor, a GPU or NPU as an accelerator, and working and model memory (RAM/VRAM). Memory bandwidth, networking and storage can limit throughput. Local, hybrid and cloud operations are to be compared against utilization, data requirements and operating effort.
- Total cost includes energy under load and at idle, cooling, depreciation, integration, services, maintenance, security testing, recovery from incidents, human review and rework. We investigate how consumption and shared infrastructure can be allocated transparently to departments and processes. Energy per result requires measurements on the actual system; a chip power rating is insufficient. Without measured data, cloud consumption must be labelled as an estimate.
Securing AI agents
An agent may be allowed to check a drawing without being allowed to send customer data or approve a quote. We ask how such boundaries can be enforced technically and verified within the professional workflow.
Open question
How much autonomy is appropriate for a particular process, and which verifiable controls does it require?
Questions and approach
- Minimal access rights, separate identities and narrowly scoped tools form the foundation. Permissions are enforced in the target system; critical changes and data transfers require verifiable approval. Our evaluation question: do these boundaries hold when assignments are incomplete or work is delegated to other agents?
- External documents, websites and tool responses can contain manipulative instructions, known as prompt injection. Such content must not grant additional authority. We examine data flows, permitted recipients and the origin of integrated tools and skills. Access keys belong in separate credential management, outside the model context. Local hosting alone does not ensure security.
- Manipulated inputs, attempted unauthorized actions and stop conditions are to be tested in isolated, authorized environments. We aim to record prevented boundary violations, legitimate work that is incorrectly blocked, and the effort required for human approvals. Actual actions in the target system are the evidence that matters.
- Operations require traceable logs without access keys, detection of unusual actions and consumption patterns, and a rehearsed way to stop execution, revoke access and recover. Responsibilities and the effort required for these controls are included in cost per accepted result.
- Dario Amodei’s September 2026 essay and Anthropic’s reports motivate these questions. We distinguish his assessment of future risks, observed misuse and unauthorized agent actions in misconfigured tests. The limitations of these sources are set out below; they do not replace evaluation of our specific applications.
The process does not end at the company boundary.
Onboarding internal agents can lead to a second step: giving customer and supplier agents a clear way to access product information, variant rules and enquiry processes. Public skills can offer guidance. Data access and authority to act for a company are checked separately and enforced technically. We aim to investigate how this supports traceable handovers with sources, versions and human approval.
- 01
Request
Requirements, drawings, sources and product context are handed over in a structured form.
- 02
Check
The recipient checks the assignment, product rules and missing details; agents can assist.
- 03
Clarify
Open points return to the customer in structured form.
- 04
Approve
People decide on price, timing and exceptions.
- 05
Handover
Result, source, version and responsibility are recorded.
This needs six clear rules.
A technical connection is not enough. Every handover needs a fixed frame.
- 01
Identity
Who acts for which company?
- 02
Mandate
What may the agent check, execute or commit to?
- 03
Semantics
Which terms and product rules apply?
- 04
Data
Which information may leave the company?
- 05
Evidence
Which source and version support the result?
- 06
Escalation
When must a person decide?
What informs our work.
These primary sources offer methodological and technical guidance. Vendor findings and standardized benchmarks do not replace evaluation in a company’s own process. Sources reviewed on 16 September 2026; Neon additions checked on 20 September 2026.
Anthropic · 29 September 2025
Effective context engineering for AI agentsDescribes the transition from individual prompts to ongoing selection of relevant context. Clear instructions remain part of this work.
Anthropic · Thariq Shihipar · 24 July 2026
The new rules of context engineering for Claude 5 generation modelsReports on simpler instructions, better interfaces and context loaded when needed. The findings concern specific Claude models and internal coding tests; they are not a general rule for prompt length.
Anthropic · Delba de Oliveira & Michael Segner · 30 June 2026
Loop engineering: Getting started with loopsOrganizes work cycles by triggers and stop conditions, connecting quality checks with token budgets. Recommends simple solutions for simple tasks.
Anthropic · 9 January 2026
Demystifying evals for AI agentsMethods for repeatable agent tests using technical, model-based and human assessment. Test cases and success criteria must fit the business process.
Neon · 22 January 2026
Agent Skills in 2026Describes skills as a guide to working practices and current documentation, complemented by authenticated MCP tools. An inspiration for our approach, not evidence of its impact in other companies.
Neon · 25 August 2026
Just landed in the Neon CLIShows combined setup of authentication, MCP and skills, plus updates. The implementation is specific to Neon; specialist business tasks need their own acceptance criteria.
AMD · 16 March 2026
Efficient MoE Inference on Strix and HaloCase study on the interaction of MoE, quantization, CPU, NPU and memory. Results concern a specific model and platform; they are not a general hardware comparison or purchasing recommendation.
International Energy Agency (IEA) · 16 April 2026
Key Questions on Energy and AIExamines electricity demand, infrastructure and AI development. Global scenarios do not provide a consumption figure for an individual business application.
MLCommons · Checked: 16 September 2026
MLPerf Inference: DatacenterComparable inference tests for defined workloads. Reported energy measurements apply to the complete system in that particular benchmark, not automatically to other tasks.
Dario Amodei · September 2026
We Must Pace the FrontierPersonal essay about future risks and independent safety evaluation. The forecasts are Amodei’s assessment; they do not establish a measured likelihood for business applications.
Anthropic · Threat Intelligence Team · 10 September 2026
Detecting and countering misuse of AI: September 2026Selected misuse cases from December 2025 to August 2026. A report by the Threat Intelligence Team, not a personal report by Amodei or a representative measure of frequency.
Anthropic · Paul C. Bogdan et al. · 9 September 2026 · corrected 10 September 2026
An alignment assessment of recent cybersecurity incidentsVendor analysis of four incidents in misconfigured cyber evaluations with internet access and normal cyber safeguards disabled. These test conditions do not establish a failure rate for ordinary business use.
OWASP GenAI Security Project · 2025 edition · checked 16 September 2026
LLM06:2025 Excessive AgencyDescribes risks from excessive tools, permissions and autonomy. Guidance for technical access controls and verifiable approvals, not a certification of any system.