CCAR-F Claude Certified Architect – Foundations Questions and Answers

The current prompt asks for testing analysis at too high a level. Claude recognizes the obvious absence of an entire test but has not been instructed to construct a path-level inventory. Option B turns the desired behavior into an explicit verification procedure: enumerate each condition, alternative branch, early return, exception handler, and failure path, then locate a test assertion that exercises its behavior.

Anthropic’s prompting best practices emphasize clear, specific instructions and explicit sequential steps when a task requires a defined analysis process. This change keeps the existing single review call while making the missing evaluation criterion unambiguous.

Option A improves proximity between implementation and tests but does not tell Claude what coverage relationship to inspect. Option C could work, but it adds orchestration, latency, cost, and another handoff before testing whether a direct instruction solves the observed failure. Option D may improve recognition of examples resembling the demonstration, but a few cases cannot enumerate every branch structure. Explicit path enumeration generalizes across unfamiliar code and creates auditable output: each reported gap can name the uncovered condition, expected behavior, and missing assertion.

================

Option D allows orchestration effort to scale with the actual request. A simple factual query may require only the web-search agent and a direct coordinator response, whereas a comparative investigation may require web research, document analysis, synthesis, and report generation. Anthropic’s Building Effective AI Agents describes the orchestrator-workers pattern as a central model dynamically identifying subtasks, delegating them, and combining the results. It is specifically appropriate when the required subtasks cannot be predicted reliably in advance. Anthropic’s multi-agent research architecture likewise emphasizes varying the number of agents and tool calls according to task complexity. Option A introduces an inflexible binary decision and still sends every non-factual request through the full pipeline. Option B requires labeled data, ongoing retraining, and reliable definitions of the “optimal” agent combination. Option C is easier to implement but will become brittle as new query types appear. A capable coordinator can examine the requested output, necessary evidence, source requirements, and analytical depth at runtime, then invoke only the specialists that materially contribute to the answer.

================

Option D identifies the dominant capacity problem. Anthropic states that everything sent in a request counts toward the context window : the system prompt, messages, documents, tool results, tool definitions, and the output Claude generates. A 175,000–190,000-token document is therefore not the complete input. Adding a 2,500-token tool schema, system instructions, wrappers, and the reserved output budget can push a nominally sub-200,000-token document close to or beyond the effective limit. Anthropic also warns that more context is not automatically better and that accuracy and recall can degrade as token count grows, a behavior described as context rot. That combination explains why short documents remain accurate while long documents lose information. Option A predicts a problem independent of document length, contradicting the measurements. Option B is an unsupported generalization and does not account for tool-definition overhead. Option C recognizes long-context degradation but ignores the concrete evidence that hidden prompt components consume the same window. The correct response is to count tokens for the complete request before submission, reserve output capacity, and chunk or retrieve relevant sections when the total approaches the model’s supported window.

================

Path-scoped rules directly satisfy the requirement that instructions load only when Claude works with matching files. Each infrastructure domain can have a separate Markdown file under .claude/rules/ , with YAML paths frontmatter targeting Terraform files, Kubernetes manifests, or pipeline configuration.

Anthropic documents that .claude/rules/ keeps project guidance modular and supports conditional loading based on glob patterns. Rules with a paths field apply only when Claude works with matching files, reducing irrelevant context and token consumption. Rules without path frontmatter load unconditionally. ( https://code.claude.com/docs/en/memory )

Option B improves readability but leaves all 500-plus lines in every session. Option C can provide directory-specific CLAUDE.md guidance, but path-scoped rules are more precise when conventions depend on extensions or patterns spanning multiple directories. Option D still requires manual imports and does not provide the documented conditional rule-loading mechanism.

A suitable design would use rules such as terraform.md scoped to terraform/**/*.tf , kubernetes.md scoped to kubernetes/**/*.{yaml,yml} , and pipelines.md scoped to the pipeline directory. Broad project-wide commands and repository etiquette can remain in the root CLAUDE.md.

Official references/topics: .claude/rules/ ; Path-Specific Rules; YAML Frontmatter; Context-Efficient Instruction Loading.

Option C corrects the weak selection signal presented to the model. Claude chooses among available tools using their names, descriptions, parameter schemas, and the current request. “Extracts a function from code” does not explain whether the tool understands syntax trees, preserves imports, updates call sites, validates scope, or offers advantages over Write and sed. Anthropic identifies prompt-engineering tool descriptions as one of the most effective ways to improve agent tool use. Descriptions should state what the operation performs, when it should be selected, what inputs are required, what output it returns, and any limitations.

Option A adds a separate probabilistic routing layer without improving the tool contract Claude ultimately sees. Option B ignores the server’s intended value. Option D removes a broadly useful capability and may prevent unrelated edits without guaranteeing that the MCP tools are used correctly. Each refactoring tool should instead describe its semantic behavior and contrast it with plain text manipulation—for example, that rename_variable performs scope-aware symbol renaming and updates references. Clear schemas, concrete examples, and evaluation against real refactoring tasks should accompany the improved descriptions.

================

Option C preserves each commit’s existing model, prompt, and independent processing structure while applying Anthropic’s reduced batch pricing. The official Message Batches documentation states that batch processing reduces input and output token costs by 50%. Requests are processed independently and asynchronously, and each response can be correlated with its original commit through a unique custom_id.

This workload is a strong batch candidate because it contains many independent requests and does not require an immediate response. Most batches complete within one hour, although processing can continue for up to 24 hours. The pipeline must therefore tolerate asynchronous completion and retrieve the results when processing finishes.

Option A changes the request architecture, increases the risk of context or output-limit failures, and makes individual retry and result association more difficult. Reducing request count does not inherently reduce per-token pricing. Option B improves throughput but concurrency does not change token rates. Option D would reduce cost but violates the explicit requirement to retain the same model tier. The Message Batches API is the only option satisfying every stated constraint.

================

Option A preserves disagreement as meaningful evidence. The report should identify the two estimates separately, explain that they arise from different methodologies and source types, retain the peer-reviewed study’s stated confidence interval, and classify the market size as contested rather than manufacturing false agreement. It may then explain what additional evidence would resolve the discrepancy.

Anthropic’s research prompting guidance recommends developing competing hypotheses, tracking confidence, verifying across sources, and retaining structured research notes. This supports calibrated synthesis rather than arbitrary selection or vague hedging.

Option B discards potentially important minority evidence and incorrectly treats corroboration count as equivalent to reliability. Option C creates numerical precision unsupported by the original sources; confidence scores from different agents are not automatically comparable, and averaging incompatible estimates can be meaningless. Option D introduces survivorship bias by suppressing uncertainty before synthesis. A systematic reporting structure distinguishes consensus, disagreement, evidence quality, methodological limitations, and unresolved questions. That produces an actionable briefing without overstating certainty or weakening every conclusion with generic qualifications.

================

Forking the existing analysis session creates independent continuations that inherit the accumulated conversation context. Each branch begins with the same understanding of the service module, request flow, source files, and error-handling patterns, but subsequent work on one testing strategy does not alter the other branch or the original session.

Anthropic’s Agent SDK documentation states that sessions can be resumed with their full context and forked to explore different approaches. In the SDK, enabling fork_session while resuming causes the continuation to receive a new session identifier rather than modifying the original session. ( https://docs.anthropic.com/en/docs/claude-code/sdk?utm_source=chatgpt.com )

Option B wastes time, tokens, and tool calls by requiring both new sessions to rebuild the same 23-file analysis. Option C mixes two experimental implementations into one conversation, increasing the risk that assumptions, edits, or conclusions from the first strategy influence the second. Option D preserves only a manually selected summary, which may omit details contained in the full session history.

The appropriate design is to create one fork for the end-to-end strategy and another fork for the snapshot strategy. The original analysis remains a stable parent, while each child session develops and evaluates its approach independently.

Official references/topics: Agent SDK Sessions, Session Forking, Context Preservation, Alternative-Approach Evaluation.

Option C is the strongest choice among the listed approaches because it moves structured data generation from unconstrained response text into a schema-governed interface. Prompt-only JSON instructions, regular-expression extraction, and corrective retries are probabilistic recovery mechanisms: they may reduce failures, but none guarantees that the first response satisfies the contract. Anthropic now provides two schema-constrained mechanisms: JSON Structured Outputs through output_config.format and strict tool use through a tool definition with strict: true. Strict tool use uses grammar-constrained sampling so the tool input conforms to the declared JSON Schema, including required properties and data types. Therefore, the production implementation represented by option C should define the extraction tool’s input_schema and enable strict mode. The application reads the tool_use block as the extracted record; it does not need to scrape prose or search for braces. Option A remains vulnerable to preambles or malformed output. Option B can select a JSON-looking substring but cannot establish schema validity. Option D adds latency and cost and can still fail repeatedly. The schema-constrained tool contract is consequently the most reliable architecture available in these options.

================

The most reliable architecture separates semantic interpretation from deterministic normalization. Claude is well suited to identifying that “$12” and “12.00” represent prices, or that a leaf icon represents a dietary classification. However, canonical conversion—removing currency symbols, converting values to decimal types, mapping icons to controlled labels, and enforcing locale-specific rules—is more predictably performed in application code.

Structured Outputs guarantee that Claude returns valid JSON matching the supplied schema, but that guarantee concerns structural conformance. It does not by itself guarantee that every semantically equivalent source representation will be normalized identically. Anthropic’s evaluation guidance identifies code-based checks as the fastest, most reliable, and most scalable mechanism for rule-based validation. ( https://platform.claude.com/docs/en/build-with-claude/structured-outputs )

Option D therefore minimizes model responsibility: Claude extracts the evidence as represented, and deterministic post-processing converts it into the canonical downstream format. This also makes normalization rules independently testable, version-controlled, and auditable.

Option A increases latency and cost without solving normalization. Option B improves output structure, but prompt-based normalization can still vary across ambiguous formats. Option C introduces unnecessary stochasticity and majority-vote logic where explicit parsing rules are available. The downstream contract should remain stable, but format conversion should be implemented using deterministic transformations rather than repeated probabilistic inference.

Official references/topics: Structured Outputs—schema compliance; Evaluation Design—code-based validation; Reliable extraction pipelines.

Option B teaches Claude the actual decision boundaries behind the team’s judgments. Contrasting examples can demonstrate why one apparent security pattern is acceptable within the organization’s deployment controls while a superficially similar implementation is genuinely unsafe. The same technique can distinguish established style conventions from deviations and intentional performance trade-offs from accidental inefficiencies.

Anthropic identifies relevant, diverse, and clearly structured examples as one of the most reliable ways to improve Claude’s accuracy and consistency. Its official prompting guidance recommends examples that closely mirror the production task while covering important variations and edge cases. This encourages generalization based on demonstrated criteria instead of memorization of prohibited wording.

Option A can suppress legitimate findings merely because they contain a selected keyword. Option C will become lengthy, difficult to maintain, and incapable of enumerating every future code variation. Option D is too vague and may reduce recall by discouraging Claude from reporting uncertain but genuine defects. Few-shot contrasts provide precise, maintainable behavioral guidance without imposing a blanket suppression policy.

================

Option A implements an iterative orchestrator-worker loop in which synthesis is treated as an evaluation checkpoint rather than an irreversible transition to report generation. When synthesis identifies missing evidence, the coordinator can formulate focused follow-up tasks, send them to the agents with the appropriate tools, and repeat synthesis after receiving the additional findings.

Anthropic’s multi-agent research architecture follows this pattern: the lead agent synthesizes subagent findings and determines whether further research is required. If gaps remain, it creates additional subagents or refines the research strategy. This preserves specialization and centralized control.

Option B makes the incompleteness visible but does not improve research coverage. Option C may increase initial cost without guaranteeing that the specific gaps discovered during synthesis will be addressed. Option D weakens separation of concerns by giving the synthesis agent search capabilities that belong to the research specialists. Targeted redelegation is more efficient because the second research round is informed by concrete deficiencies rather than speculative breadth. It also allows the coordinator to track completeness explicitly before authorizing final report generation.

================

Option A exposes both independent invocations in the same assistant turn, allowing the Agent SDK or application tool runner to execute them concurrently. The coordinator can then receive both results together and continue with synthesis only after the independent research branches have completed.

Anthropic’s parallel tool-use documentation explains that a response may contain multiple tool-use blocks. Independent, read-only operations can be executed concurrently to reduce latency, after which all corresponding tool results should be returned together. The term “Agent” is used here because current Claude Agent SDK releases renamed the earlier “Task” tool.

Option B may shorten individual execution but does not eliminate the sequential waiting pattern and could reduce research quality. Option C expresses the desired behavior but does not correct an orchestration implementation that processes only one tool call per turn. Option D introduces unnecessary coordinators, duplicated context, and substantially more complex state management. A single coordinator issuing both independent Agent calls preserves centralized monitoring and result association while removing the avoidable serial dependency. The runtime must process every returned tool call concurrently rather than stopping after the first one.

================

Option A parallelizes independent precedent analysis while preserving centralized control. The coordinator can partition the 12 precedents into balanced groups, provide each worker with identical extraction and citation requirements, monitor completion or failure, and aggregate the structured results before invoking synthesis.

Anthropic’s multi-agent research architecture uses an orchestrator-worker pattern in which a lead agent coordinates specialized subagents operating in parallel. Parallel execution is valuable when tasks are substantially independent, as each precedent can be analyzed without waiting for the preceding case. Maintaining the fan-out at the coordinator also produces a clear execution trace showing each assignment, status, and returned result.

Option B introduces nested delegation and makes tool usage, permissions, failures, and costs harder for the coordinator to observe. Option C compounds those problems through recursive spawning and risks excessive agent and token consumption. Option D may be appropriate for a large distributed processing platform, but it adds infrastructure without inherently improving the coordinator’s reasoning-level observability or defining how results are associated with the case. Coordinator-managed parallel workers provide the required latency reduction with the simplest debuggable architecture.

================

Option B targets the remaining failure mode: semantic recognition across heterogeneous document structures. Strict schemas eliminate malformed JSON and can guarantee that tool inputs conform to declared types, but they cannot force Claude to locate evidence that appears under unfamiliar headings or in atypical sections. Anthropic’s prompting guidance says that a few relevant, diverse, structured examples are among the most reliable ways to improve accuracy and consistency. Examples should therefore show inline citations, reference lists, numbered bibliographies, methodology sections, and methods embedded in introductions, each paired with the correct extracted structure. This teaches the intended evidence-location and granularity rules rather than merely repeating the same request. Option A retries an unchanged prompt and can reproduce the same omission. Option C introduces brittle regex rules that may miss nonstandard citations and mistake keyword mentions for methodology content. Option D suppresses validation failures by weakening the contract, but it does not improve extraction and would convert recoverable omissions into incomplete records. The examples should be drawn from real failure cases, evaluated on a held-out set, and expanded when monitoring reveals new layouts. Schema constraints and few-shot coverage solve different layers of reliability and should be used together.

================

Option B gives the report generator the two forms of information it actually needs: a compact narrative containing the synthesized conclusions and precise evidence records supporting those conclusions. The source index should map claim identifiers to URLs, document locations, excerpts, and other provenance fields so citations can be generated and verified without reloading 120,000 tokens of raw material.

Anthropic’s context-engineering guidance recommends distilling extensive subagent activity into high-signal summaries while preserving critical context and dependencies. Its research architecture similarly treats subagents as intelligent filters that compress large evidence collections before returning relevant findings to the coordinator.

Option A lacks sufficient location-level evidence for reliable citation verification. Option C postpones attribution until after drafting, when claim wording may no longer map cleanly to the original evidence. Option D maximizes theoretical completeness but introduces extensive irrelevant material, higher token costs, slower processing, and greater context pollution. The synthesis draft plus a structured claim-to-source index maintains evidentiary completeness where it matters while eliminating intermediate searches, duplicate passages, and other low-value context.

================

Option A is correct because the failure results from excessive output volume, not from JSON or tool use. Anthropic documents that max_tokens is a hard output ceiling and that a response stopped at this limit reports stop_reason: " max_tokens " . Its tool-streaming guidance also warns that generation can stop midway through a tool parameter, leaving partial JSON that must not be treated as complete. Splitting the pull request into bounded file groups limits the number of findings produced by each call, preserves the report_findings schema, and allows the pipeline to validate every response independently before merging and deduplicating the arrays. Shared dependency context can still be included when cross-file analysis is required.

Option B only postpones the failure because the model’s output maximum remains finite. Option C abandons the structured contract and makes deterministic parsing less reliable. Option D changes the review requirements by suppressing potentially valuable lower-severity findings, while the retried request could still reach the same limit. Controlled partitioning followed by deterministic aggregation is therefore the most reliable and scalable design. Anthropic stop-reason guidance and tool-streaming guidance .

Option D directly addresses cache entries expiring before later batch requests are processed. Anthropic’s batch-processing documentation specifically notes that Message Batches can take longer than five minutes and recommends the one-hour prompt-cache duration for batches containing shared context. The prompt-caching documentation confirms that the default TTL is five minutes and that " ttl " : " 1h " creates an extended entry.

Option A may improve cache locality, but it introduces the sequential-processing latency explicitly prohibited by the requirement. Option B seeds the cache initially, but the prewarmed entry still expires after five minutes unless the TTL is extended; it therefore does not solve misses among requests scheduled later. Option C places the breakpoint on request-specific content, defeating reuse of the stable 8,000-token prefix and attempting to cache scripts that are not byte-for-byte identical.

The system should retain the breakpoint at the end of the shared system content and apply the one-hour TTL there. Cache-usage fields should then be monitored to confirm that cache_read_input_tokens rises and later batch requests reuse the intended prefix.

================

The Messages API exposes stop_reason specifically so the application can determine why Claude stopped generating and what action is required next. A value of tool_use means Claude is requesting one or more tools and expects the application to execute them and return corresponding tool_result blocks. A value of end_turn means Claude has naturally completed the response. ( https://platform.claude.com/docs/en/build-with-claude/handling-stop-reasons )

Anthropic’s agent-loop tutorial implements this as a loop that continues executing tools and returning results while stop_reason remains tool_use . Once the value changes, the response is treated according to the new terminal or continuation condition. ( https://platform.claude.com/docs/en/agents-and-tools/tool-use/build-a-tool-using-agent )

Option A is unreliable because an assistant response can contain both text and tool-use blocks. Text alone does not prove that the workflow is complete. Option B requires the application to predict that no further tool call is needed, defeating Claude’s ability to adapt from tool results. Option D is an important safety limit but is not the primary completion signal; an arbitrary maximum may terminate a valid workflow prematurely.

The harness should check stop_reason , process every requested tool call, append results to the conversation, and maintain a separate maximum-turn safeguard against runaway loops.

Official references/topics: Messages API stop reasons, tool-use loops, tool-result continuation, bounded orchestration.

Resuming the existing subagent preserves the expensive investigative context: files already inspected, data-flow relationships, hypotheses, and intermediate conclusions. Anthropic documents that session history contains prompts, tool calls, tool results, and responses, allowing an interrupted investigation to continue with its prior analysis intact. ( https://code.claude.com/docs/en/agent-sdk/sessions ) Subagent transcripts also persist within their parent session and can be resumed after an interruption or restart. ( https://code.claude.com/docs/en/agent-sdk/subagents?utm_source=chatgpt.com )

The engineer must nevertheless disclose the renamed utility functions. Anthropic explicitly distinguishes conversation persistence from filesystem persistence: resuming restores what the agent previously knew, but it does not freeze or snapshot the repository. ( https://code.claude.com/docs/en/agent-sdk/sessions ) Without the update, the subagent may search for obsolete symbols, misinterpret broken references, or rely on stale file paths.

Option A loses the detailed transcript and replaces it with a necessarily compressed summary. Option B preserves context but conceals a material repository change. Option D duplicates a large transcript inside a new context, increasing token consumption without providing any advantage over native resume functionality.

The resumed prompt should name the renamed functions, identify the merge or affected files, and instruct the subagent to re-read only the changed areas before continuing its broader exploration.

Official references/topics: Session Resume; Persistent Subagent Transcripts; Repository Drift; Targeted Context Refresh.

The implementation approach is unresolved and carries architectural consequences. WebSockets, Server-Sent Events, and polling differ in connection lifecycle, bidirectional communication, proxy compatibility, scaling requirements, deployment topology, reconnection behavior, and operational complexity. Claude should therefore inspect the existing application and infrastructure before modifying code.

Anthropic recommends separating exploration and planning from implementation when the approach is uncertain, the work affects multiple files, or the developer is unfamiliar with the relevant architecture. In plan mode, Claude can read files and analyze the system without making changes, produce a detailed proposal, and allow the developer or team to review the plan before execution. ( https://code.claude.com/docs/en/best-practices )

Option A commits to polling before determining whether its latency and load characteristics meet the requirement. Option B delegates a consequential architectural decision and immediate implementation to a single execution step without a review checkpoint. Option D prematurely selects the most infrastructure-sensitive option and assumes later refactoring will be inexpensive.

Option C creates the correct sequence: examine the frontend and backend architecture, document requirements, compare alternatives, identify infrastructure constraints, obtain approval, and only then implement the selected design with appropriate tests and observability.

Official references/topics: Plan mode, explore–plan–implement workflow, architectural trade-off analysis, review checkpoints.

Option D is the closest match to Claude Code’s documented editing procedure. The Claude Code tools reference explains that Edit performs exact string replacement and requires old_string to appear exactly once. When the text occurs multiple times, the prescribed response is to include sufficient surrounding context to identify one occurrence uniquely. For this insertion, the match should span a distinctive boundary between the preceding function and the following function. It does not literally need 30 lines; it needs the smallest exact block that is demonstrably unique, but option D is the only answer expressing that method.

Option A would modify every occurrence of a repeated pattern and could insert the helper function multiple times. Option B places the function at the end rather than at the required architectural location. Option C can technically work, but Write replaces the complete file and increases the change surface. Anthropic explicitly states that Write creates or overwrites full files, while partial modifications should use Edit. A targeted, uniquely anchored Edit preserves all unrelated content and produces a smaller, safer diff.

================

Claude Code’s --bare option is specifically designed for faster scripted execution. It skips automatic discovery of CLAUDE.md files, hooks, skills, plugins, MCP servers, and auto-memory while retaining essential built-in capabilities such as Bash, file reading, and file editing. Because --bare also prevents automatic loading of the root CLAUDE.md, the required standards must be added explicitly.

Option C accomplishes both objectives. --append-system-prompt-file ./CLAUDE.md loads the project standards into the current invocation while preserving Claude Code’s default coding-agent system prompt and tool-use guidance. According to the official Claude Code CLI reference , append flags add file contents to the default system prompt, whereas replacement flags discard that default guidance.

Option A could work functionally but duplicates the standards in every command and creates configuration drift. Option B replaces the complete default prompt, removing useful coding, safety, and tool-use instructions. Option D improves prompt-cache reuse across different machines, but it does not disable hooks, plugins, skills, MCP servers, or CLAUDE.md discovery and therefore does not directly address the measured initialization delay.

================

Project skills are stored at .claude/skills/ < skill-name > /SKILL.md . The directory name becomes the invocable command name, so .claude/skills/migrate-component/SKILL.md creates /migrate-component . Anthropic distinguishes project skills from personal skills: project skills apply only to the repository, while skills under ~/.claude/skills/ apply to one user across all projects. ( https://code.claude.com/docs/en/skills )

Committing the project skill to version control ensures that every developer receives the same workflow and that changes are reviewed, versioned, and synchronized with the codebase. Anthropic’s .claude directory guidance states that project configuration should be committed when it is intended to be shared with the team, whereas files under ~/.claude are personal. ( https://code.claude.com/docs/en/claude-directory )

Option A requires manual duplication across developer machines and allows versions to diverge. Option B loads the migration procedure into every conversation even when no migration is occurring; Anthropic recommends skills for reusable checklists and multi-step procedures because their bodies load only when used. Option C describes no valid mechanism for defining a skill’s content in settings.json .

Option D provides the correct scope, command name, on-demand loading behavior, and team distribution model.

Official references/topics: Project skills, SKILL.md structure, command invocation, version-controlled team configuration.

Option A corrects the missing tool contract that permits Claude to guess a required parameter. The process_refund description should state its prerequisite explicitly: invoke lookup_order, use only the exact order_id returned by that successful call, and ask for additional identifying information when lookup cannot resolve an order. An input example can demonstrate the correct two-tool sequence.

Anthropic’s tool-definition guidance identifies detailed descriptions as the most important factor in tool performance. Descriptions should explain when a tool should and should not be used, what every parameter means, and all important limitations. The tool-use overview confirms that Claude selects and populates tools based on the request and their descriptions.

Option B forces some tool call but does not tell Claude which tool must run first or where the identifier originates. Option C is an essential defence-in-depth control, but it detects the fabricated value after Claude has already made the incorrect decision. Option D works only when the customer supplies an identifier and does not cover “recent purchase.” Explicit prerequisite and provenance instructions directly prevent the model from inventing the required argument.

The agent is behaving inconsistently because every failure is represented identically. “Operation failed” contains no information about permanence, user correctability, authorization, or whether another attempt is likely to succeed. Adding structured fields converts the error into an actionable interface contract.

Anthropic instructs tool implementations to mark failures using an error flag and return information Claude can use to retry with corrected input, ask for clarification, or explain a limitation. Tool design should expose sufficient detail for the model to choose the correct next action rather than forcing it to infer the cause from a generic message. ( https://platform.claude.com/docs/en/agents-and-tools/tool-use/build-a-tool-using-agent?utm_source=chatgpt.com )

With error_category , isRetryable , and a causal description, the agent can retry transient network failures, request corrected identifiers for validation errors, and escalate or report permission failures without pointless repetitions. Option B retries permanent validation and permission failures unnecessarily. Option C adds another tool call and failure point merely to classify information the original tool already possesses. Option D relies on parsing variable text and examples rather than providing explicit machine-readable semantics.

The tool should preserve isError: true , return a stable structured error object, include a safe customer-facing message where appropriate, and avoid exposing internal secrets or stack traces.

Official references/topics: MCP error contracts, actionable tool results, retryability metadata, agent-computer interface design.

The investigation path cannot be reliably predetermined because the responsible files, components, and execution sequence are unknown. The agent should begin with available evidence—such as route definitions, stack traces, logs, or endpoint references—and use each discovery to decide the next search, file read, or diagnostic action.

Anthropic distinguishes predefined workflows from agents that dynamically direct their own processes and tool usage. Agents are appropriate for open-ended problems where the required number and nature of the steps cannot be predicted or encoded as a fixed path. During execution, the agent should obtain ground truth from tool results and adapt its plan based on that environmental feedback. ( https://www.anthropic.com/engineering/building-effective-agents )

Option A requires a comprehensive plan before the agent has inspected the code, so the plan would rest on unsupported assumptions. Option B forces every investigation through the same sequence even when an early discovery makes later steps irrelevant or identifies a different dependency path. Option C assumes the four layers can be investigated independently; tracing an intermittent request failure usually involves dependencies revealed sequentially across layers.

Option D implements an adaptive agent loop: inspect, form a hypothesis, use tools, evaluate the evidence, and generate the next subtask. The workflow should still include stopping conditions, testable hypotheses, and escalation when evidence remains inconclusive.

Official references/topics: Adaptive Agent Loops, Dynamic Task Decomposition, Tool Feedback, Open-Ended Coding Investigations.

An aggregate accuracy value can conceal severe performance disparities. A system may achieve 97% overall accuracy while performing poorly on a low-volume document type, a critical financial field, or a specific edge case. Automating outputs solely from the aggregate figure could therefore expose downstream systems to concentrated, high-impact errors.

Anthropic’s evaluation guidance states that evaluations should be task-specific, reflect the real-world task distribution, and explicitly include edge cases. It also emphasizes multidimensional success criteria rather than reliance on a single global metric. ( https://docs.anthropic.com/en/docs/build-with-claude/develop-tests ) Option A applies those principles by stratifying performance according to document type and field. This reveals whether confidence is calibrated consistently and whether the proposed automation threshold remains safe for every operationally significant segment.

Option B is useful only after segment-level performance has been understood. Selecting a global threshold cannot correct a subgroup where confidence is systematically overstated. Option C is necessary governance work, but it treats the overall 97% result as though errors were uniformly distributed. Option D places unvalidated outputs into downstream systems and depends on passive error reporting, which may fail to detect silent corruption.

The correct deployment gate is therefore segmented validation, followed by threshold selection, downstream acceptance criteria, and a controlled pilot.

Official references/topics: Define Success Criteria; Task-Specific Evaluations; Edge-Case Coverage; Reliability Segmentation.

Option A moves durable, high-value discoveries outside the transient conversation history. The scratchpad should record module responsibilities, important symbols, architectural relationships, file paths, unresolved questions, and decisions supported by the code. The agent can reread this compact file after context compaction or before answering a later architectural question. Anthropic’s large-codebase guidance recommends saving plans and important state to files because those artifacts survive when long conversations are compacted. Its context-management guidance also warns that accumulated file contents and command output can reduce performance during extended sessions.

Option B clears valuable information on a fixed schedule regardless of whether the current task is complete. Option C delays the problem but does not prevent irrelevant history from crowding out important details. Option D performs expensive summarization before the agent knows which files are relevant and may remove implementation details needed later. A focused scratchpad supports just-in-time restoration: the agent keeps the active context lean while retaining an auditable architectural map that can be updated as exploration progresses.

================

Option A is the most sustainable open-world design. The property-type domain is demonstrably not closed: uncommon values already occur, and new labels continue to appear. An enum is appropriate only when the valid vocabulary is stable and exhaustive. If the source contains a legitimate value outside that vocabulary, the schema either rejects it or pressures the model to map it inaccurately. A free-form string preserves the source meaning, while deterministic post-processing can normalize “studio,” “loft,” “duplex,” and future terms into an evolving canonical taxonomy. Anthropic’s Structured Outputs documentation distinguishes structural schema conformance from the semantic decisions made within that schema; it also documents that JSON Schema constraints such as enums govern allowable output shapes and values. Few-shot mapping to the nearest existing enum, option B, discards real distinctions. Continually expanding the enum, option C, creates recurring schema changes and still lags newly observed values. An “other” bucket with detail, option D, is workable but collapses all emerging categories at the primary field and complicates analytics until downstream interpretation occurs. Capturing the raw type first and normalizing it in code provides lossless extraction, testable mappings, and forward compatibility.

================

Option C creates an objective verification loop. The tests encode expected traversal behavior for disconnected graphs, cycle handling, weighted edges, invalid inputs, and performance constraints. Claude can implement the algorithm, execute the suite, inspect concrete failures, and refine the implementation until the measurable conditions pass.

Anthropic emphasizes giving Claude a verification mechanism such as tests, builds, linters, or fixture comparisons. Without an executable pass-or-fail check, Claude can only determine that an implementation appears complete. With tests, it can perform work, evaluate the result, and iterate using evidence rather than subjective judgment. Anthropic also recommends reproducing defects with failing tests before applying corrections. ( https://code.claude.com/docs/en/best-practices )

Option A may produce a thoughtful initial design but does not guarantee progressive improvement after implementation. Option B risks inheriting assumptions or deficiencies from a reference that may not match the project’s constraints. Option D depends on manual review and converts the developer into the primary verification system.

The test suite should include correctness fixtures, boundary cases, complexity-sensitive workloads, and regression tests added whenever a new failure is discovered. This makes every iteration cumulative: a correction must satisfy the new case without breaking previously validated behavior.

Official references/topics: Executable Verification; Test-Driven Iteration; Feedback Loops; Regression Testing.

Option A preserves provenance as first-class data throughout the pipeline. Each finding should contain the summarized claim, supporting excerpt, source identifier, URL or document title, and location information such as a page or content-block index. The synthesis agent can combine findings without severing the association between evidence and source, while the report generator can render citations directly from the structured records. Anthropic’s Citations documentation explains that reliable citations identify the supporting passage and its precise source location, including PDF page ranges or content-block indices. Passing all raw output, option B, preserves evidence but introduces excessive context and makes source selection harder. Inline references in prose, option C, are vulnerable to being altered, omitted, or detached from claims during subsequent summarization. Option D repeats research after report generation and may locate a different source rather than the evidence originally used. A structured provenance contract should therefore be required in every subagent’s output and validated at each handoff. The report generator should reject or flag factual claims that lack an associated evidence record instead of inventing or retrospectively reconstructing citations.

================

Option C gives the reviewer access to the evidence currently missing from its prompt. An agentic review can use Grep, Glob, Read, language-server tools, and test commands to locate callers, follow imports, inspect type definitions, and verify whether a suspected compatibility issue actually exists. A turn limit controls cost while still allowing targeted exploration.

Anthropic’s context-engineering guidance recommends just-in-time retrieval: agents should retain lightweight references and dynamically load the information needed for the current task instead of preloading a large fixed context. Anthropic has also reported that code-review performance improves when the necessary repositories are available for gathering complete context. Option A may load many irrelevant files while still missing reflection, generated interfaces, dependency injection, or indirect call paths beyond the arbitrary two-hop boundary. Option B cannot reason reliably about code that the model cannot inspect. Option D improves coverage but fragments repository-wide relationships and may duplicate substantial work. An agentic loop can begin with the diff, identify uncertain cross-file effects, search only relevant paths, and report findings only after locating supporting code. Anthropic context-engineering guidance , Claude Code quality report

================

Option A defines what successful research must achieve without hard-coding a brittle search procedure. The subagent receives measurable objectives—breadth, diversity, recency, and relevance—but retains authority to reformulate queries, follow promising leads, and adjust source selection when the topic does not match familiar patterns. Anthropic’s account of its multi-agent research system states that subagents need an objective, expected output format, guidance about tools and sources, and clear task boundaries. This is more informative than option B’s vague instruction, yet more adaptive than prescribing every query. Option C improves only one known failure path and still constrains the agent to a predefined procedure that may be unsuitable for emerging subjects. Option D adds orchestration complexity and a potentially incorrect classification step without solving over-prescription within either category. The coordinator should describe mandatory constraints separately from strategic guidance: authoritative-source requirements and time boundaries can remain fixed, while query formulation and exploration paths remain agent-controlled. Evaluation should then measure source coverage, evidence quality, duplication, and discovery of relevant secondary leads rather than whether the subagent followed a particular series of searches.

================

Option B identifies escalation through direct operational criteria rather than indirect proxies. A customer’s explicit request for a person is unambiguous. A required policy exception defines an authorization boundary. An inability to make meaningful progress identifies a case where continued autonomous execution is no longer productive.

Anthropic describes agents as systems that act, observe results, adjust, and continue until the task is completed or human input is required. Its trustworthy-agent guidance also emphasizes that agents must recognize when to pause rather than pushing through uncertainty or decisions that only a human can settle. ( https://www.anthropic.com/research/trustworthy-agents )

Option A is too rigid for high-ambiguity support cases. Maintaining exhaustive mappings for every issue, product, and customer segment recreates the brittleness that agentic reasoning is intended to avoid. Option C treats repeated tool use as a substitute for semantic progress; one definitive authorization failure may require immediate escalation, while several legitimate diagnostic calls may not. Option D confuses emotional tone with operational necessity. A calm customer may require a policy exception, while a frustrated customer may still have a straightforward automated resolution.

The escalation criteria should be encoded in the system instructions and supported by evaluations covering explicit requests, authorization limits, unresolved ambiguity, repeated non-progress, and successful self-service cases.

Official references/topics: Human-control checkpoints, escalation criteria, authorization boundaries, progress-aware agents.

Option A establishes a clear destination without forcing the subagent to follow a brittle route. The prompt should define the research question, boundaries, expected deliverable, acceptable source types, recency requirements, coverage expectations, and verification criteria. The subagent can then broaden, narrow, reformulate, or follow emerging leads according to observed search results.

Anthropic’s research-agent guidance emphasizes giving each subagent an objective, output format, source guidance, and clear task boundaries. It also describes research as dynamic and path-dependent, requiring agents to adapt their strategy as new information emerges.

Option B removes too much structure and may cause duplicated work, incomplete coverage, or inconsistent output. Option C handles only one known failure condition and still restricts the agent to a predetermined procedure. Option D adds classification complexity and creates an artificial boundary between topic types that may change during investigation. Objective-based delegation retains accountability because results can be evaluated against explicit quality criteria, while preserving the agent’s ability to discover alternative terminology, unexpected sources, and useful adjacent evidence. This is controlled autonomy rather than either procedural micromanagement or unrestricted exploration.

================

Option B creates the granular error taxonomy needed to understand recurring false-positive patterns. The existing issue_category field is too broad: a high dismissal rate for style does not reveal whether developers object to single-letter variables, line-length warnings, naming conventions, or something else. Recording the detected construct allows dismissal rates to be grouped by trigger and connected to targeted prompt revisions or project-specific examples.

Anthropic’s evaluation guidance recommends measurable, task-specific criteria and evaluation cases that reflect real production behavior and edge cases. Its structured-output documentation supports schema-constrained, parseable records suitable for this type of downstream analysis.

Option A can help rank findings, but a confidence score does not explain why developers reject them and may be poorly calibrated across issue types. Option C produces more text without adding a stable dimension for aggregation. Option D removes useful category information and makes systematic analysis harder. A normalized detected_pattern field enables dashboards, pattern-level dismissal metrics, representative-example sampling, and controlled evaluations of prompt changes while retaining the broader category for higher-level reporting.

================

Option B correctly separates asynchronous bulk work from latency-sensitive operational work. Anthropic describes the Message Batches API as a cost-effective asynchronous service for high-volume requests that do not require immediate responses. Batch requests are processed independently, normally finish within an hour, may remain pending for up to 24 hours, and are billed at 50 percent of standard API prices. Those characteristics fit standard monthly reports because they are archived after processing and have no immediate business deadline. Urgent exception reports, however, must trigger an alert within 30 minutes. The batch service cannot guarantee that deadline, even if many batches finish quickly; a workload should not use typical completion time as a service-level guarantee. Routing exceptions through the synchronous Messages API provides the real-time response path needed for alerting, while the shared JSON schema keeps downstream records consistent across both routes. Option A knowingly permits delayed alerts. Option C introduces an hourly submission delay before processing even begins. Option D meets latency requirements but wastes the batch discount on non-urgent reports. A routing layer based on document priority therefore satisfies both the cost objective and the business deadline without changing the extraction contract.

================

Option A uses the dedicated configuration mechanism for Anthropic’s managed Code Review service. The official Code Review documentation states that a root-level REVIEW.md is injected into every review agent as the highest-priority instruction block. It can redefine severity, suppress categories already enforced by CI, skip generated paths, and require concrete evidence before particular findings are reported.

The proposed rules map directly to the observed noise. Skipping lint and formatting findings eliminates duplication with deterministic CI checks. Excluding src/gen/* prevents comments on machine-generated code. Requiring a specific source line demonstrating incorrect behavior raises the verification threshold for rendering-helper findings without suppressing genuine defects.

Options B and C configure self-hosted GitHub Actions workflows, but the scenario concerns managed Code Review running through the Claude GitHub App on Anthropic’s infrastructure. Those workflow prompts do not govern the managed reviewer. Option D supplies useful general project context, but CLAUDE.md applies to all Claude Code tasks and has lower review-specific authority. The documentation states that REVIEW.md is the stronger control for changing what managed Code Review flags and how findings are reported. It therefore provides the most targeted solution with the least unnecessary infrastructure.

================

Direct @ references provide Claude with the exact implementations it must imitate. Anthropic documents that referencing a file with @ includes the full file content in the conversation, and multiple files can be referenced in one message. This gives Claude immediate access to the real transaction boundaries, exception structures, audit fields, naming conventions, and helper APIs used by the project. ( https://code.claude.com/docs/en/common-workflows )

Option B is inappropriate because the task is explicitly one-off and the conventions are already documented elsewhere. CLAUDE.md is loaded into every session and should contain concise information that broadly applies to the project. Adding detailed implementation material for a single integration would consume context unnecessarily. Anthropic recommends moving occasional procedures to skills and keeping CLAUDE.md limited to persistent, widely applicable guidance. ( https://code.claude.com/docs/en/memory )

Option C loses precision because a natural-language summary may omit subtle but important code behavior. Option D asks Claude to rediscover files that have already been identified, increasing exploration time and context usage.

The most effective prompt should reference all three modules, identify which pattern each demonstrates, specify the new module’s required behavior, and request focused tests proving that the established conventions were followed.

Official references/topics: @ file references, rich prompt context, CLAUDE.md scope, pattern-based implementation.

Stratified random sampling provides both an ongoing quality-control mechanism and an unbiased measurement framework. By reviewing a fixed proportion of high-confidence outputs across meaningful strata—such as document type, field, source format, and business risk—the organization can estimate the residual error rate, compare performance across releases, and discover failure patterns that were not anticipated when existing rules were designed.

Anthropic recommends measurable success criteria and evaluations that mirror the real-world task distribution, including edge cases. Evaluation volume and repeatability are important because improvements must be demonstrated empirically rather than inferred from isolated examples. ( https://docs.anthropic.com/en/docs/build-with-claude/develop-tests ) A weekly sampling program creates a stable benchmark and allows confidence intervals, trend analysis, regression detection, and error-taxonomy updates.

Option A detects only disagreements between stochastic extractions. Two attempts may produce the same plausible but incorrect answer, so agreement is not equivalent to factual correctness. Option B addresses known patterns but will miss new failure modes and may generate excessive false positives. Option C actually lowers the review threshold in the wrong direction: documents between 70% and 85% would be treated as automated rather than reviewed if the routing rule remains “below threshold,” and changing thresholds alone does not measure high-confidence error prevalence.

Official references/topics: Evaluation Design; Representative Test Distributions; Continuous Reliability Measurement; Human-in-the-Loop Sampling.

In the standard Claude tool-use loop, the application executes lookup_order and sends its output back as a tool_result . That result becomes part of the conversation state available to Claude. Claude then evaluates the purchase date, refund policy, customer request, authorization constraints, and available tools before selecting the next action.

Anthropic describes client-tool orchestration as a repeated loop: Claude emits a tool_use request, the application executes it, returns a tool_result , and Claude continues reasoning from the updated conversation. Claude, rather than the tool implementation, selects when and how to invoke the next available tool unless the application has explicitly implemented a fixed workflow. ( https://platform.claude.com/docs/en/agents-and-tools/tool-use/how-tool-use-works )

Options B and C describe possible custom orchestration architectures, but neither is stated in the scenario. Option D is inconsistent with adaptive agent behavior because later actions depend on information that did not exist before lookup_order completed. A rigid sequence would not respond appropriately to different purchase dates, eligibility states, or order conditions.

The tool result should return high-signal fields such as purchase date, return-window status, refund eligibility, existing refund status, and stable order identifiers so Claude can make the subsequent decision accurately.

Official references/topics: Tool-result continuation, adaptive agent loops, model-directed tool selection, sequential dependency handling.