Question 160
The support ticket describes this behavior: A model supplies a negative quantity to an order placement tool even though the schema expects an allowed positive amount. Which engineering change should come first?
- Reject invalid parameters with application-side validation before the business API call
- Propagate cancellation to the model request and close the stream on disconnect
- Configure a credential chain using the workload identity and least-privilege role grants
- Adjust chunk boundaries and limited overlap, then rebuild affected embeddings
Explanation
Correct Answer
A:The fault signal is that a model supplies a negative quantity to an order placement tool even though the schema expects an allowed positive amount; the targeted fix works because tool schemas guide argument shape, but the application must check types, constraints, identity and authorization before execution, restoring the ability to prevent malformed model-generated parameters from reaching a write-capable API.
Incorrect Answers
B:If the failing function were to show partial assistant output to a user while stopping work after the request is canceled, this change could be relevant because streaming delivers incremental output; cancellation and backpressure prevent orphaned inference work and stale interface content; the actual symptom is that a model supplies a negative quantity to an order placement tool even though the schema expects an allowed positive amount, which calls for a different repair.
C:If the failing function were to authenticate a server-side generative app through Entra where supported, this change could be relevant because a workload identity and appropriate RBAC reduce static credential exposure while preserving auditable authorization decisions; the actual symptom is that a model supplies a negative quantity to an order placement tool even though the schema expects an allowed positive amount, which calls for a different repair.
D:If the failing function were to keep context that crosses page or section boundaries from being lost during indexing, this change could be relevant because chunk overlap can retain nearby context across splits, although excessive overlap inflates index size and duplicates retrieval; the actual symptom is that a model supplies a negative quantity to an order placement tool even though the schema expects an allowed positive amount, which calls for a different repair.
Question 161
In an architecture review, the key requirement is to keep context that crosses page or section boundaries from being lost during indexing. Which solution directly satisfies it?
- Use chunk overlap for boundary-spanning facts
- Apply retrieval metadata filters before generation
- Implement fallback when retrieval is insufficient
- Use comparative evaluations for prompt changes
Explanation
Correct Answer
A:For the stated requirement to keep context that crosses page or section boundaries from being lost during indexing, chunk overlap can retain nearby context across splits, although excessive overlap inflates index size and duplicates retrieval; this is the mechanism that the system must implement.
Incorrect Answers
B:For a system whose objective is to ensure answers include only documents for a user's department and effective policy year, retrieval filters narrow the evidence set by structured attributes before the model sees it; prompt instructions are not security filters; this does not directly meet the required outcome to keep context that crosses page or section boundaries from being lost during indexing.
C:For a system whose objective is to avoid fabricating an answer to a question not covered by the organization's knowledge collection, an evidence threshold and abstention path distinguish unknown facts from model completion skill; confident text is not proof of source support; this does not directly meet the required outcome to keep context that crosses page or section boundaries from being lost during indexing.
D:For a system whose objective is to choose between candidate prompt versions by measured task quality rather than intuition, paired evaluation on identical cases isolates prompt impact; production traffic shifts make uncontrolled comparisons misleading; this does not directly meet the required outcome to keep context that crosses page or section boundaries from being lost during indexing.
Question 162
Stakeholders want a customer-facing AI service able to avoid fabricating an answer to a question not covered by the organization's knowledge collection. Which choice implements that requirement?
- Resolve deployment and endpoint from runtime configuration
- Implement fallback when retrieval is insufficient
- Use chunk overlap for boundary-spanning facts
- Use passage-level citations in RAG answers
Explanation
Correct Answer
B:For the stated requirement to avoid fabricating an answer to a question not covered by the organization's knowledge collection, an evidence threshold and abstention path distinguish unknown facts from model completion skill; confident text is not proof of source support; this is the mechanism that the system must implement.
Incorrect Answers
A:For a system whose objective is to avoid routing production questions to a test model through hardcoded SDK settings, endpoint and deployment identifiers are environment-specific; runtime configuration keeps inference calls aligned to the project; this does not directly meet the required outcome to avoid fabricating an answer to a question not covered by the organization's knowledge collection.
C:For a system whose objective is to keep context that crosses page or section boundaries from being lost during indexing, chunk overlap can retain nearby context across splits, although excessive overlap inflates index size and duplicates retrieval; this does not directly meet the required outcome to avoid fabricating an answer to a question not covered by the organization's knowledge collection.
D:For a system whose objective is to let a compliance reviewer locate the specific evidence supporting each generated assertion, citations tied to retrieved chunks improve traceability; a source list without claim alignment does not prove each claim; this does not directly meet the required outcome to avoid fabricating an answer to a question not covered by the organization's knowledge collection.
Question 163
The engineering change request is to validate tool arguments before invoking actions. What is the most direct acceptance criterion?
- Verify multi-hop task completion and loop termination under adversarial inputs
- Test boundary values and confirm no rejected argument causes a side effect
- Measure cancellation propagation and discarded tokens after client disconnects
- Prove the app can generate responses after removing the static key from configuration
Explanation
Correct Answer
B:The accepted change is to validate tool arguments before invoking actions; this evaluation checks whether it can prevent malformed model-generated parameters from reaching a write-capable API, since tool schemas guide argument shape, but the application must check types, constraints, identity and authorization before execution.
Incorrect Answers
A:This test concerns the ability to allow a model to request multiple independent data lookups while limiting cost and duration, for which an orchestration loop can inspect tool requests, execute authorized tools, return results, and terminate under explicit limits; it does not establish whether the change to validate tool arguments before invoking actions works for the current release.
C:This test concerns the ability to show partial assistant output to a user while stopping work after the request is canceled, for which streaming delivers incremental output; cancellation and backpressure prevent orphaned inference work and stale interface content; it does not establish whether the change to validate tool arguments before invoking actions works for the current release.
D:This test concerns the ability to authenticate a server-side generative app through Entra where supported, for which a workload identity and appropriate RBAC reduce static credential exposure while preserving auditable authorization decisions; it does not establish whether the change to validate tool arguments before invoking actions works for the current release.
Question 164
In an architecture review, the key requirement is to avoid routing production questions to a test model through hardcoded SDK settings. Which solution directly satisfies it?
- Use token-based credentials rather than embedded keys
- Resolve deployment and endpoint from runtime configuration
- Validate tool arguments before invoking actions
- Use function calling for external calculations
Explanation
Correct Answer
B:For the stated requirement to avoid routing production questions to a test model through hardcoded SDK settings, endpoint and deployment identifiers are environment-specific; runtime configuration keeps inference calls aligned to the project; this is the mechanism that the system must implement.
Incorrect Answers
A:For a system whose objective is to authenticate a server-side generative app through Entra where supported, a workload identity and appropriate RBAC reduce static credential exposure while preserving auditable authorization decisions; this does not directly meet the required outcome to avoid routing production questions to a test model through hardcoded SDK settings.
C:For a system whose objective is to prevent malformed model-generated parameters from reaching a write-capable API, tool schemas guide argument shape, but the application must check types, constraints, identity and authorization before execution; this does not directly meet the required outcome to avoid routing production questions to a test model through hardcoded SDK settings.
D:For a system whose objective is to obtain exact tax or pricing totals from an authoritative business calculation endpoint, a tool call delegates deterministic computation to trusted code instead of relying on a model's arithmetic approximation; this does not directly meet the required outcome to avoid routing production questions to a test model through hardcoded SDK settings.
Question 165
A system now includes a component to use passage-level citations in RAG answers. Which evaluation should accompany the rollout?
- Check claim-to-citation accuracy on questions with several similar policy sections
- Trace required step ordering and block completions that omit a mandatory stage
- Prove the app can generate responses after removing the static key from configuration
- Test for cross-department leakage and expired-document citation rate
- Measure unsupported-answer rate and correct abstentions on out-of-scope questions
Explanation
Correct Answer
A:The accepted change is to use passage-level citations in RAG answers; this evaluation checks whether it can let a compliance reviewer locate the specific evidence supporting each generated assertion, since citations tied to retrieved chunks improve traceability; a source list without claim alignment does not prove each claim.
Incorrect Answers
B:This test concerns the ability to execute a known approval workflow where inputs must be validated before a model drafts a response, for which explicit workflow stages make ordering and failure handling reproducible; free-form agent planning is unnecessary for a fixed process; it does not establish whether the change to use passage-level citations in RAG answers works for the current release.
C:This test concerns the ability to authenticate a server-side generative app through Entra where supported, for which a workload identity and appropriate RBAC reduce static credential exposure while preserving auditable authorization decisions; it does not establish whether the change to use passage-level citations in RAG answers works for the current release.
D:This test concerns the ability to ensure answers include only documents for a user's department and effective policy year, for which retrieval filters narrow the evidence set by structured attributes before the model sees it; prompt instructions are not security filters; it does not establish whether the change to use passage-level citations in RAG answers works for the current release.
E:This test concerns the ability to avoid fabricating an answer to a question not covered by the organization's knowledge collection, for which an evidence threshold and abstention path distinguish unknown facts from model completion skill; confident text is not proof of source support; it does not establish whether the change to use passage-level citations in RAG answers works for the current release.
Question 166
The team plans to use chunk overlap for boundary-spanning facts. Which test provides the clearest evidence that this change works?
- Compare calculated totals with independently tested business-rule outputs
- Check claim-to-citation accuracy on questions with several similar policy sections
- Test retrieval of examples whose supporting clauses straddle chunk boundaries
- Measure unsupported-answer rate and correct abstentions on out-of-scope questions
Explanation
Correct Answer
C:The accepted change is to use chunk overlap for boundary-spanning facts; this evaluation checks whether it can keep context that crosses page or section boundaries from being lost during indexing, since chunk overlap can retain nearby context across splits, although excessive overlap inflates index size and duplicates retrieval.
Incorrect Answers
A:This test concerns the ability to obtain exact tax or pricing totals from an authoritative business calculation endpoint, for which a tool call delegates deterministic computation to trusted code instead of relying on a model's arithmetic approximation; it does not establish whether the change to use chunk overlap for boundary-spanning facts works for the current release.
B:This test concerns the ability to let a compliance reviewer locate the specific evidence supporting each generated assertion, for which citations tied to retrieved chunks improve traceability; a source list without claim alignment does not prove each claim; it does not establish whether the change to use chunk overlap for boundary-spanning facts works for the current release.
D:This test concerns the ability to avoid fabricating an answer to a question not covered by the organization's knowledge collection, for which an evidence threshold and abstention path distinguish unknown facts from model completion skill; confident text is not proof of source support; it does not establish whether the change to use chunk overlap for boundary-spanning facts works for the current release.
Question 167
A cloud engineering team needs its AI workflow to choose between candidate prompt versions by measured task quality rather than intuition. What technical approach most directly enables that?
- Measure factual faithfulness to source context
- Route conditional branches using rules
- Test application robustness on malformed inputs
- Use comparative evaluations for prompt changes
Explanation
Correct Answer
D:For the stated requirement to choose between candidate prompt versions by measured task quality rather than intuition, paired evaluation on identical cases isolates prompt impact; production traffic shifts make uncontrolled comparisons misleading; this is the mechanism that the system must implement.
Incorrect Answers
A:For a system whose objective is to catch plausible statements that are not substantiated by the retrieved evidence, faithfulness checks whether generated claims follow provided source material, not whether wording is eloquent; this does not directly meet the required outcome to choose between candidate prompt versions by measured task quality rather than intuition.
B:For a system whose objective is to choose among distinct business flows based on a validated account status, rules engines offer predictable decisions for simple structured conditions, while language models handle unstructured interpretation; this does not directly meet the required outcome to choose between candidate prompt versions by measured task quality rather than intuition.
C:For a system whose objective is to verify that an app recovers safely from empty messages, long context, and invalid tool responses, boundary-case testing surfaces parsing and orchestration failures that standard benchmark prompts miss; this does not directly meet the required outcome to choose between candidate prompt versions by measured task quality rather than intuition.
Question 168
Engineers have implemented a change to route conditional branches using rules. What validation would expose a remaining defect?
- Compare branch decisions against a complete table of allowed status transitions
- Compare critical-path latency and result consistency with serial execution
- Verify multi-hop task completion and loop termination under adversarial inputs
- Compare win rate, task accuracy, and safety failures with statistical uncertainty
Explanation
Correct Answer
A:The accepted change is to route conditional branches using rules; this evaluation checks whether it can choose among distinct business flows based on a validated account status, since rules engines offer predictable decisions for simple structured conditions, while language models handle unstructured interpretation.
Incorrect Answers
B:This test concerns the ability to reduce latency when separate read-only lookups have no ordering dependency, for which parallelizing independent operations shortens critical-path latency but is unsafe when one action requires another's output; it does not establish whether the change to route conditional branches using rules works for the current release.
C:This test concerns the ability to allow a model to request multiple independent data lookups while limiting cost and duration, for which an orchestration loop can inspect tool requests, execute authorized tools, return results, and terminate under explicit limits; it does not establish whether the change to route conditional branches using rules works for the current release.
D:This test concerns the ability to choose between candidate prompt versions by measured task quality rather than intuition, for which paired evaluation on identical cases isolates prompt impact; production traffic shifts make uncontrolled comparisons misleading; it does not establish whether the change to route conditional branches using rules works for the current release.
Question 169
A release reviewer is assessing a feature intended to use constrained structured JSON output. Which test is most meaningful?
- Test boundary values and confirm no rejected argument causes a side effect
- Compare calculated totals with independently tested business-rule outputs
- Validate required fields, types, parse success and rejected malformed payloads
- Measure answer support and document freshness on questions with recently revised policies
Explanation
Correct Answer
C:The accepted change is to use constrained structured JSON output; this evaluation checks whether it can send model-produced classifications into a strict downstream API contract, since schema-constrained generation helps enforce machine-readable fields and types; application-level validation is still needed for business rules.
Incorrect Answers
A:This test concerns the ability to prevent malformed model-generated parameters from reaching a write-capable API, for which tool schemas guide argument shape, but the application must check types, constraints, identity and authorization before execution; it does not establish whether the change to use constrained structured JSON output works for the current release.
B:This test concerns the ability to obtain exact tax or pricing totals from an authoritative business calculation endpoint, for which a tool call delegates deterministic computation to trusted code instead of relying on a model's arithmetic approximation; it does not establish whether the change to use constrained structured JSON output works for the current release.
D:This test concerns the ability to answer questions about changing internal procedures with source-backed responses, for which RAG retrieves relevant evidence at runtime and gives it to a generative model; model pretraining alone cannot guarantee current policy text; it does not establish whether the change to use constrained structured JSON output works for the current release.
Question 170
A cloud engineering team must answer questions about changing internal procedures with source-backed responses. What is the most appropriate Azure AI implementation?
- Use a multimodal request for document-plus-image reasoning
- Use grounded retrieval-augmented generation
- Route conditional branches using rules
- Use constrained structured JSON output
Explanation
Correct Answer
B:For the stated requirement to answer questions about changing internal procedures with source-backed responses, RAG retrieves relevant evidence at runtime and gives it to a generative model; model pretraining alone cannot guarantee current policy text; this is the mechanism that the system must implement.
Incorrect Answers
A:For a system whose objective is to reason about a photo and related user instructions together in one supported inference flow, a multimodal model can interpret visual input alongside textual context; relying on OCR alone loses non-textual relationships; this does not directly meet the required outcome to answer questions about changing internal procedures with source-backed responses.
C:For a system whose objective is to choose among distinct business flows based on a validated account status, rules engines offer predictable decisions for simple structured conditions, while language models handle unstructured interpretation; this does not directly meet the required outcome to answer questions about changing internal procedures with source-backed responses.
D:For a system whose objective is to send model-produced classifications into a strict downstream API contract, schema-constrained generation helps enforce machine-readable fields and types; application-level validation is still needed for business rules; this does not directly meet the required outcome to answer questions about changing internal procedures with source-backed responses.