Question 610An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. What is the most appropriate first change for this situation? For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Build edge-case evaluation and safe escalation paths for unsupported situations. For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. ExplanationCorrect Answer B:Build edge-case evaluation and safe escalation paths for unsupported situations. It responds to the concrete requirement because Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. Success should be checked by this evidence: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Other Answers A:For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A travel advisory bot invents opening hours when its retrieved documents contain no such information. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. C:For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. That is targeted at a different problem: A supply-chain model's answer quality falls after product identifiers and source formats change. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. D:Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations.
Question 611An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. What underlying distinction matters most to this decision? Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. For the assessed business case: Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. A language model can produce plausible but unsupported statements, commonly called hallucinations. ExplanationCorrect Answer A:Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. That distinction explains why the targeted response is: Build edge-case evaluation and safe escalation paths for unsupported situations. The relevant verification is: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Other Answers B:Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. That mechanism concerns the different case where A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. C:For the assessed business case: Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where An enterprise adopts an automatic foundation-model update without recording changes in safety metrics. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. D:A language model can produce plausible but unsupported statements, commonly called hallucinations. That mechanism concerns the different case where A support assistant cites a fabricated warranty clause that does not appear in any approved source. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases.
Question 612An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. Which pilot result most directly validates the proposed remedy? For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. ExplanationCorrect Answer C:Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Build edge-case evaluation and safe escalation paths for unsupported situations. Other Answers A:For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. This could validate a separate initiative: A loan-support chatbot gives systematically different explanations to equivalent customers with different names. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. B:For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A legal drafting system wants to send high-impact filings directly to regulators without human review. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. D:For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. This could validate a separate initiative: A travel advisory bot invents opening hours when its retrieved documents contain no such information. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions.
Question 613An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. Which control should the team add to its repeatable operating process? For the assessed business case: Include fairness tests and representative data reviews in every major release. For the assessed business case: Set measurable drift alerts and documented investigation owners. Maintain a curated edge-case regression suite from real incident patterns. For the assessed business case: Train teams on injection testing and isolate external context from tool policy. ExplanationCorrect Answer C:Maintain a curated edge-case regression suite from real incident patterns. This control addresses recurrence of the specific failure because Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. It supports the action: Build edge-case evaluation and safe escalation paths for unsupported situations. Other Answers A:For the assessed business case: Include fairness tests and representative data reviews in every major release. This safeguard targets another exposure: A loan-support chatbot gives systematically different explanations to equivalent customers with different names. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns. B:For the assessed business case: Set measurable drift alerts and documented investigation owners. This safeguard targets another exposure: A supply-chain model's answer quality falls after product identifiers and source formats change. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns. D:For the assessed business case: Train teams on injection testing and isolate external context from tool policy. This safeguard targets another exposure: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns.
Question 614A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. What is the most appropriate first change for this situation? For the assessed business case: Build edge-case evaluation and safe escalation paths for unsupported situations. Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. ExplanationCorrect Answer A:For the assessed business case: Build edge-case evaluation and safe escalation paths for unsupported situations. It responds to the concrete requirement because Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. Success should be checked by this evidence: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Other Answers B:Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. C:For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. That is targeted at a different problem: A finance bot confidently repeats pre-merger organization details after ownership has changed. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. D:For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. That is targeted at a different problem: A supply-chain model's answer quality falls after product identifiers and source formats change. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations.
Question 615A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. Which principle best explains why the right approach fits this case? Production inputs and evidence distributions change over time even if the model binary stays constant. Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. A language model can produce plausible but unsupported statements, commonly called hallucinations. For the assessed business case: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. ExplanationCorrect Answer D:For the assessed business case: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. That distinction explains why the targeted response is: Build edge-case evaluation and safe escalation paths for unsupported situations. The relevant verification is: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Other Answers A:Production inputs and evidence distributions change over time even if the model binary stays constant. That mechanism concerns the different case where A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. B:Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where A model upgrade improves writing fluency but unexpectedly increases unsupported claims. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. C:A language model can produce plausible but unsupported statements, commonly called hallucinations. That mechanism concerns the different case where A support assistant cites a fabricated warranty clause that does not appear in any approved source. It does not best explain the present requirement. Here: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases.
Question 616A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. Which pilot result most directly validates the proposed remedy? For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. ExplanationCorrect Answer A:For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Build edge-case evaluation and safe escalation paths for unsupported situations. Other Answers B:For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. This could validate a separate initiative: A loan-support chatbot gives systematically different explanations to equivalent customers with different names. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. C:Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. This could validate a separate initiative: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. D:For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A legal drafting system wants to send high-impact filings directly to regulators without human review. It cannot establish the requested result in this case, which should be tested by: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions.
Question 617A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. Which ongoing safeguard would best reduce this risk in future initiatives? Version deployments and require explicit promotion and rollback thresholds. For the assessed business case: Maintain a curated edge-case regression suite from real incident patterns. For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. For the assessed business case: Train teams on injection testing and isolate external context from tool policy. ExplanationCorrect Answer B:For the assessed business case: Maintain a curated edge-case regression suite from real incident patterns. This control addresses recurrence of the specific failure because Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. It supports the action: Build edge-case evaluation and safe escalation paths for unsupported situations. Other Answers A:Version deployments and require explicit promotion and rollback thresholds. This safeguard targets another exposure: A model upgrade improves writing fluency but unexpectedly increases unsupported claims. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns. C:For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This safeguard targets another exposure: A finance bot confidently repeats pre-merger organization details after ownership has changed. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns. D:For the assessed business case: Train teams on injection testing and isolate external context from tool policy. This safeguard targets another exposure: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. The priority in the current case is: Maintain a curated edge-case regression suite from real incident patterns.
Question 618A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. Which action should the business and technical teams prioritize for this specific requirement? Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. ExplanationCorrect Answer D:Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. It responds to the concrete requirement because Prompt injection attempts to turn lower-trust content into instructions with higher privilege. Success should be checked by this evidence: Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. Other Answers A:Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. That is targeted at a different problem: A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. In this case the decisive distinction is that Prompt injection attempts to turn lower-trust content into instructions with higher privilege. The direct response here is: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. B:Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A support assistant cites a fabricated warranty clause that does not appear in any approved source. In this case the decisive distinction is that Prompt injection attempts to turn lower-trust content into instructions with higher privilege. The direct response here is: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. C:Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. That is targeted at a different problem: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. In this case the decisive distinction is that Prompt injection attempts to turn lower-trust content into instructions with higher privilege. The direct response here is: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code.
Question 619A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. Which principle best explains why the right approach fits this case? For the assessed business case: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. For the assessed business case: Production inputs and evidence distributions change over time even if the model binary stays constant. For the assessed business case: Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. Prompt injection attempts to turn lower-trust content into instructions with higher privilege. ExplanationCorrect Answer D:Prompt injection attempts to turn lower-trust content into instructions with higher privilege. That distinction explains why the targeted response is: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. The relevant verification is: Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. Other Answers A:For the assessed business case: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. That mechanism concerns the different case where A finance bot confidently repeats pre-merger organization details after ownership has changed. It does not best explain the present requirement. Here: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. B:For the assessed business case: Production inputs and evidence distributions change over time even if the model binary stays constant. That mechanism concerns the different case where A supply-chain model's answer quality falls after product identifiers and source formats change. It does not best explain the present requirement. Here: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. C:For the assessed business case: Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. That mechanism concerns the different case where A legal drafting system wants to send high-impact filings directly to regulators without human review. It does not best explain the present requirement. Here: Prompt injection attempts to turn lower-trust content into instructions with higher privilege.
Question 620A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. Which test would provide the most relevant acceptance evidence? Replay a fixed golden test set and examine quality and safety regressions by category. Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. ExplanationCorrect Answer B:Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. Other Answers A:Replay a fixed golden test set and examine quality and safety regressions by category. This could validate a separate initiative: A model upgrade improves writing fluency but unexpectedly increases unsupported claims. It cannot establish the requested result in this case, which should be tested by: Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. C:Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. It cannot establish the requested result in this case, which should be tested by: Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. D:For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. This could validate a separate initiative: A travel advisory bot invents opening hours when its retrieved documents contain no such information. It cannot establish the requested result in this case, which should be tested by: Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs.