Question 590A travel advisory bot invents opening hours when its retrieved documents contain no such information. What is the most appropriate first change for this situation? Build edge-case evaluation and safe escalation paths for unsupported situations. Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. ExplanationCorrect Answer C:For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. It responds to the concrete requirement because A language model can produce plausible but unsupported statements, commonly called hallucinations. Success should be checked by this evidence: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. Other Answers A:Build edge-case evaluation and safe escalation paths for unsupported situations. That is targeted at a different problem: An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. In this case the decisive distinction is that A language model can produce plausible but unsupported statements, commonly called hallucinations. The direct response here is: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. B:Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. That is targeted at a different problem: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. In this case the decisive distinction is that A language model can produce plausible but unsupported statements, commonly called hallucinations. The direct response here is: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. D:For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. That is targeted at a different problem: A supply-chain model's answer quality falls after product identifiers and source formats change. In this case the decisive distinction is that A language model can produce plausible but unsupported statements, commonly called hallucinations. The direct response here is: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent.
Question 591A travel advisory bot invents opening hours when its retrieved documents contain no such information. Which principle best explains why the right approach fits this case? Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. For the assessed business case: Production inputs and evidence distributions change over time even if the model binary stays constant. For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. ExplanationCorrect Answer C:For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. That distinction explains why the targeted response is: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. The relevant verification is: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. Other Answers A:Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where A model upgrade improves writing fluency but unexpectedly increases unsupported claims. It does not best explain the present requirement. Here: A language model can produce plausible but unsupported statements, commonly called hallucinations. B:For the assessed business case: Production inputs and evidence distributions change over time even if the model binary stays constant. That mechanism concerns the different case where A supply-chain model's answer quality falls after product identifiers and source formats change. It does not best explain the present requirement. Here: A language model can produce plausible but unsupported statements, commonly called hallucinations. D:Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. That mechanism concerns the different case where An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. It does not best explain the present requirement. Here: A language model can produce plausible but unsupported statements, commonly called hallucinations.
Question 592A travel advisory bot invents opening hours when its retrieved documents contain no such information. Which evidence would best demonstrate that the chosen approach is working? For the assessed business case: Compare current performance metrics and retrieval hit rates against stable reference periods. For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. Compare matched cases across cohorts and inspect disparities with qualified reviewers. For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. ExplanationCorrect Answer B:For the assessed business case: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Other Answers A:For the assessed business case: Compare current performance metrics and retrieval hit rates against stable reference periods. This could validate a separate initiative: A supply-chain model's answer quality falls after product identifiers and source formats change. It cannot establish the requested result in this case, which should be tested by: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. C:Compare matched cases across cohorts and inspect disparities with qualified reviewers. This could validate a separate initiative: A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. It cannot establish the requested result in this case, which should be tested by: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. D:For the assessed business case: Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A legal drafting system wants to send high-impact filings directly to regulators without human review. It cannot establish the requested result in this case, which should be tested by: Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts.
Question 593A travel advisory bot invents opening hours when its retrieved documents contain no such information. What governance practice would most directly prevent recurrence? For the assessed business case: Track unsupported-claim rates and review citation failures during operations. Version deployments and require explicit promotion and rollback thresholds. Date and refresh time-sensitive knowledge references and monitor stale-answer reports. Set measurable drift alerts and documented investigation owners. ExplanationCorrect Answer A:For the assessed business case: Track unsupported-claim rates and review citation failures during operations. This control addresses recurrence of the specific failure because A language model can produce plausible but unsupported statements, commonly called hallucinations. It supports the action: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Other Answers B:Version deployments and require explicit promotion and rollback thresholds. This safeguard targets another exposure: A model upgrade improves writing fluency but unexpectedly increases unsupported claims. The priority in the current case is: Track unsupported-claim rates and review citation failures during operations. C:Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This safeguard targets another exposure: A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. The priority in the current case is: Track unsupported-claim rates and review citation failures during operations. D:Set measurable drift alerts and documented investigation owners. This safeguard targets another exposure: A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. The priority in the current case is: Track unsupported-claim rates and review citation failures during operations.
Question 594A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. Which action should the business and technical teams prioritize for this specific requirement? Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Build edge-case evaluation and safe escalation paths for unsupported situations. For the assessed business case: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. ExplanationCorrect Answer B:Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. It responds to the concrete requirement because Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. Success should be checked by this evidence: Query a deliberately changed fact and confirm the latest approved source drives the answer. Other Answers A:Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A support assistant cites a fabricated warranty clause that does not appear in any approved source. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. C:Build edge-case evaluation and safe escalation paths for unsupported situations. That is targeted at a different problem: An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. D:For the assessed business case: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates.
Question 595A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. What underlying distinction matters most to this decision? Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. For the assessed business case: Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. ExplanationCorrect Answer B:Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. That distinction explains why the targeted response is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. The relevant verification is: Query a deliberately changed fact and confirm the latest approved source drives the answer. Other Answers A:Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. That mechanism concerns the different case where A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. C:Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where A model upgrade improves writing fluency but unexpectedly increases unsupported claims. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. D:For the assessed business case: Model outputs may be valuable drafts but lack independent professional accountability for high-stakes consequences. That mechanism concerns the different case where A legal drafting system wants to send high-impact filings directly to regulators without human review. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes.
Question 596A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. Which evidence would best demonstrate that the chosen approach is working? Query a deliberately changed fact and confirm the latest approved source drives the answer. Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. ExplanationCorrect Answer A:Query a deliberately changed fact and confirm the latest approved source drives the answer. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Other Answers B:Pose questions whose answer is absent from the source and verify the assistant expresses uncertainty rather than inventing facts. This could validate a separate initiative: A support assistant cites a fabricated warranty clause that does not appear in any approved source. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. C:For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This could validate a separate initiative: A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. D:Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer.
Question 597A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. What governance practice would most directly prevent recurrence? Set measurable drift alerts and documented investigation owners. Include fairness tests and representative data reviews in every major release. Define risk tiers and human oversight requirements before deploying AI into consequential decisions. Date and refresh time-sensitive knowledge references and monitor stale-answer reports. ExplanationCorrect Answer D:Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This control addresses recurrence of the specific failure because Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. It supports the action: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Other Answers A:Set measurable drift alerts and documented investigation owners. This safeguard targets another exposure: A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. B:Include fairness tests and representative data reviews in every major release. This safeguard targets another exposure: A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. C:Define risk tiers and human oversight requirements before deploying AI into consequential decisions. This safeguard targets another exposure: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports.
Question 598A finance bot confidently repeats pre-merger organization details after ownership has changed. What is the most appropriate first change for this situation? For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. ExplanationCorrect Answer A:For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. It responds to the concrete requirement because Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. Success should be checked by this evidence: Query a deliberately changed fact and confirm the latest approved source drives the answer. Other Answers B:Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. That is targeted at a different problem: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. C:Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. D:Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A support assistant cites a fabricated warranty clause that does not appear in any approved source. In this case the decisive distinction is that Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. The direct response here is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates.
Question 599A finance bot confidently repeats pre-merger organization details after ownership has changed. What underlying distinction matters most to this decision? For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. For the assessed business case: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. For the assessed business case: Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. ExplanationCorrect Answer C:For the assessed business case: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. That distinction explains why the targeted response is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. The relevant verification is: Query a deliberately changed fact and confirm the latest approved source drives the answer. Other Answers A:For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. That mechanism concerns the different case where A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. B:For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. That mechanism concerns the different case where A travel advisory bot invents opening hours when its retrieved documents contain no such information. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. D:For the assessed business case: Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where An enterprise adopts an automatic foundation-model update without recording changes in safety metrics. It does not best explain the present requirement. Here: Model training has a knowledge horizon and does not guarantee awareness of subsequent changes.
Question 600A finance bot confidently repeats pre-merger organization details after ownership has changed. Which test would provide the most relevant acceptance evidence? For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. For the assessed business case: Query a deliberately changed fact and confirm the latest approved source drives the answer. For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. ExplanationCorrect Answer C:For the assessed business case: Query a deliberately changed fact and confirm the latest approved source drives the answer. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Other Answers A:For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This could validate a separate initiative: A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. B:Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. This could validate a separate initiative: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. D:For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. This could validate a separate initiative: A loan-support chatbot gives systematically different explanations to equivalent customers with different names. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer.