Question 600A finance bot confidently repeats pre-merger organization details after ownership has changed. Which test would provide the most relevant acceptance evidence? For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. For the assessed business case: Query a deliberately changed fact and confirm the latest approved source drives the answer. For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. ExplanationCorrect Answer C:For the assessed business case: Query a deliberately changed fact and confirm the latest approved source drives the answer. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Other Answers A:For the assessed business case: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This could validate a separate initiative: A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. B:Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. This could validate a separate initiative: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer. D:For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. This could validate a separate initiative: A loan-support chatbot gives systematically different explanations to equivalent customers with different names. It cannot establish the requested result in this case, which should be tested by: Query a deliberately changed fact and confirm the latest approved source drives the answer.
Question 601A finance bot confidently repeats pre-merger organization details after ownership has changed. Which ongoing safeguard would best reduce this risk in future initiatives? For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. For the assessed business case: Train teams on injection testing and isolate external context from tool policy. Set measurable drift alerts and documented investigation owners. For the assessed business case: Maintain a curated edge-case regression suite from real incident patterns. ExplanationCorrect Answer A:For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This control addresses recurrence of the specific failure because Model training has a knowledge horizon and does not guarantee awareness of subsequent changes. It supports the action: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. Other Answers B:For the assessed business case: Train teams on injection testing and isolate external context from tool policy. This safeguard targets another exposure: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. C:Set measurable drift alerts and documented investigation owners. This safeguard targets another exposure: A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. D:For the assessed business case: Maintain a curated edge-case regression suite from real incident patterns. This safeguard targets another exposure: A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. The priority in the current case is: Date and refresh time-sensitive knowledge references and monitor stale-answer reports.
Question 602A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. What is the most appropriate first change for this situation? Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. For the assessed business case: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. ExplanationCorrect Answer D:Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. It responds to the concrete requirement because Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. Success should be checked by this evidence: Compare matched cases across cohorts and inspect disparities with qualified reviewers. Other Answers A:Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A support assistant cites a fabricated warranty clause that does not appear in any approved source. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. B:For the assessed business case: Retrieve current verified sources for time-sensitive facts instead of assuming a pretrained cutoff includes updates. That is targeted at a different problem: A finance bot confidently repeats pre-merger organization details after ownership has changed. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. C:For the assessed business case: Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release.
Question 603A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. Which principle best explains why the right approach fits this case? For the assessed business case: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. ExplanationCorrect Answer C:Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. That distinction explains why the targeted response is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. The relevant verification is: Compare matched cases across cohorts and inspect disparities with qualified reviewers. Other Answers A:For the assessed business case: Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. That mechanism concerns the different case where A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. B:For the assessed business case: A language model can produce plausible but unsupported statements, commonly called hallucinations. That mechanism concerns the different case where A travel advisory bot invents opening hours when its retrieved documents contain no such information. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. D:For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. That mechanism concerns the different case where A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral.
Question 604A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. Which test would provide the most relevant acceptance evidence? Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. For the assessed business case: Replay a fixed golden test set and examine quality and safety regressions by category. Compare matched cases across cohorts and inspect disparities with qualified reviewers. ExplanationCorrect Answer D:Compare matched cases across cohorts and inspect disparities with qualified reviewers. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. Other Answers A:Run a controlled approval workflow and confirm no critical action occurs without reviewer signoff. This could validate a separate initiative: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers. B:Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. This could validate a separate initiative: An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers. C:For the assessed business case: Replay a fixed golden test set and examine quality and safety regressions by category. This could validate a separate initiative: An enterprise adopts an automatic foundation-model update without recording changes in safety metrics. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers.
Question 605A hiring summary assistant repeatedly overstates certain groups' qualifications because historical notes were skewed. Which ongoing safeguard would best reduce this risk in future initiatives? For the assessed business case: Version deployments and require explicit promotion and rollback thresholds. For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. Include fairness tests and representative data reviews in every major release. Track unsupported-claim rates and review citation failures during operations. ExplanationCorrect Answer C:Include fairness tests and representative data reviews in every major release. This control addresses recurrence of the specific failure because Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. It supports the action: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. Other Answers A:For the assessed business case: Version deployments and require explicit promotion and rollback thresholds. This safeguard targets another exposure: An enterprise adopts an automatic foundation-model update without recording changes in safety metrics. The priority in the current case is: Include fairness tests and representative data reviews in every major release. B:For the assessed business case: Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This safeguard targets another exposure: A finance bot confidently repeats pre-merger organization details after ownership has changed. The priority in the current case is: Include fairness tests and representative data reviews in every major release. D:Track unsupported-claim rates and review citation failures during operations. This safeguard targets another exposure: A support assistant cites a fabricated warranty clause that does not appear in any approved source. The priority in the current case is: Include fairness tests and representative data reviews in every major release.
Question 606A loan-support chatbot gives systematically different explanations to equivalent customers with different names. Which action should the business and technical teams prioritize for this specific requirement? Compare a pinned baseline and candidate version using factuality, safety and task-success evaluations. For the assessed business case: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. For the assessed business case: Build edge-case evaluation and safe escalation paths for unsupported situations. ExplanationCorrect Answer B:For the assessed business case: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. It responds to the concrete requirement because Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. Success should be checked by this evidence: Compare matched cases across cohorts and inspect disparities with qualified reviewers. Other Answers A:Compare a pinned baseline and candidate version using factuality, safety and task-success evaluations. That is targeted at a different problem: A model upgrade improves writing fluency but unexpectedly increases unsupported claims. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. C:Keep qualified humans in the loop for high-impact decisions and provide sources and uncertainty to reviewers. That is targeted at a different problem: A hospital assistant recommends a treatment schedule from a low-confidence summary with no expert approval. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. D:For the assessed business case: Build edge-case evaluation and safe escalation paths for unsupported situations. That is targeted at a different problem: A purchasing bot cannot handle a new supplier status that never appeared in sample prompts. In this case the decisive distinction is that Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. The direct response here is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release.
Question 607A loan-support chatbot gives systematically different explanations to equivalent customers with different names. Which principle best explains why the right approach fits this case? For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. A language model can produce plausible but unsupported statements, commonly called hallucinations. For the assessed business case: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. ExplanationCorrect Answer C:For the assessed business case: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. That distinction explains why the targeted response is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. The relevant verification is: Compare matched cases across cohorts and inspect disparities with qualified reviewers. Other Answers A:For the assessed business case: Prompt injection attempts to turn lower-trust content into instructions with higher privilege. That mechanism concerns the different case where A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. B:A language model can produce plausible but unsupported statements, commonly called hallucinations. That mechanism concerns the different case where A support assistant cites a fabricated warranty clause that does not appear in any approved source. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. D:Model upgrades can change behavior in multiple dimensions; improvement on one metric does not certify the others. That mechanism concerns the different case where A model upgrade improves writing fluency but unexpectedly increases unsupported claims. It does not best explain the present requirement. Here: Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral.
Question 608A loan-support chatbot gives systematically different explanations to equivalent customers with different names. Which pilot result most directly validates the proposed remedy? Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. For the assessed business case: Replay a fixed golden test set and examine quality and safety regressions by category. Compare current performance metrics and retrieval hit rates against stable reference periods. For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. ExplanationCorrect Answer D:For the assessed business case: Compare matched cases across cohorts and inspect disparities with qualified reviewers. This observation tests the requested outcome directly rather than an unrelated model property. The selected action is: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. Other Answers A:Seed a test document containing an unsafe instruction and confirm that no privileged tool action occurs. This could validate a separate initiative: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers. B:For the assessed business case: Replay a fixed golden test set and examine quality and safety regressions by category. This could validate a separate initiative: An enterprise adopts an automatic foundation-model update without recording changes in safety metrics. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers. C:Compare current performance metrics and retrieval hit rates against stable reference periods. This could validate a separate initiative: A customer assistant gradually loses accuracy as its product catalog and customer behaviors evolve. It cannot establish the requested result in this case, which should be tested by: Compare matched cases across cohorts and inspect disparities with qualified reviewers.
Question 609A loan-support chatbot gives systematically different explanations to equivalent customers with different names. Which ongoing safeguard would best reduce this risk in future initiatives? For the assessed business case: Train teams on injection testing and isolate external context from tool policy. For the assessed business case: Include fairness tests and representative data reviews in every major release. Track unsupported-claim rates and review citation failures during operations. Date and refresh time-sensitive knowledge references and monitor stale-answer reports. ExplanationCorrect Answer B:For the assessed business case: Include fairness tests and representative data reviews in every major release. This control addresses recurrence of the specific failure because Bias in training data and evaluation can yield unfair generated outcomes even when language sounds neutral. It supports the action: Evaluate outputs by relevant demographic cohorts and correct biased data or design choices before release. Other Answers A:For the assessed business case: Train teams on injection testing and isolate external context from tool policy. This safeguard targets another exposure: A document retrieval agent encounters a malicious PDF that asks it to disclose restricted internal instructions. The priority in the current case is: Include fairness tests and representative data reviews in every major release. C:Track unsupported-claim rates and review citation failures during operations. This safeguard targets another exposure: A support assistant cites a fabricated warranty clause that does not appear in any approved source. The priority in the current case is: Include fairness tests and representative data reviews in every major release. D:Date and refresh time-sensitive knowledge references and monitor stale-answer reports. This safeguard targets another exposure: A regulatory analyst expects a model trained last year to know a newly enacted rule automatically. The priority in the current case is: Include fairness tests and representative data reviews in every major release.
Question 610An insurance assistant performs well on routine claims but fails on rare catastrophic exceptions. What is the most appropriate first change for this situation? For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. Build edge-case evaluation and safe escalation paths for unsupported situations. For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. ExplanationCorrect Answer B:Build edge-case evaluation and safe escalation paths for unsupported situations. It responds to the concrete requirement because Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. Success should be checked by this evidence: Test rare and ambiguous situations and verify escalation rather than confident unauthorized decisions. Other Answers A:For the assessed business case: Ground answers in authoritative retrieved evidence and require an explicit unknown response when support is absent. That is targeted at a different problem: A travel advisory bot invents opening hours when its retrieved documents contain no such information. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. C:For the assessed business case: Monitor model and retrieval performance for drift and refresh validated data or configurations when warranted. That is targeted at a different problem: A supply-chain model's answer quality falls after product identifiers and source formats change. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations. D:Treat retrieved and user-provided text as untrusted data and enforce authorizations in application code. That is targeted at a different problem: A sales assistant reads a customer-supplied webpage that tells it to ignore the company's approval process. In this case the decisive distinction is that Limited training or evaluation coverage can make rare inputs behave differently from ordinary cases. The direct response here is: Build edge-case evaluation and safe escalation paths for unsupported situations.