Review Set 3 question 7

[Jon984732]

It does not include the correct answer or any explaination.

Question is:

7. Question

Category: AIP – Foundation Model Integration, Data Management, and Compliance

A GenAI developer is building a generative AI platform that automates regulatory summaries and internal compliance reporting. The developer recently fine-tuned a new foundation model in Amazon Bedrock and must determine whether it is suitable to replace the currently deployed production model. As part of the organization’s governance and audit requirements, large volumes of historical evaluation datasets, prompt samples, and model outputs are stored in Amazon S3. To reduce storage costs while maintaining traceability, the organization applies S3 Lifecycle policies to transition older evaluation artifacts into lower-cost storage tiers.

Before promoting the newly fine-tuned foundation model, the company must follow a structured, sequential validation workflow to ensure the model demonstrates measurable improvements over the existing one. This evaluation process requires well-defined performance metrics, curated test datasets, controlled A/B comparisons, and automated quality gates to maintain consistent governance and compliance standards.

Select and order the following items to implement the evaluation workflow. Each step should be selected once or not at all. (Select and order FIVE.)

• Configure Amazon CloudWatch dashboards to visualize model latency and throughput trends for production workloads.
• Assemble a benchmark dataset containing varied prompts, rare scenarios, and regulatory edge cases.
• Review the comparison data, summarize findings, and generate a formal evaluation report with performance conclusions.
• Set up an Amazon SNS notification system to alert teams when model outputs exceed a predefined size threshold.
• Define clear evaluation criteria that measure attributes such as correctness, relevance, and linguistic quality.
• Use AWS Step Functions to enforce automated approval checkpoints before advancing the workflow.
• Run controlled A/B testing to directly compare outputs from the new FM and the current production model.

[Nikee-TutorialsDojo]

Hi Jon,

Thank you for reporting this. The issue you mentioned has already been fixed, and the correct answer, along with the explanation, should now be properly displayed.

Please refresh or reload the practice exam on your end to see the updated content. If you still notice anything missing, feel free to let us know, and we’ll be happy to look into it further.

We appreciate you bringing this to our attention!

Regards,

Nikee @ Tutorials Dojo

[Jon984732]

Hi Nikee,

I do see the correct answers and explanations now, but steps 2 and 3 are still out of order it goes 1,3,2,4,5 which is confusing to test takers so you may want to correct that.

[Nikee-TutorialsDojo]

Hi Jon,

Thank you for checking and for pointing this out. The steps appearing as 1, 3, 2, 4, 5 are expected, as we recently shuffled the options to improve the assessment experience and prevent memorization based on a fixed ordering.

Rest assured, the correct sequence and explanations remain accurate — only the display order of the choices was randomized.

We appreciate your feedback and diligence in reviewing the questions. Please let us know if you notice anything else.

Regards,
Nikee @ Tutorials Dojo