Anthropic CCDV-F (Claude Certified Developer - Foundations) Practice Test 24

Question 230

A change simultaneously modifies model, prompt, and retrieval. Quality declines. What helps identify the cause?

  1. Assume the newest model caused every failure.
  2. Controlled comparisons that vary one component while holding the others fixed.
  3. Compare only deployment timestamps.
  4. Revert random lines until the score improves once.

Explanation

Correct Answer

B:

Ablation isolates contributions that a bundled change makes difficult to attribute. Retain comparable inputs and scoring criteria during the investigation so differences can be attributed to the component being varied.

Incorrect Answers

A:

Several variables changed; the evidence does not isolate that conclusion.

C:

Timing identifies correlation, not which changed component caused the regression.

D:

Uncontrolled experimentation can confuse noise with a causal improvement.

Question 231

A provider asks for a failed request identifier during support investigation. Why retain it?

  1. It links application observations to the provider’s corresponding request records.
  2. It guarantees the request succeeded.
  3. It replaces the API credential for future calls.
  4. It automatically restores the conversation history.

Explanation

Correct Answer

A:

Correlation identifiers help locate the exact event without requiring an ambiguous description of the failure.

Incorrect Answers

B:

Failures can also have correlation identifiers.

C:

A request identifier is not an authentication secret.

D:

Tracking an event is different from supplying model context.

Question 232

The raw response contains valid required fields, but the UI shows them missing after a local transformation. What should be tested?

  1. Only the provider’s training corpus.
  2. A larger model without checking application code.
  3. Only a different prompt requesting the same fields.
  4. The transformation and rendering path using the captured response.

Explanation

Correct Answer

D:

The evidence localizes loss after generation, so a targeted replay can test the consumer independently of the model.

Incorrect Answers

A:

Training data does not explain a value removed by local transformation.

B:

Changing inference can leave the same consumer bug intact.

C:

The model already returned them; the demonstrated defect is downstream.

Question 233

Failures increase, but monitoring counts only completed successful generations. What is missing?

  1. Compute availability using successful requests as both numerator and denominator.
  2. Attempt, failure, timeout, and cancellation measurements with appropriate denominators.
  3. Only average answer length.
  4. An assumption that absent records are successes.

Explanation

Correct Answer

B:

Success-only telemetry cannot reveal reliability or distinguish missing work from completed work. Use a denominator that includes attempted work, then classify failures so reliability does not look artificially high by excluding unsuccessful requests.

Incorrect Answers

A:

This definition reports perfect success by construction and excludes the failures the metric is supposed to measure.

C:

Output size does not measure failed or canceled attempts.

D:

Missing evidence cannot establish successful completion.

Question 234

A user includes a new private glossary in one request. What does that ordinarily do?

  1. Replace the model’s tokenizer.
  2. Make the glossary public to all users.
  3. Provide in-context information for that request.
  4. Permanently retrain the shared model immediately.

Explanation

Correct Answer

C:

Supplying context can influence the response without changing the deployed model’s weights or teaching every future conversation.

Incorrect Answers

A:

A supplied glossary does not reconfigure tokenization machinery.

B:

Request inclusion does not establish public distribution.

D:

Ordinary inference input is not automatically a weight-training operation.

Question 235

Why can an early generated assumption influence later sentences in the same response?

  1. Every sentence is generated independently with no previous text.
  2. Earlier output changes the application’s database automatically.
  3. Later generation is conditioned on preceding context, including generated text.
  4. The final sentence always rewrites all earlier tokens.

Explanation

Correct Answer

C:

Generation conditions on the existing sequence, including earlier generated tokens, so an unsupported premise can propagate through later conclusions.

Incorrect Answers

A:

That ignores the sequential context used in language generation.

B:

Text generation alone does not perform arbitrary external mutations.

D:

Streaming generation does not imply automatic retroactive replacement of prior output.

Question 236

A request sets max_tokens to a large value but produces a short complete answer. Is that necessarily an error?

  1. No; the value is an upper generation allowance, not a required length.
  2. Yes; every allowed token must be emitted.
  3. No; the setting controls only input characters.
  4. Yes; unused allowance must appear as blank text.

Explanation

Correct Answer

A:

A model can finish naturally before using its entire permitted output budget. The limit caps output length rather than requiring padding; the completion status and content determine whether the short response fulfilled the task.

Incorrect Answers

B:

An upper bound does not prescribe an exact count.

C:

The parameter concerns generation allowance, not a character limit on input.

D:

There is no requirement to pad a completed answer with unused capacity.

Question 237

A prompt includes five labeled examples. Which learning mechanism is being used during the request?

  1. In-context few-shot guidance.
  2. Retrieval-augmented generation merely because examples appear in the prompt.
  3. A guaranteed permanent fine-tuning job.
  4. A permanent update to the model's trained parameters.

Explanation

Correct Answer

A:

Examples demonstrate the desired mapping within the prompt; this differs from updating model parameters through training.

Incorrect Answers

B:

Providing demonstrations is few-shot prompting; it does not by itself establish a retrieval system supplying external evidence.

C:

Examples in inference context do not automatically trigger parameter updates.

D:

In-context examples influence the current request without performing the parameter updates associated with training.

Question 238

A classifier receives a clear task description and labels but no worked examples. Which prompting setup is this?

  1. Zero-shot prompting.
  2. Tool execution.
  3. Fine-tuning.
  4. Few-shot prompting.

Explanation

Correct Answer

A:

The model uses the stated task and its existing capabilities without a worked input-output demonstration in the current prompt.

Incorrect Answers

B:

Describing a classification task does not by itself invoke an external function.

C:

A task prompt is not a model-parameter training process.

D:

Few-shot guidance includes multiple demonstrations absent from this request.

Question 239

A retrieval pipeline encodes passages as vectors and compares them with a query vector. What role do these embeddings play?

  1. They represent content numerically for similarity-based retrieval.
  2. They automatically update the language model's trained parameters.
  3. They prove that every retrieved passage is factually correct.
  4. They are lossless compressed passages that can always be decoded verbatim.

Explanation

Correct Answer

A:

Vector proximity helps identify potentially relevant passages for later processing. The vectors are not themselves a verified natural-language answer or a record of tool execution.

Incorrect Answers

B:

Creating or comparing external vectors does not by itself perform a training update on the answer model.

C:

Representational proximity concerns retrieval similarity. It does not authenticate the source or validate the truth of its claims.

D:

A retrieval embedding is a numerical representation used for comparisons. It is not a guarantee of reversible storage of the original passage text.

Question 240

A supported sampling configuration is adjusted to encourage more varied wording. What tradeoff should be evaluated?

  1. Whether increased diversity affects consistency on the task.
  2. Whether vocabulary diversity alone is sufficient to prove better task performance.
  3. Whether a single attractive sample proves all outputs satisfy the quality target.
  4. Whether every possible response becomes equally likely regardless of the prompt.

Explanation

Correct Answer

A:

Evaluate diversity against the task's consistency requirements. Variation useful for creative exploration can reduce repeatability in constrained classification or extraction.

Incorrect Answers

B:

More varied wording can coexist with worse accuracy or format compliance, so diversity is not a complete quality measure.

C:

One selected result cannot characterize the broader output distribution or detect failures introduced by increased variation.

D:

Sampling controls alter selection probabilities; they do not erase input conditioning or make the entire response space uniform.

Claude Certified Developer - Foundations (CCDV-F) Practice Tests