Skip to content

[azure-ai-evaluation] Fix broken README/migration code samples, typos, and stale links#48122

Open
kkchandi wants to merge 4 commits into
Azure:mainfrom
kkchandi:docs-azure-ai-evaluation-fixes
Open

[azure-ai-evaluation] Fix broken README/migration code samples, typos, and stale links#48122
kkchandi wants to merge 4 commits into
Azure:mainfrom
kkchandi:docs-azure-ai-evaluation-fixes

Conversation

@kkchandi

Copy link
Copy Markdown

Documentation-only fixes in the azure-ai-evaluation package. No code or behavior changes.

README.md

  • Call the instantiated BleuScoreEvaluator (bleu_score_evaluator(...)) instead of an undefined bleu_score(...) (NameError).
  • Blocklist example: use the declared response parameter instead of the undefined answer.
  • Add missing dict/argument separators (commas) so the dataset and target evaluation examples parse.
  • Align simulator env vars with the canonical sample (AZURE_OPENAI_ENDPOINT / AZURE_OPENAI_KEY / AZURE_OPENAI_DEPLOYMENT).
  • Standardize the Azure OpenAI key env var to AZURE_OPENAI_KEY.
  • Fix typos: synthentic -> synthetic, intergration -> integration.
  • Replace stale learn.microsoft.com/azure/ai-studio/... links with current foundry/foundry-classic paths.

migration_guide.md

  • Close the ContentSafetyEvaluator(...) call (missing )), which was a SyntaxError.

TROUBLESHOOTING.md

  • Update obsolete "Azure AI Studio hub" terminology to "Azure AI Foundry hub".

kkchandi and others added 3 commits July 17, 2026 15:56
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 77e272d0-4d0f-42cf-b18b-50a5ab5b60e5
…guide

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 77e272d0-4d0f-42cf-b18b-50a5ab5b60e5
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 77e272d0-4d0f-42cf-b18b-50a5ab5b60e5
Copilot AI review requested due to automatic review settings July 17, 2026 22:56
@kkchandi
kkchandi requested a review from a team as a code owner July 17, 2026 22:56
@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).
9 pipeline(s) were filtered out due to trigger conditions.
There may be pipelines that require an authorized user to comment /azp run to run.

@github-actions github-actions Bot added the Evaluation Issues related to the client library for Azure AI Evaluation label Jul 17, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Fixes broken documentation samples, typos, environment variables, links, and terminology in azure-ai-evaluation.

Changes:

  • Corrects README sample syntax and variables.
  • Updates documentation links and wording.
  • Fixes a migration-guide syntax error.

Reviewed changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.

File Description
README.md Repairs samples, typos, environment variables, and links.
migration_guide.md Closes an evaluator call.
TROUBLESHOOTING.md Updates hub terminology, but needs current branding.

- Before running `evaluate()`, to ensure that you can enable logging and tracing to your Azure AI project, make sure you are first logged in by running `az login`.

- Ensure that you assign the proper permissions to the storage account linked to your Azure AI Studio hub. This can be done with the following command. More information can be found [here](https://aka.ms/credentialleshub).
- Ensure that you assign the proper permissions to the storage account linked to your Azure AI Foundry hub. This can be done with the following command. More information can be found [here](https://aka.ms/credentialleshub).
```Shell
# <mySubscriptionID>: Subscription ID of the Azure AI Studio hub's linked storage account (available in Azure AI hub resource view in Azure Portal).
# <myResourceGroupName>: Resource group of the Azure AI Studio hub's linked storage account.
# <mySubscriptionID>: Subscription ID of the Azure AI Foundry hub's linked storage account (available in Azure AI hub resource view in Azure Portal).
Comment thread sdk/evaluation/azure-ai-evaluation/TROUBLESHOOTING.md Outdated
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings July 17, 2026 23:04

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

Comments suppressed due to low confidence (2)

sdk/evaluation/azure-ai-evaluation/TROUBLESHOOTING.md:31

  • This introduces the previous product name rather than the current Microsoft Foundry branding. Current Microsoft Learn classic-hub documentation calls this a “Microsoft Foundry hub,” which line 35 already uses; please keep the terminology consistent.
- Ensure that you assign the proper permissions to the storage account linked to your Azure AI Foundry hub. This can be done with the following command. More information can be found [here](https://aka.ms/credentialleshub).

sdk/evaluation/azure-ai-evaluation/TROUBLESHOOTING.md:34

  • This second occurrence also retains the superseded “Azure AI Foundry” name while the adjacent comment uses the current “Microsoft Foundry” branding. Use one current product name throughout this command description.
    # <mySubscriptionID>: Subscription ID of the Azure AI Foundry hub's linked storage account (available in Azure AI hub resource view in Azure Portal).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Evaluation Issues related to the client library for Azure AI Evaluation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants