Skip to content

fix:provider agnostic client - #7

Open
ju3ouz4n wants to merge 1 commit into
devfrom
fix/llm_client_provides_compatibility
Open

fix:provider agnostic client#7
ju3ouz4n wants to merge 1 commit into
devfrom
fix/llm_client_provides_compatibility

Conversation

@ju3ouz4n

Copy link
Copy Markdown
Collaborator

Summary

Centralizes Agora’s OpenAI-compatible chat access behind a provider-aware wrapper so summary ingestion works with OpenAI while preserving Ollama reasoning support.
Closes #
## Changes
Added the shared chat adapter in agora/llm/, including provider filtering, token limits, retries, streaming, and TLS configuration.
Updated agora/cli/ingest.py to construct the shared ChatClient with the existing summary timeout and retry policy.
Removed direct OpenAI SDK construction and RemoteOpenAIChatClient from agora/summary.py.
Consolidated client tests in agora/tests/test_llm_client.py, removed obsolete summary-client tests, and documented the adapter in ARCHITECTURE.md.

How to test

pytest agora/tests -q
Screenshots (if UI changes)
N/A — CLI pipeline, no UI changes.

## Checklist

Tests added/updated

Documentation updated

No secrets in commits or logs

Backward compatibility considered (breaking: RemoteOpenAIChatClient was removed; use ChatClient)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant