BerriAI/litellm - GitHub vs CoGrader
Side-by-side comparison · Updated October 2026
| Description | LiteLLM is an AI gateway and Python SDK from Berrie AI Incorporated, published in the BerriAI GitHub repository. The SDK provides a common interface for model calls inside Python applications. The proxy gateway centralizes access for a team, with virtual keys, model routing, spend tracking, budgets and an administration interface. The official documentation lists support for more than 100 model providers. Supported endpoints and features vary by integration, so verify your model’s streaming, tool-calling, image, audio or embedding requirements. The router supports retries, fallbacks and load balancing; observability integrations can send request data to tools such as Langfuse, LangSmith and OpenTelemetry. LiteLLM also provides an MCP gateway. It can connect upstream servers using Streamable HTTP, SSE or stdio, expose tools through a fixed gateway endpoint, and scope access by key, team or organization. This requires configuring the upstream servers and authentication; the gateway does not automatically grant access to third-party tools. Agent-to-agent integrations are documented separately. The open-source offering has no software license fee for self-hosting. Code outside the enterprise directory is MIT-licensed, while enterprise code has separate terms. Enterprise pricing is quoted by annual gateway request capacity, deployment architecture and support needs, rather than a per-token license charge. Model-provider charges and infrastructure costs still apply. Enterprise adds controls and support such as SSO, SCIM, audit logs and service-level agreements. Compare New API for another self-hosted gateway with provider-channel management and usage accounting. Evaluate a representative workload, inspect request logging and secret handling, test budget and failure behavior, and decide whether SDK integration or a shared gateway best fits your application. | CoGrader is a teacher-facing AI grading assistant for essays and other open-ended assignments. It uses a selected or custom rubric to draft grades and feedback that educators can review and edit before returning work. Its useful role is helping a teacher organize assessment and feedback; it does not establish that a grade is correct, unbiased or suitable for a particular student without human review. The free Starter plan includes 100 student submissions per month and rubric creation and sharing. The pricing page also advertises 90 days of premium access, which is a temporary benefit rather than unlimited free access to paid features. Standard includes 350 submissions per month, handwritten assignments, grammar checking and a class-performance dashboard. It costs $19 per month on monthly billing or an advertised $15 per month billed annually. The annual equivalent is $180 before any applicable additions, calculated as $15 multiplied by 12; confirm the actual checkout total before paying. Schools and Districts plans use a custom quote and advertise unlimited submissions, shared rubric libraries, administration, institutional analytics and training. Higher Ed and Enterprise also use a custom quote, with API access, custom LMS connections and roles among the listed options. Choose a plan around submission volume, the review process and the integrations your institution actually needs, rather than assuming an individual subscription includes enterprise access. To evaluate CoGrader, begin with a rubric that defines each criterion and the evidence needed for each score. Try a small, permitted sample of work you have already assessed, compare the suggested results with your own reasoning, and revise unclear rubric language. Check whether each comment refers accurately to the student's work and gives an actionable next step. Review accommodations, language-learning needs and subject-specific expectations before finalizing feedback. A class dashboard can help identify topics to revisit; it should not replace the teacher's judgment about individual learning needs. Google Classroom integration is described as available to all users. The pricing FAQ places full Canvas and Schoology integration in school or district subscriptions, although the plan cards also display those platforms elsewhere. Confirm the exact integration and account entitlement you need. Other LMS workflows may use file import and export. The vendor also advertises plagiarism and AI-writing detection, but its plan card and FAQ disagree about AI-detection access. Confirm the selected plan's access, and treat a flag as a reason to review the evidence rather than proof of misconduct. CoGrader's privacy policy says teachers provide assignment questions, rubrics and student answers, and that student grading data is not used to train its AI models. It says third-party AI providers may not train on that data and identifies OpenAI OpCo, LLC as a provider receiving anonymized grading information. The policy also allows anonymized aggregate information to improve the service and does not give one fixed deletion deadline. Follow your school's authorization and data-handling process before uploading student work; a vendor policy is a statement of practice, not an independent security assessment. CoGrader is most relevant when an educator needs rubric-based feedback at a recurring classroom workload. Compare EssayGrader using the same sample rubric, feedback-review steps, submission allowance and data requirements. The terms describe a refund window within 14 days of an initial subscription purchase; that is separate from the free plan's advertised premium-access period. Review billing and cancellation terms before subscribing. |
| Category | Developer Tools | Education |
| Rating | No reviews | No reviews |
| Pricing | Open Source | Freemium |
| Starting Price | N/A | Free |
| Plans | — |
|
| Use Cases |
|
|
| Tags | AI gatewayPython SDKLLM routingMCP gatewayvirtual keys | AI essay gradingrubric feedbackteacher assessmentGoogle Classroomeducation |
| Features | ||
| Python SDK for direct application integration | ||
| Shared AI proxy gateway and administration UI | ||
| More than 100 documented model-provider integrations | ||
| Virtual keys, users, teams, budgets and rate limits | ||
| Spend tracking and observability integrations | ||
| Router retries, fallbacks and load balancing | ||
| MCP gateway for Streamable HTTP, SSE and stdio upstreams | ||
| Key, team and organization MCP permissions | ||
| Separate enterprise identity, audit and support features | ||
| Rubric-based AI grades and feedback for teacher review | ||
| Free Starter: 100 student submissions per month | ||
| Standard: 350 submissions per month | ||
| Custom and standards-aligned rubrics | ||
| Handwritten assignments and grammar checking on Standard | ||
| Google Classroom integration and institutional LMS options | ||
| Class-performance dashboard and institutional analytics | ||
| Quoted API access for Higher Ed and Enterprise | ||
| View BerriAI/litellm - GitHub | View CoGrader | |
Modify This Comparison
Also Compare
Explore more head-to-head comparisons with BerriAI/litellm - GitHub and CoGrader.