# Weights & Biases ## Docs - [Call End](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/call-end.md) - [Call Read](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/call-read.md) - [Call Start](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/call-start.md) - [Call Start Batch](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/call-start-batch.md) - [Call Update](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/call-update.md) - [Calls Delete](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/calls-delete.md) - [Calls Query Stats](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/calls-query-stats.md) - [Calls Query Stream](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/calls/calls-query-stream.md) - [Cost Create](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/costs/cost-create.md) - [Cost Purge](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/costs/cost-purge.md) - [Cost Query](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/costs/cost-query.md) - [Feedback Create](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/feedback/feedback-create.md): Add feedback to a call or object. - [Feedback Purge](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/feedback/feedback-purge.md): Permanently delete feedback. - [Feedback Query](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/feedback/feedback-query.md): Query for feedback. - [Feedback Replace](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/feedback/feedback-replace.md) - [File Content](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/files/file-content.md) - [File Create](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/files/file-create.md) - [Files Stats](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/files/files-stats.md) - [Obj Create](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/objects/obj-create.md) - [Obj Delete](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/objects/obj-delete.md) - [Obj Read](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/objects/obj-read.md) - [Objs Query](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/objects/objs-query.md) - [Export Trace](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/opentelemetry/export-trace.md) - [Refs Read Batch](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/refs/refs-read-batch.md) - [Get Caller Location](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/service/get-caller-location.md): Lookup the geographic location of a user based on their IP address. - [Read Root](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/service/read-root.md) - [Read Version](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/service/read-version.md) - [Server Info](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/service/server-info.md) - [Table Create](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/tables/table-create.md) - [Table Query](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/tables/table-query.md) - [Table Query Stats](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/tables/table-query-stats.md) - [Table Query Stats Batch](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/tables/table-query-stats-batch.md) - [Table Update](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/tables/table-update.md) - [Threads Query Stream](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/api-reference/threads/threads-query-stream.md) - [Introduction to Evaluations](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/Intro_to_Weave_Hello_Eval.md): Learn how to use introduction to evaluations with W&B Weave - [Introduction to Traces](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/Intro_to_Weave_Hello_Trace.md): Learn how to use introduction to traces with W&B Weave - [Use Weave with W&B Models](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/Models_and_Weave_Integration_Demo.md): Learn how to use use weave with w&b models with W&B Weave - [Audio With Weave](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/audio_with_weave.md): Learn how to use audio with weave with W&B Weave - [Chain Of Density](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/chain_of_density.md): Learn how to use chain of density with W&B Weave - [Codegen](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/codegen.md): Learn how to use codegen with W&B Weave - [Custom Model Cost](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/custom_model_cost.md): Learn how to use custom model cost with W&B Weave - [DSPy Prompt Optimization](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/dspy_prompt_optimization.md): Learn how to use dspy prompt optimization with W&B Weave - [Feedback Prod](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/feedback_prod.md): Learn how to use feedback prod with W&B Weave - [HuggingFace Dataset Evaluations](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/hf_dataset_evals.md): Learn how to use huggingface dataset evaluations with W&B Weave - [Import From Csv](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/import_from_csv.md): Learn how to use import from csv with W&B Weave - [Leaderboard Quickstart](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/leaderboard_quickstart.md): Learn how to use leaderboard quickstart with W&B Weave - [Multi Agent Structured Output](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/multi-agent-structured-output.md): Learn how to use multi agent structured output with W&B Weave - [NotDiamond Custom Routing](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/notdiamond_custom_routing.md): Learn how to use notdiamond custom routing with W&B Weave - [Trace and Evaluate a Computer Vision Pipeline with Weave](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/ocr-pipeline.md): Learn how to use trace and evaluate a computer vision pipeline with weave with W&B Weave - [Online Monitoring](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/online_monitoring.md): Learn how to use online monitoring with W&B Weave - [PII Data Handling](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/pii.md): Learn how to use pii data handling with W&B Weave - [Scorers As Guardrails](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/scorers_as_guardrails.md): Learn how to use scorers as guardrails with W&B Weave - [Weave Via Service Api](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/cookbooks/weave_via_service_api.md): Learn how to use weave via service api with W&B Weave - [Datasets](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/datasets.md): Organize, collect, track, and version examples for LLM application evaluation - [Environment variables](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/env-vars.md): Configure Weave's behavior at runtime using environment variables - [Evaluations](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/evaluations.md): Evaluation-driven LLM application development to systematically improve applications - [Leaderboards](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/leaderboards.md): Compare and rank different model versions based on evaluation metrics - [Logging media](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/media.md): Log and display video, images, and audio with Weave - [Models](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/models.md): Version your application with structured models that combine data and code - [Prompts](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/core-types/prompts.md): Store, version, and organize prompts for LLM applications - [Builtin Scorers](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/evaluation/builtin_scorers.md): Use Weave's predefined scorers for evaluating your AI applications - [EvaluationLogger](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/evaluation/evaluation_logger.md): Flexible, incremental way to log evaluation data from Python code - [Online Evaluation: Guardrails and Monitors](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/evaluation/guardrails_and_monitors.md): Ensure LLM safety and measure output quality in production applications - [Scoring Overview](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/evaluation/scorers.md): Evaluate AI outputs and return evaluation metrics with Weave Scorers - [Weave Local Scorers](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/evaluation/weave_local_scorers.md): Small language models that run locally to evaluate AI system safety and quality - [Anthropic](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/anthropic.md): Use Weave to automatically track and log LLM calls made via the Anthropic Python library - [AutoGen](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/autogen.md): Use Weave to track and monitor AutoGen agents and multi-agent systems - [Microsoft Azure](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/azure.md): Integrate Weave with Microsoft Azure OpenAI services - [Bedrock](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/bedrock.md) - [Cerebras](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/cerebras.md): Use Weave to trace and log LLM calls made via the Cerebras Cloud SDK - [Cohere](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/cohere.md): Use Weave to automatically track and log LLM calls made via the Cohere Python library - [CrewAI](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/crewai.md): Integrate CrewAI with Weave for monitoring and tracing multi-agent applications - [DSPy](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/dspy.md): Use Weave to automatically track and log calls made using DSPy modules and functions - [Google](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/google.md): Use Weave to trace and log Google GenAI model calls - [Google Agent Development Kit (ADK)](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/google_adk.md): Trace Google Agent Development Kit (ADK) agent and tool calls in Weave using OpenTelemetry - [Groq](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/groq.md) - [Hugging Face Hub](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/huggingface.md): Integrate Hugging Face Hub with W&B Weave to track and analyze your machine learning applications - [Integrations](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/index.md): Automatic logging integrations for popular LLM providers and orchestration frameworks - [Inference](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/inference.md) - [Instructor](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/instructor.md) - [TypeScript SDK: Third-Party Integration Guide](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/js.md): Integrate third-party libraries with the Weave TypeScript SDK - [LangChain](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/langchain.md): Use Weave to track and log all calls made through the LangChain Python library - [LiteLLM](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/litellm.md): Automatically track and log LLM calls made via LiteLLM - [Llamaindex](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/llamaindex.md) - [Local models](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/local_models.md) - [Model Context Protocol (MCP) and Weave](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/mcp.md): Trace activity between your MCP client and MCP server with Weave - [Mistral](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/mistral.md) - [Nvidia nim](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/nvidia_nim.md) - [OpenAI](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/openai.md): Integrate OpenAI with Weave for tracing, evaluation, and monitoring - [Openai agents](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/openai_agents.md) - [Open Router](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/openrouter.md): Use Open Router's unified interface for many LLMs with automatic Weave integration - [PydanticAI](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/pydantic_ai.md): Trace PydanticAI agent and tool calls in Weave using OpenTelemetry - [Smolagents](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/smolagents.md) - [Together ai](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/together_ai.md) - [Verdict](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/integrations/verdict.md): Use Verdict evaluation framework with Weave to trace and monitor your LLM evaluation pipelines - [Platform & Security](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/platform/index.md): Weave deployment options and security features - [W&B Weave Self-Managed](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/platform/weave-self-managed.md): Deploy and manage Weave on your own infrastructure - [Comparison](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/comparison.md): Visually compare and diff code, traces, prompts, models, and configurations - [Deploy](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/deploy.md): Deploy your Weave models to cloud platforms - [Tools & Utilities](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/index.md): Weave tools and utilities for AI application workflow and deployment - [Playground](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/playground.md): Simplify the process of iterating on LLM prompts and responses - [Saved Views](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/saved-views.md): Customize how you interact with traced function calls and evaluations - [Serve](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tools/serve.md): Expose your Weave ops and models as API endpoints - [Costs](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/costs.md): Track and manage costs for LLM operations in Weave - [FAQs](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/faqs.md): Answers to common questions about Weave tracing - [Feedback](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/feedback.md): Collect and analyze feedback for LLM applications through UI and SDK - [Tracing Overview](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/index.md): Powerful tracing capabilities to track and version objects and function calls - [Objects](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/objects.md): Track and version any JSON-serializable object in Weave - [Ops](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/ops.md): Versioned functions that automatically log all calls in Weave - [Send OpenTelemetry Traces](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/otel.md): Ingest OpenTelemetry compatible trace data through a dedicated endpoint - [Redacting PII](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/redact-pii.md): Automatically redact Personally Identifiable Information from traces - [Navigate the Trace View](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/trace-tree.md): Make sense of complex execution paths in your LLM and agentic apps - [Tracing Quickstart](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/tracing.md): Track and monitor your AI application's execution with Weave tracing - [Video Support](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/tracking/video.md): Automatically log videos using moviepy in Weave - [Troubleshooting](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/guides/troubleshooting.md): Solutions and guidance for common issues you may encounter with Weave - [W&B Weave](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/index.md): Track, test, and improve language model apps with W&B Weave - [Track LLM inputs & outputs](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/quickstart.md): Follow these steps to track your first call - [Python SDK Reference](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/python-sdk/weave/index.md): Complete API reference for the Weave Python SDK - [Op](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/python-sdk/weave/trace/op.md): The Op decorator and related functionality for tracking function calls - [Trace Utilities](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/python-sdk/weave/trace/util.md): Utility functions and classes for tracing, including ThreadPoolExecutor - [WeaveClient](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/python-sdk/weave/trace/weave_client.md): The WeaveClient class provides methods for interacting with the Weave service - [Trace Server Interface](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/python-sdk/weave/trace_server/trace_server_interface.md): Interface definitions and schemas for the trace server - [Dataset](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/classes/Dataset.md) - [Evaluation](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/classes/Evaluation.md) - [WeaveClient](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/classes/WeaveClient.md) - [WeaveObject](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/classes/WeaveObject.md) - [Init](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/functions/init.md) - [Login](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/functions/login.md) - [Op](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/functions/op.md) - [WeaveAudio](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/functions/weaveAudio.md) - [WeaveImage](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/functions/weaveImage.md) - [Weave](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/index.md) - [CallSchema](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/interfaces/CallSchema.md) - [CallsFilter](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/interfaces/CallsFilter.md) - [Op](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/reference/typescript-sdk/weave/type-aliases/Op.md) - [Tutorial: Build an Evaluation pipeline](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/tutorial-eval.md): Learn how to build an evaluation pipeline with Weave Models and Evaluations - [Tutorial: Model-Based Evaluation of RAG applications](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/tutorial-rag.md): Build and evaluate RAG applications using Weave with LLM judges - [Track Application Logic](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/tutorial-tracing_2.md): Learn how to track data flow and metadata in your LLM applications - [Tutorial: App versioning](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/tutorial-weave_models.md): Learn how to use Weave Model to track and version your application and its parameters ## OpenAPI Specs - [openapi](https://wb-21fd5541-feature-automate-reference-docs-generation.mintlify.app/openapi.json) ## Optional - [GitHub](https://github.com/wandb/weave) - [Release Changelog](https://github.com/wandb/weave/releases)