# Autoblocks Documentation ## Docs - [Add dataset items](https://docs.autoblocks.ai/api-reference/datasets/add-dataset-items.md): Add items to a dataset - [Create a dataset](https://docs.autoblocks.ai/api-reference/datasets/create-a-dataset.md): Create a new dataset - [Delete a dataset](https://docs.autoblocks.ai/api-reference/datasets/delete-a-dataset.md): Delete a dataset - [Delete dataset item](https://docs.autoblocks.ai/api-reference/datasets/delete-dataset-item.md): Delete a dataset item - [Get dataset items](https://docs.autoblocks.ai/api-reference/datasets/get-dataset-items.md): Get items from a dataset - [Get dataset schema by version](https://docs.autoblocks.ai/api-reference/datasets/get-dataset-schema-by-version.md): Get a dataset schema by version - [List datasets](https://docs.autoblocks.ai/api-reference/datasets/list-datasets.md): List all datasets for an app - [Update dataset item](https://docs.autoblocks.ai/api-reference/datasets/update-dataset-item.md): Update a dataset item - [Get a specific job](https://docs.autoblocks.ai/api-reference/human-review/get-a-specific-job.md): Get a specific job by ID - [Get a specific job item](https://docs.autoblocks.ai/api-reference/human-review/get-a-specific-job-item.md): Get a specific job item by ID - [Get all jobs for the app](https://docs.autoblocks.ai/api-reference/human-review/get-all-jobs-for-the-app.md): Get all jobs for the app - [Log trace](https://docs.autoblocks.ai/api-reference/otel/log-trace.md): Log a trace in the OpenTelemetry format. See https://docs.autoblocks.ai/v2/guides/tracing/overview for more information. - [Create a new prompt](https://docs.autoblocks.ai/api-reference/prompts/create-a-new-prompt.md): Create a new prompt inside of a Prompt app. This prompt can then be used with the Prompt SDKs. See https://docs.autoblocks.ai/v2/guides/prompt-management/overview for more information. - [Get a deployed prompt](https://docs.autoblocks.ai/api-reference/prompts/get-a-deployed-prompt.md): This endpoint is used by the SDKs to get a deployed prompt inside a Prompt Manager. See https://docs.autoblocks.ai/v2/guides/prompt-management/overview for more information. - [Get an undeployed prompt](https://docs.autoblocks.ai/api-reference/prompts/get-an-undeployed-prompt.md): This endpoint is used by the SDKs to get an undeployed prompt inside a Prompt Manager. See https://docs.autoblocks.ai/v2/guides/prompt-management/overview for more information. - [Get prompt types](https://docs.autoblocks.ai/api-reference/prompts/get-prompt-types.md): This endpoint is used by the SDKs to generate classes for prompts. See https://docs.autoblocks.ai/v2/guides/prompt-management/overview for more information. - [Valid prompt compatibility](https://docs.autoblocks.ai/api-reference/prompts/valid-prompt-compatibility.md): This endpoint is used by the SDKs to check if a prompt revision is compatible with their currently-configured major version. This is used in the context of tests triggered from the UI, where we override the local config with a prompt revision. - [Generate a message for a scenario](https://docs.autoblocks.ai/api-reference/scenarios/generate-a-message-for-a-scenario.md): Generate a message for a scenario based on conversation history - [Get all scenario IDs for the app](https://docs.autoblocks.ai/api-reference/scenarios/get-all-scenario-ids-for-the-app.md): Get all scenario IDs for the app - [Create a CI build](https://docs.autoblocks.ai/api-reference/testing/create-a-ci-build.md): Used by the Autoblocks CLI to create a CI build. See https://docs.autoblocks.ai/v2/guides/testing/overview for more information. - [Cloud](https://docs.autoblocks.ai/v2/deployment/cloud.md): Get started quickly with Autoblocks' hosted cloud offering, the recommended approach for most users. - [Security and Compliance](https://docs.autoblocks.ai/v2/deployment/security-and-compliance.md): At Autoblocks, security and compliance are top priorities. Autoblocks is committed to ensuring the safety of our customers' data by following industry-standard best practices. - [Self-Hosted](https://docs.autoblocks.ai/v2/deployment/self-hosted.md): Learn how to deploy Autoblocks on your own infrastructure. - [Analyze Results](https://docs.autoblocks.ai/v2/guides/agent-simulate/analyze-results.md): Learn how to analyze and understand your simulation results - [Evaluators](https://docs.autoblocks.ai/v2/guides/agent-simulate/evaluators.md): Learn how to create and use LLM evaluators to assess your AI agent's performance - [Frequently Asked Questions](https://docs.autoblocks.ai/v2/guides/agent-simulate/faq.md) - [Overview](https://docs.autoblocks.ai/v2/guides/agent-simulate/overview.md): Learn about Agent Simulate and how it can help test your AI agents - [Quickstart](https://docs.autoblocks.ai/v2/guides/agent-simulate/quick-start.md): Run your first simulation in 5 minutes - [Scenarios](https://docs.autoblocks.ai/v2/guides/agent-simulate/scenarios.md): Learn how to create and manage simulations in Agent Simulate - [Overview](https://docs.autoblocks.ai/v2/guides/datasets/overview.md): Reference for how Autoblocks allows you to manage test cases and datasets. - [Out of Box Evaluators](https://docs.autoblocks.ai/v2/guides/evaluators/out-of-box.md): Learn about the built-in evaluators available in Autoblocks. - [Overview](https://docs.autoblocks.ai/v2/guides/evaluators/overview.md): Learn about Autoblocks Evaluators and how they help you assess your AI applications. - [Python Quick Start](https://docs.autoblocks.ai/v2/guides/evaluators/python/quick-start.md): Get started with Autoblocks Evaluators in Python. - [TypeScript Quick Start](https://docs.autoblocks.ai/v2/guides/evaluators/typescript/quick-start.md): Get started with Autoblocks Evaluators in TypeScript. - [Overview](https://docs.autoblocks.ai/v2/guides/human-review/overview.md): Human review mode is designed for humans to review, grade, and discuss test results.. - [Core Concepts](https://docs.autoblocks.ai/v2/guides/introduction/core-concepts.md): Learn about the fundamental concepts that power Autoblocks, including apps, test cases, evaluations, human review, and agent simulation. - [What is Autoblocks?](https://docs.autoblocks.ai/v2/guides/introduction/what-is-autoblocks.md): Ship AI apps you can trust. Autoblocks helps AI product teams prototype, test, and launch reliable apps & agents faster and at scale. - [Overview](https://docs.autoblocks.ai/v2/guides/prompt-management/overview.md): Learn about Autoblocks Prompt Management and how it helps you manage and version your prompts with type safety and autocomplete. - [Quick Start](https://docs.autoblocks.ai/v2/guides/prompt-management/python/quick-start.md): Get started with the Autoblocks Python Prompt SDK to manage and execute your prompts with type safety and autocomplete. - [SDK Reference](https://docs.autoblocks.ai/v2/guides/prompt-management/python/sdk-reference.md): Reference documentation for the Autoblocks Python Prompt SDK, including the AutoblocksPromptManager and PromptExecutionContext classes. - [Quick Start](https://docs.autoblocks.ai/v2/guides/prompt-management/typescript/quick-start.md): Get started with the Autoblocks TypeScript Prompt SDK to manage and execute your prompts with type safety and autocomplete. - [SDK Reference](https://docs.autoblocks.ai/v2/guides/prompt-management/typescript/sdk-reference.md): Reference documentation for the Autoblocks TypeScript Prompt SDK, including the AutoblocksPromptManager and PromptExecutionContext classes. - [Overview](https://docs.autoblocks.ai/v2/guides/rbac/overview.md): Learn how to manage roles, teams, and access control in Autoblocks, including SSO integration and granular app permissions. - [Running in CI](https://docs.autoblocks.ai/v2/guides/testing/ci.md): Learn how to run your Autoblocks tests in a CI environment. - [Overview](https://docs.autoblocks.ai/v2/guides/testing/overview.md): Learn about Autoblocks Testing and how it helps you test your LLM applications. - [Python Quick Start](https://docs.autoblocks.ai/v2/guides/testing/python/quick-start.md): Get started with the Autoblocks Testing SDK for Python. - [Python SDK Reference](https://docs.autoblocks.ai/v2/guides/testing/python/sdk-reference.md): Technical reference for the Autoblocks Python SDK testing functionality. - [TypeScript Quick Start](https://docs.autoblocks.ai/v2/guides/testing/typescript/quick-start.md): Get started with the Autoblocks Testing SDK for TypeScript. - [TypeScript SDK Reference](https://docs.autoblocks.ai/v2/guides/testing/typescript/sdk-reference.md): Technical reference for the Autoblocks TypeScript SDK testing functionality. - [Overview](https://docs.autoblocks.ai/v2/guides/tracing/overview.md): Learn about Autoblocks Tracing and how it helps you monitor and debug your AI applications. - [Quickstart](https://docs.autoblocks.ai/v2/guides/tracing/python/quick-start.md): Learn how to use Autoblocks tracing in Python applications - [Quickstart](https://docs.autoblocks.ai/v2/guides/tracing/typescript/quick-start.md): Learn how to use Autoblocks tracing in JavaScript/TypeScript applications - [Overview](https://docs.autoblocks.ai/v2/guides/workflow-builder/overview.md): Learn about Autoblocks Workflow Builder and how it helps you create and manage complex LLM chains. - [llms.txt](https://docs.autoblocks.ai/v2/llms/llms.md) - [llms-full](https://docs.autoblocks.ai/v2/llms/llms-full.md) - [V1 to V2 Migration Guide](https://docs.autoblocks.ai/v2/migrating-to-v2/v1-to-v2-migration-guide.md): Learn how to migrate from Autoblocks V1 to V2. ## Optional - [v1](https://docs-v1.autoblocks.ai)