Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions hugo/config/_default/menus/api.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8480,6 +8480,19 @@ menu:
unstable:
- v2
order: 28
- name: Get an annotated queue interaction
url: /api/latest/agent-observability/get-an-annotated-queue-interaction/
identifier: agent-observability-get-an-annotated-queue-interaction
parent: agent-observability
generated: true
params:
versions:
- v2
operationids:
- GetLLMObsAnnotatedInteraction
unstable:
- v2
order: 73
- name: Get annotated queue interactions
url: /api/latest/agent-observability/get-annotated-queue-interactions/
identifier: agent-observability-get-annotated-queue-interactions
Expand Down
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
---
title: Get an annotated queue interaction
---
139 changes: 139 additions & 0 deletions hugo/content/en/api/v2/agent-observability/examples.json

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,37 @@ Complete the following checks for each monitored region:
3. If you use custom subnets, verify that they meet the [permissions][7] (detailed in the note after step 5).
4. For each Datadog-created metric service connector hub, confirm that its function target is the `dd-metrics-forwarder` function in `dd-function-app`. Datadog-created metric connector hubs use the format `dd-metrics-connectorhub-<suffix>`. If a connector hub targets a different forwarding function application, delete it and allow it to be automatically reprovisioned.

## OCI stack destroy issues

If the destroy job fails or is unable to be run:

1. Clone the [OCI integration repository][11] and enter the repository directory.
2. Use the [OCI integration cleanup script][10] to remove the remaining resources.
3. Set the required variables.
4. Review a dry run:

```shell
export OCI_PROFILE="<YOUR_OCI_PROFILE>"
export COMPARTMENT_OCID="<YOUR_COMPARTMENT_OCID>"
export TENANCY_OCID="<YOUR_TENANCY_OCID>"

python3 oci-integration-cleanup/integration_cleanup.py \
--profile "$OCI_PROFILE" \
--compartment-ocid "$COMPARTMENT_OCID" \
--dry-run true
```

5. Review the resources planned for deletion in the dry run output. If the output looks correct, execute the cleanup:

```shell
python3 oci-integration-cleanup/integration_cleanup.py \
--profile "$OCI_PROFILE" \
--compartment-ocid "$COMPARTMENT_OCID" \
--confirm-tenancy-id "$TENANCY_OCID" \
--region-workers <number of regions to be processed in parallel> \
--dry-run false
```

## Outdated integration version

This occurs when your Datadog integration ORM stack or Terraform module is out of date. To remediate this, update your deployment to the latest version and reapply it. For instructions covering both QuickStart (ORM stack) and Terraform, see [Update the integration][8].
Expand All @@ -93,3 +124,5 @@ Still need help? Contact [Datadog support][3].
[7]: https://docs.datadoghq.com/integrations/oracle-cloud-infrastructure/#deploy-the-quickstart-orm-stack
[8]: /integrations/oracle-cloud-infrastructure/#update-the-integration
[9]: https://app.datadoghq.com/organization-settings/application-keys
[10]: https://github.com/DataDog/oracle-cloud-integration/tree/master/oci-integration-cleanup#readme
[11]: https://github.com/DataDog/oracle-cloud-integration
184 changes: 184 additions & 0 deletions hugo/data/api/v2/full_spec.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -988,6 +988,14 @@ components:
required: true
schema:
type: string
LLMObsAnnotationQueueInteractionIDPathParameter:
description: The ID of the interaction in the annotation queue.
example: "interaction-456"
in: path
name: interaction_id
required: true
schema:
type: string
LLMObsDatasetIDPathParameter:
description: The ID of the Agent Observability dataset.
example: "9f64e5c7-dc5a-45c8-a17c-1b85f0bec97d"
Expand Down Expand Up @@ -56780,11 +56788,89 @@ components:
- can_annotate
- annotations
type: object
LLMObsAnnotatedInteractionDataAttributesResponse:
description: Attributes containing an annotated interaction and its related events.
properties:
annotated_interaction:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionItem"
events:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionEvents"
interaction_type:
$ref: "#/components/schemas/LLMObsAnyInteractionType"
next_cursor:
description: Cursor to retrieve the next page of events. Absent when there are no more events.
example: "eyJzdGFydCI6MTAwfQ=="
type: string
required:
- annotated_interaction
- interaction_type
- events
type: object
LLMObsAnnotatedInteractionDataResponse:
description: Data object for a single annotated interaction.
properties:
attributes:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionDataAttributesResponse"
id:
description: Unique identifier of the interaction.
example: "interaction-456"
type: string
type:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionsType"
required:
- id
- type
- attributes
type: object
LLMObsAnnotatedInteractionEvent:
description: An event associated with an annotated interaction.
properties:
attributes:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionEventAttributes"
id:
description: Unique identifier of the event.
example: "span-7a1b2c3d"
type: string
type:
description: Type of the event.
example: span
type: string
required:
- id
- type
- attributes
type: object
LLMObsAnnotatedInteractionEventAttributes:
additionalProperties: {}
description: Attributes of an event associated with an annotated interaction.
example:
duration: 1500000000
ml_app: my-llm-app
name: agent_workflow
span_id: span-7a1b2c3d
span_kind: agent
start_ns: 1705314600000000000
status: ok
trace_id: trace-abc-123
type: object
LLMObsAnnotatedInteractionEvents:
description: Page of events associated with the annotated interaction.
items:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionEvent"
type: array
LLMObsAnnotatedInteractionItem:
description: An interaction with its associated annotations.
oneOf:
- $ref: "#/components/schemas/LLMObsTraceAnnotatedInteractionItem"
- $ref: "#/components/schemas/LLMObsDisplayBlockAnnotatedInteractionItem"
LLMObsAnnotatedInteractionResponse:
description: Response containing a single annotated interaction and its related events.
properties:
data:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionDataResponse"
required:
- data
type: object
LLMObsAnnotatedInteractionsByTraceDataAttributesResponse:
description: Attributes of the cross-queue annotated interactions response.
properties:
Expand Down Expand Up @@ -168519,6 +168605,104 @@ paths:
x-unstable: |-
**Note**: This endpoint is in preview and is subject to change.
If you have any feedback, contact [Datadog support](https://docs.datadoghq.com/help/).
/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions/{interaction_id}:
get:
description: Retrieve an interaction, its annotations, and a page of related events from an annotation queue.
operationId: GetLLMObsAnnotatedInteraction
parameters:
- $ref: "#/components/parameters/LLMObsAnnotationQueueIDPathParameter"
- $ref: "#/components/parameters/LLMObsAnnotationQueueInteractionIDPathParameter"
- description: Maximum number of events to return. Defaults to 10.
in: query
name: limit
schema:
default: 10
format: int32
maximum: 1000
minimum: 1
type: integer
- description: Cursor from the previous response to retrieve the next page of events.
in: query
name: cursor
schema:
type: string
responses:
"200":
content:
application/json:
examples:
default:
value:
data:
attributes:
annotated_interaction:
annotations: []
can_annotate: true
content_id: trace-abc-123
created_at: "2024-01-15T10:30:00Z"
id: interaction-456
modified_at: "2024-01-15T10:30:00Z"
type: trace
events:
- attributes:
duration: 1500000000
ml_app: my-llm-app
name: agent_workflow
span_id: span-7a1b2c3d
span_kind: agent
start_ns: 1705314600000000000
status: ok
trace_id: trace-abc-123
id: span-7a1b2c3d
type: span
interaction_type: session
next_cursor: eyJzdGFydCI6MTAwfQ==
id: interaction-456
type: annotated_interactions
schema:
$ref: "#/components/schemas/LLMObsAnnotatedInteractionResponse"
description: OK
"400":
content:
application/json:
schema:
$ref: "#/components/schemas/JSONAPIErrorResponse"
description: Bad Request
"401":
content:
application/json:
schema:
$ref: "#/components/schemas/JSONAPIErrorResponse"
description: Unauthorized
"403":
content:
application/json:
schema:
$ref: "#/components/schemas/JSONAPIErrorResponse"
description: Forbidden
"404":
content:
application/json:
schema:
$ref: "#/components/schemas/JSONAPIErrorResponse"
description: Not Found
"429":
$ref: "#/components/responses/TooManyRequestsResponse"
security:
- apiKeyAuth: []
appKeyAuth: []
summary: Get an annotated queue interaction
tags:
- Agent Observability
x-menu-order: 73
x-pagination:
cursorParam: cursor
cursorPath: data.attributes.next_cursor
limitParam: limit
resultsPath: data.attributes.events
x-unstable: |-
**Note**: This endpoint is in preview and is subject to change.
If you have any feedback, contact [Datadog support](https://docs.datadoghq.com/help/).
/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations:
post:
description: |-
Expand Down
4 changes: 4 additions & 0 deletions hugo/data/api/v2/translate_actions.json
Original file line number Diff line number Diff line change
Expand Up @@ -3369,6 +3369,10 @@
"description": "Retrieve all interactions (traces and sessions) and their annotations for a given annotation queue.",
"summary": "Get annotated queue interactions"
},
"GetLLMObsAnnotatedInteraction": {
"description": "Retrieve an interaction, its annotations, and a page of related events from an annotation queue.",
"summary": "Get an annotated queue interaction"
},
"UpsertLLMObsAnnotations": {
"description": "Create or update annotations on interactions in a queue. Each annotation is matched\nby `interaction_id` and the requesting user's identity.\nResults and errors in the response are linked to request items by `interaction_id`.\nErrors for individual items are returned in the `errors` field without blocking the rest of the batch.\nRequests where every item is denied by queue access rules return `403`.",
"summary": "Create or update annotations",
Expand Down
52 changes: 0 additions & 52 deletions hugo/local/bin/py/build/configurations/pull_config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -156,58 +156,6 @@
aliases:
- /serverless/serverless_integrations/macro/

- repo_name: datadog-ci
contents:
- action: pull-and-push-file
branch: master
globs:
- 'packages/plugin-lambda/README.md'
options:
dest_path: '/serverless/libraries_integrations/'
file_name: 'cli.md'
front_matters:
dependencies: ["https://github.com/DataDog/datadog-ci/blob/master/packages/plugin-lambda/README.md"]
title: Datadog Serverless CLI
aliases:
- /serverless/datadog_lambda_library/
- /serverless/serverless_integrations/cli/
- action: pull-and-push-file
branch: master
globs:
- 'packages/plugin-cloud-run/README.md'
options:
dest_path: '/serverless/libraries_integrations/'
file_name: 'cli-cloud-run.md'
front_matters:
dependencies: ["https://github.com/DataDog/datadog-ci/blob/master/packages/plugin-cloud-run/README.md"]
title: Datadog Serverless CLI for Cloud Run
- action: pull-and-push-file
branch: master
globs:
- 'packages/plugin-synthetics/README.md'
options:
dest_path: '/continuous_testing/cicd_integrations/'
file_name: 'configuration.md'
front_matters:
dependencies: ["https://github.com/DataDog/datadog-ci/blob/master/packages/plugin-synthetics/README.md"]
title: Continuous Testing and CI/CD Configuration
description: Configure Continuous Testing to run tests in your CI/CD pipelines.
aliases:
- /synthetics/cicd_integrations/configuration
further_reading:
- link: "https://www.datadoghq.com/blog/datadog-github-action-synthetics-ci-visibility/"
tag: "Blog"
text: "Use Datadog's GitHub Action to add continuous testing to workflows"
- link: "/continuous_testing/cicd_integrations"
tag: "Documentation"
text: "Learn about Continuous Testing and CI/CD"
- link: "/continuous_testing/explorer"
tag: "Documentation"
text: "Learn about the Synthetic Monitoring & Testing Results Explorer"
- link: "/continuous_testing/testing_tunnel"
tag: "Documentation"
text: "Learn about the Continuous Testing Tunnel"

- repo_name: datadog-cdk-constructs
contents:
- action: pull-and-push-file
Expand Down
Loading
Loading