Skip to content

Report on Privacy Requests

Overview

The reporting feature allows you to fetch information about privacy requests. You can opt for high-level status information, or get more detailed information about the status of the requests on each of your collections.

View high-level statuses

This request displays concise, high-level information for all your privacy requests including their status and related timestamps.

Check out the API docs here.

GET api/v1/privacy-request
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
{
    "items": [
        {
            "id": "pri_5f4feff5-fb60-4286-82bd-7e0748ce90ac",
            "created_at": "2021-10-04T17:36:32.223287+00:00",
            "started_processing_at": "2021-10-04T17:36:37.248880+00:00",
            "finished_processing_at": "2021-10-04T17:36:37.263121+00:00",
            "status": "pending"
        }
    ],
    "total": 1,
    "page": 1,
    "size": 50
}

View a single privacy request

Use the id query param to view the high level status of a single privacy request.

1
GET api/v1/privacy-request?request_id=<privacy_request_id>

If an external_id was provided at request creation, we can also track the privacy request using:

1
GET api/v1/privacy-request?external_id=<external_id>

Please note: These parameters will return matching privacy requests based on startswith matches.

Filtering options

Use the following query params to further filter your privacy requests. Filters can be chained, for example, 

1
GET api/v1/privacy-request?created_gt=2021-10-01&created_lt=2021-10-05&status=pending
  • id
  • status (one of in_processing, pending, paused, complete, or error)
  • created_lt
  • created_gt
  • started_lt
  • started_gt
  • completed_lt
  • completed_gt
  • errored_lt
  • errored_gt

You can filter for multiple statuses by repeating the status query param:

1
GET api/v1/privacy-request?status=paused&status=complete

View privacy request logs

To view all the execution logs for a privacy request, visit /api/v1/privacy-request/{privacy_request_id}/logs. Embedded logs in the previous endpoints are truncated at 50 logs.

Check out the API docs here.

View a request's identity data

Use the optional include_identities query param to include all identity data that was submitted for the Privacy Request. Due to the nature of how fidesops stores identity data, this data will expire automatically according to the FIDESOPS__REDIS__DEFAULT_TTL_SECONDS variable.

If the identity data fetched by include_identities has expired, an empty JSON dictionary will be returned.

View individual request log details

Use the verbose query param to see more details about individual collections visited as part of the Privacy Request along with individual statuses. Individual collection statuses include in_processing, retrying, complete or error. You may see multiple logs for each collection as they reach different steps in the lifecycle.

verbose will embed a “results” key in the response, with both audit logs containing information about the overall request, as well as execution logs grouped by dataset name.

In the example below, we have two datasets: my-mongo-db and my-postgres-db. There are two execution logs for my-mongo-db (when the flights collection is starting execution and when the flights collection has finished) and two execution logs for my-postgres-db (when the order collection is starting and finishing execution). fields_affected are the fields that were potentially returned or masked based on the Rules you've specified on the Policy. The embedded execution logs are automatically truncated at 50 logs, so to view the entire list of logs, visit the execution logs endpoint separately.

There are also "Request approved" and "Request finished" audit logs included in the response.

GET api/v1/privacy-request?request_id={privacy_request_id}&verbose=True
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
{
    "items": [
        {
            "id": "pri_2e0655c3-7a76-425e-8c4c-52fee32ce14b",
            "created_at": "2022-02-28T16:38:03.878898+00:00",
            "started_processing_at": "2022-02-28T16:38:04.021763+00:00",
            "finished_processing_at": "2022-02-28T16:38:06.211547+00:00",
            "status": "complete",
            "external_id": null,
            "results": {
                 "Request approved": [
                    {
                        "collection_name": null,
                        "fields_affected": null,
                        "message": "",
                        "action_type": null,
                        "status": "approved",
                        "updated_at": "2022-08-11T14:03:37.679732+00:00",
                        "user_id": "system"
                    }
                ],
                "my-mongo-db": [
                    {
                        "collection_name": "flights",
                        "fields_affected": [],
                        "message": "starting",
                        "action_type": "access",
                        "status": "in_processing",
                        "updated_at": "2022-02-28T16:38:04.668513+00:00"
                    },
                     {
                        "collection_name": "flights",
                        "fields_affected": [
                            {
                                "path": "mongo_test:flights:passenger_information.full_name",
                                "field_name": "passenger_information.full_name",
                                "data_categories": [
                                    "user.name"
                                ]
                            }
                        ],
                        "message": "success",
                        "action_type": "access",
                        "status": "complete",
                        "updated_at": "2022-02-28T16:38:04.727094+00:00",
                        "user_id": null
                    }
                ],
                "my-postgres-db": [
                    {
                        "collection_name": "order",
                        "fields_affected": [],
                        "message": "starting",
                        "action_type": "access",
                        "status": "in_processing",
                        "updated_at": "2022-02-28T16:38:04.668513+00:00"
                    },
                    {
                        "collection_name": "order",
                        "fields_affected": [
                            {
                                "path": "order.customer_name",
                                "field_name": "name",
                                "data_categories": [
                                    "user.name"
                                ]
                            }
                        ], 
                        "message": "success",
                        "action_type": "access",
                        "status": "complete",
                        "updated_at": "2022-02-28T16:39:04.668513+00:00",
                        "user_id": null
                    }
                ]
            },
            "Request finished": [
                {
                    "collection_name": null,
                    "fields_affected": null,
                    "message": "",
                    "action_type": null,
                    "status": "finished",
                    "updated_at": "2022-08-11T14:04:29.611878+00:00",
                    "user_id": "system"
                }
            ]
        }
    ],
    "total": 1,
    "page": 1,
    "size": 50
}

Download all privacy requests as a CSV

To get all privacy requests in CSV format, use the download_csv query param:

GET api/v1/privacy-request/?download_csv=True
1
2
Time received,Subject identity,Policy key,Request status,Reviewer,Time approved/denied
2022-03-14 16:53:28.869258+00:00,{'email': 'customer-1@example.com'},my_primary_policy,complete,fid_16ffde2f-613b-4f79-bbae-41420b0f836b,2022-03-14 16:54:08.804283+00:00

Paused or failed request details

A privacy request may pause when manual input is needed from the user, or it might fail for various reason on a specific collection.

To retrieve information to resume or retry a privacy request, the following endpoint is available: 

1
GET api/v1/privacy-request?request_id=<privacy_request_id>

Paused access request example

The request below is in a paused state because we're waiting on manual input from the user to proceed. If we look at the action_required_details key, we can see that the request paused execution during the access step of the manual_key:filing_cabinet collection. The action_needed.locators field shows the user they should fetch the record in the filing cabinet with a customer_id of 72909, and pull the authorized_user, customer_id, id, and payment_card_id fields from that record. These values should be manually uploaded to the resume_endpoint. See the Manual Data guides for more information on resuming a paused access request.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
{
    "items": [
        {
            "id": "pri_ed4a6b7d-deab-489a-9a9f-9c2b19cd0713",
            "created_at": "2022-06-06T20:12:28.809815+00:00",
            "started_processing_at": "2022-06-06T20:12:28.986462+00:00",
            ...,
            "action_required_details": {
                "step": "access",
                "collection": "manual_key:filing_cabinet",
                "action_needed": [
                    {
                        "locators": {
                            "customer_id": [
                                72909
                            ]
                        },
                        "get": [
                            "authorized_user",
                            "customer_id",
                            "id",
                            "payment_card_id"
                        ],
                        "update": null
                    }
                ]
            },
            "resume_endpoint": "/privacy-request/pri_ed4a6b7d-deab-489a-9a9f-9c2b19cd0713/manual_input"
        }
    ],
    "total": 1,
    "page": 1,
    "size": 50
}

Paused erasure request example

The request below is in a paused state because we're waiting on the user to confirm they've masked the appropriate data before proceeding. The action_required_details shows us that the request paused execution during the erasure step of the manual_key:filing_cabinet collection. Looking at action_needed.locators field, we can see that the user should find the record in the filing cabinet with an id of 2, and replace its authorized_user with None. A confirmation of the masked records count should be uploaded to the resume_endpoint See the Manual Data guides for more information on resuming a paused erasure request.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
{
    "items": [
        {
            "id": "pri_59ea0129-fc6d-4a12-a5bd-2ee647bf5cec",
            "created_at": "2022-06-06T20:22:05.436361+00:00",
            "started_processing_at": "2022-06-06T20:22:05.473280+00:00",
            "finished_processing_at": null,
            "status": "paused",
            ...,
            "action_required_details": {
                "step": "erasure",
                "collection": "manual_key:filing_cabinet",
                "action_needed": [
                    {
                        "locators": {
                            "id": 2
                        },
                        "get": null,
                        "update": {
                            "authorized_user": null
                        }
                    }
                ]
            },
            "resume_endpoint": "/privacy-request/pri_59ea0129-fc6d-4a12-a5bd-2ee647bf5cec/erasure_confirm"
        }
    ],
    "total": 1,
    "page": 1,
    "size": 50
}

Failed request example

The below request is an error state because something failed in the erasure step of the postgres_dataset:payment_card collection.
After troubleshooting the issues with your postgres connection, you would resume the request with a POST to the resume_endpoint.

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
{
    "items": [
        {
            "id": "pri_59ea0129-fc6d-4a12-a5bd-2ee647bf5cec",
            "created_at": "2022-06-06T20:22:05.436361+00:00",
            "started_processing_at": "2022-06-06T20:22:05.473280+00:00",
            "finished_processing_at": null,
            "status": "error",
            ...,
            "action_required_details": {
              "step": "erasure",
              "collection": "postgres_dataset:payment_card",
              "action_needed": null
            },
            "resume_endpoint": "/privacy-request/pri_59ea0129-fc6d-4a12-a5bd-2ee647bf5cec/retry"
        }
    ],
    "total": 1,
    "page": 1,
    "size": 50
}
Back to top