Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion deployments/apple_iconic_scenes_photo_selections_2023.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -44,7 +44,7 @@ deployment:
# composition: '' # Tier 3

implementation:
# pre_processing_eda_hyperparameter_tuning: '' # Tier 3
# preprocessing_and_hyperparameter_tuning: '' # Tier 3
mechanisms: |
- Randomized Response with amplification through the secure aggregation protocol. The local Differential Privacy mechanism encodes a single, randomly sampled location-category pair into a tiled one-hot vector, subsequently applying randomized bit-flipping to satisfy DP guarantees.
- No explicit information regarding the privacy unit was provided on the posted online article by Apple: https://machinelearning.apple.com/research/scenes-differential-privacy
Expand Down
2 changes: 1 addition & 1 deletion deployments/apple_popular_emojis.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ deployment:
composition: No information was provided about composition.

implementation:
pre_processing_eda_hyperparameter_tuning: 'Three parameters are explicitly set: \\(\epsilon = 4\\), number of hash functions k = 65,546 and the size of the privatized vector m = 1024. These were predetermined by the authors based on an analysis of the tradeoff between utility, server computation cost (related to k), and device bandwidth (related to m).'
preprocessing_and_hyperparameter_tuning: 'Three parameters are explicitly set: \\(\epsilon = 4\\), number of hash functions k = 65,546 and the size of the privatized vector m = 1024. These were predetermined by the authors based on an analysis of the tradeoff between utility, server computation cost (related to k), and device bandwidth (related to m).'
mechanisms: |
- The differential privacy algorithm used is Private Count Mean Sketch (CMS).
- No information was provided about the implementation of the mechanism.
Expand Down
2 changes: 1 addition & 1 deletion deployments/assistive_ai.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ deployment:
deployment_model:
model_name: Central
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Differentially Private Set Union
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/audience_engagement.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ deployment:
release_type_description: The data are refreshed on a monthly basis. The budget also resets on a monthly basis.
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace, Gumbel
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/autoplay_intent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ deployment:
release_type_description: Daily
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Private Count Mean Sketch
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/birth_dataset.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: PrivBayes with Private Selection (Universal Microdata Scheme)
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/broadband_coverage.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ deployment:
By sequential composition, the total privacy loss is 0.2.
(Note: The equation for Broadband Coverage Estimate does not use the "number of devices with speed < 25". In fact, it seems this number is never used.)
implementation:
pre_processing_eda_hyperparameter_tuning: The 32,653 zip codes were predefined based on the average number of machines in the last years (not on the dataset being protected).
preprocessing_and_hyperparameter_tuning: The 32,653 zip codes were predefined based on the average number of machines in the last years (not on the dataset being protected).

mechanisms: |
- The Laplace mechanism with \\(\epsilon = 0.1\\) was applied to every count query (see section on Composition for query descriptions).
Expand Down
2 changes: 1 addition & 1 deletion deployments/census_demographic_and_housing.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ deployment:
- For the TopDownAlgorithm, the total \\(\rho\\) is the sum of the \\(\rho\\) values allocated to all queries at every level of the geographic hierarchy (nation, state, county, tract, block group, and block).

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- Preprocessing: the raw census responses undergo pre-processing steps to create the CEF. This involves:
- Editing: Ensuring logical consistencies among characteristics for a person or household. For instance, an edit constraint ensures that a mother must be older than her natural child.
- Imputation: Filling in missing or misreported data for key characteristics like age, sex, race, and ethnicity to ensure every record is complete.
Expand Down
2 changes: 1 addition & 1 deletion deployments/census_redistricting_data.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -72,7 +72,7 @@ deployment:
- For the TopDownAlgorith, the total \\(\rho\\) is the sum of the \\(\rho\\) values allocated to all queries at every level of the geographic hierarchy (nation, state, county, tract, block group, and block).

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- Preprocessing: the raw census responses undergo pre-processing steps to create the CEF. This involves:
- Editing: Ensuring logical consistencies among characteristics for a person or household. For instance, an edit constraint ensures that a mother must be older than her natural child.
- Imputation: Filling in missing or misreported data for key characteristics like age, sex, race, and ethnicity to ensure every record is complete.
Expand Down
2 changes: 1 addition & 1 deletion deployments/county_business_patterns.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Gaussian
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/covid19_notifications.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ deployment:
release_type_description: Varies
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Randomized Response
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/covid19_search_trends_symptoms.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -68,7 +68,7 @@ deployment:
- Level 2 (e.g., County): \\(\epsilon_2'\\) = 0.014

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- Individual search queries are mapped to one or more symptoms from a predefined list.
- The mapped queries are aggregated by user, day, symptom, and geographic region to produce raw counts.
- For each day and geographic granularity level, a user can contribute at most once to any given count (per-symptom bound) and to no more than three counts in total (cross-symptom bound). Any symptom searches beyond this limit are discarded.
Expand Down
2 changes: 1 addition & 1 deletion deployments/employment_outcomes.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ deployment:
# composition:

# implementation:
# pre_processing_eda_hyperparameter_tuning:
# preprocessing_and_hyperparameter_tuning:
# mechanisms:
# justification:
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/google_mobility.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -76,7 +76,7 @@ deployment:
- Composition: A user contributes at most once per geographic level. The total budget is the sum across the levels: 0.11*2 + 0.22 = 0.44

implementation:
pre_processing_eda_hyperparameter_tuning: 'User contributions for public places are bounded: If a user visits more than four (category, location) pairs on a given day at a specific geographic level, four are chosen at random, and the rest are discarded. Each user can also contribute at most once per category at a given location.'
preprocessing_and_hyperparameter_tuning: 'User contributions for public places are bounded: If a user visits more than four (category, location) pairs on a given day at a specific geographic level, four are chosen at random, and the rest are discarded. Each user can also contribute at most once per category at a given location.'
mechanisms: |
- The Laplace mechanism was used for simple counts, like the number of daily visits to public places and workplaces. The DP Mean Mechanism: used to calculate the average time spent at residences.
- The mechanisms were implemented via Google's open-source C++ Differential Privacy Library:
Expand Down
2 changes: 1 addition & 1 deletion deployments/healthkit.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ deployment:


implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Private Count Mean Sketch
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/korean_statistics_datahub.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -27,7 +27,7 @@ deployment:
release_type_description: Not specified
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Unknown
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/linkedin_hiring_reports.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ deployment:
release_type_description: Monthly
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace, Gumbel
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/lookup_hints.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ deployment:
release_type_description: Daily
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Count Mean Sketch or Hadamard Count Mean Sketch
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ deployment:
# composition: '' # Tier 3

implementation:
# pre_processing_eda_hyperparameter_tuning: '' # Tier 3
# preprocessing_and_hyperparameter_tuning: '' # Tier 3
mechanisms: |
- Continuous Gaussian mechanism
- The dataset was generated using Microsoft's Synthetic Data Showcase, which follows a two-stage approach:
Expand Down
2 changes: 1 addition & 1 deletion deployments/mobility_trends_hurricane.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -29,7 +29,7 @@ deployment:
release_type_description: Not specified
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/movement_ranges_maps.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ deployment:
data_source_type: Dynamic
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/on_device_browser_rec.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ deployment:
release_type_description: Not specified
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: DP SGD*
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/private_third_party_audits.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Not Specificed, Synthetic Data
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/recurve_energy_dp.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ deployment:
- Because the comparison group was a sample of a larger population, the paper applies an 'amplification factor' of 0.124 to reduce the total privacy cost. The correct amplification formula yields \\(\epsilon = 4.72\\) and \\(\delta = 5.06e-9\\).

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- The CalTRACK methodology was used to model and generate a 'predicted' (counterfactual) hourly energy usage for every customer in both the treatment (non-sensitive) and comparison (sensitive) groups.
- An upper bound was selected for hourly consumption data used for clipping in a two-step process:
1. Build a histogram using \\(\epsilon = 0.1\\) to understand the distribution of the data. This private histogram was then used to generate a synthetic dataset, which was used to choose the privacy budget \\(epsilon=0.2\\) to be used for selecting clamping bound using the Sparse Vector Technique.
Expand Down
2 changes: 1 addition & 1 deletion deployments/safari_energy_drain.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ deployment:
composition: No information was provided about composition.

implementation:
pre_processing_eda_hyperparameter_tuning: 'No hyperperameters are required; no EDA is described'
preprocessing_and_hyperparameter_tuning: 'No hyperperameters are required; no EDA is described'
mechanisms: Private Hadamard Count Mean Sketch (PHCMS)
justification: '"Formal proof, described in Theorem 4.1, Theorem 4.3"'

Expand Down
2 changes: 1 addition & 1 deletion deployments/safety_classifier.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ deployment:
# composition:

# implementation:
# pre_processing_eda_hyperparameter_tuning:
# preprocessing_and_hyperparameter_tuning:
# mechanisms:
# justification:
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/sas_data_maker_vulnerable_persons.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -50,7 +50,7 @@ deployment:
- Group privacy: To account for the one-to-many relationship between Customers and Accounts, the number of accounts per customer is bounded to 5 in the second PrivBayes network model, ensuring privacy loss accounting under group privacy.

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- Preprocessing: |
- discarding PIIs like real account/transaction/merchant IDs, and merchant names; generating random synthetic IDs/names in a similar format
- discretizing numerical data in the Customers and Accounts tables (required for PrivBayes models, which operate on discrete/categorical data); after generation, values are transformed back to numerical by randomly sampling from the discretized bins
Expand Down
2 changes: 1 addition & 1 deletion deployments/shared_mobility_dataset.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace Mechanism
justification: '"All trips were anonymized and aggregated by jointly applying differential privacy via the Laplace mechanism in combination with k-anonymity."'
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/spanish_language_next_word.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ deployment:
composition: The article does not specifically mention composition, only that the final privacy guarantee is rho = 0.81 zCDP. It mentions that training ran for 2000 rounds over six days, and devices participated in training at most once every 24 hours.

implementation:
pre_processing_eda_hyperparameter_tuning: No information is provided about pre-processing steps, EDA, or the process by which hyperparameters (privacy loss parameter or number of training rounds) were tuned.
preprocessing_and_hyperparameter_tuning: No information is provided about pre-processing steps, EDA, or the process by which hyperparameters (privacy loss parameter or number of training rounds) were tuned.
mechanisms: |
- The mechanism is a DP variant of Follow-The-Regularized-Leader (DP-FTRL), which utilizes negatively correlated noise, added by the aggregating server (essentially, adding noise to one gradient and subtracting that same noise from a later gradient) and efficiently implements this using the Tree Aggregation algorithm.
- The mechanism was implemented using Google’s open-source libraries TenserFlow Federated and TensorFlow Privacy.
Expand Down
2 changes: 1 addition & 1 deletion deployments/synth_data_public_use.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: DP GAN*
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/telemetry_collection_windows.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ deployment:
data_source_type: Dynamic
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace, Randomized Rounding
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/uber.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ deployment:
- deployment does not manage privacy budgets
- user can compute overall privacy loss using strong composition bounds on sequential queries
implementation:
pre_processing_eda_hyperparameter_tuning: none described
preprocessing_and_hyperparameter_tuning: none described
mechanisms: |
- The differential privacy algorithm used is bounded epsilon-delta DP
- details:
Expand Down
2 changes: 1 addition & 1 deletion deployments/user_url_privacy.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -39,7 +39,7 @@ deployment:
release_type_description: Static
access_type: Non-interactive
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Laplace, Modified Report Noisy Max
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/vaccine_search_insights.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@ deployment:
release_type_description: Daily
access_type: Non-interactive # TODO: Is this correct?
implementation:
pre_processing_eda_hyperparameter_tuning: '' # TODO: Fill in correct value
preprocessing_and_hyperparameter_tuning: '' # TODO: Fill in correct value
mechanisms: Gaussian
justification: '' # TODO: Fill in correct value
administrative:
Expand Down
2 changes: 1 addition & 1 deletion deployments/wikimedia_current_usage_data.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -49,7 +49,7 @@ deployment:
composition: 'There is no need for composition analysis: The data is partitioned by day, and there is no overlap between days, so the privacy loss does not accumulate.'

implementation:
pre_processing_eda_hyperparameter_tuning: |
preprocessing_and_hyperparameter_tuning: |
- Client-side filtering: Before pageview data is sent to the server, a client-side algorithm annotates each contribution with a boolean flag, which indicates whether the contribution should be included in the server side computation, the criteria being that only the first 10 unique pageviews per user, per day are included. The client uses a salted hash of the page ID to track which pages have already been counted, rather than storing raw identifiers, further reducing fingerprinting risk. This pre-processing step enables user-privacy without sending a user identifier to the server (which would be cookie-based and consistent across days).
- The server determines the list of <page,country> groups for which to release statistics by identifying all pages that have more than a global pageview threshold (which was chosen based on the true data with no DP) and create the cross-product of those pages with a pre-defined list of countries.
- The hyperparameters per-user daily contribution bound, ingestion threshold, and suppression threshold (see “Unprotected Quantities” for details) were selected by computing metrics using the true data. The authors acknowledge that the parameters are not differentially private.
Expand Down
2 changes: 1 addition & 1 deletion deployments/wikimedia_editor_activity_statistics_2023.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -45,7 +45,7 @@ deployment:
# composition: '' # Tier 3

implementation:
# pre_processing_eda_hyperparameter_tuning: '' # Tier 3
# preprocessing_and_hyperparameter_tuning: '' # Tier 3
mechanisms: |
- Laplace Mechanism
- The processing pipelines consists of the following steps:
Expand Down
Loading
Loading