Difference between revisions of "Metrics"

From Open Food Facts wiki
Jump to navigation Jump to search
(Created page with "An InfluxDB/Grafana stack has been set up to be able to follow essential metrics for Open Food Facts team. The dashboards can be viewed at https://metrics.openfoodfacts.org....")
 
Line 13: Line 13:
  
 
Columns:
 
Columns:
* time: timestamp of the datapoint.
 
 
* annotation: annotation status of the insight, either 0, -1, 1 or <nil>.
 
* annotation: annotation status of the insight, either 0, -1, 1 or <nil>.
 
* automatic_processing: whether the insight will be (or has been) automatically processed, either "True" or "False".
 
* automatic_processing: whether the insight will be (or has been) automatically processed, either "True" or "False".
Line 21: Line 20:
 
* count: the number of insights with the previous characteristics.
 
* count: the number of insights with the previous characteristics.
 
* percent: the % of insights with the previous characteristics, over the total number of insights.
 
* percent: the % of insights with the previous characteristics, over the total number of insights.
 +
 +
=== facets ===
 +
Save metrics about Product Opener facets, using public facet API.
 +
 +
Current saved facets:
 +
 +
* ingredients-analysis
 +
* data-quality
 +
* ingredients
 +
* states
 +
* misc
 +
 +
Columns:
 +
 +
* country: the ISO 2-letter code of the country (ISO_3166-1 alpha-2), or "world" for metrics on the full database. Only a selected subset of country is available.
 +
* facet: the name of the facet (`ingredients-analysis`, `data-quality`,...)
 +
* tag_name: name of the tag
 +
* tag_id: identifier of the tag (ex: `en:alcoholic-beverages-category-without-alcohol-value`), this is the field you will probably have to use
 +
* products: number of products with the given tag
 +
* percent: % of products with the given tag over the total number of product for the country

Revision as of 12:24, 9 January 2023

An InfluxDB/Grafana stack has been set up to be able to follow essential metrics for Open Food Facts team. The dashboards can be viewed at https://metrics.openfoodfacts.org.

This is different from monitoring

There is currently a single InfluxDB bucket (=similar to SQL database) off_metrics.

There are two measurements (=similar to SQL table): facets and insights.

insights

Save metrics about Robotoff product_insight PostgreSQL table. The export is performed daily at night time by Robotoff.

Columns:

  • annotation: annotation status of the insight, either 0, -1, 1 or <nil>.
  • automatic_processing: whether the insight will be (or has been) automatically processed, either "True" or "False".
  • predictor: the predictor of the insight (=model or method that generated the insight)
  • reserved_barcode: either "False" or "True", if True the product barcode is a reserved barcode, mostly used for variable weight products
  • type: the insight type, see InsightType class in Robotoff codebase for a complete list.
  • count: the number of insights with the previous characteristics.
  • percent: the % of insights with the previous characteristics, over the total number of insights.

facets

Save metrics about Product Opener facets, using public facet API.

Current saved facets:

  • ingredients-analysis
  • data-quality
  • ingredients
  • states
  • misc

Columns:

  • country: the ISO 2-letter code of the country (ISO_3166-1 alpha-2), or "world" for metrics on the full database. Only a selected subset of country is available.
  • facet: the name of the facet (`ingredients-analysis`, `data-quality`,...)
  • tag_name: name of the tag
  • tag_id: identifier of the tag (ex: `en:alcoholic-beverages-category-without-alcohol-value`), this is the field you will probably have to use
  • products: number of products with the given tag
  • percent: % of products with the given tag over the total number of product for the country