@digital4better/data 1.3.38 → 1.3.40

package/README.md

@@ -1,132 +1,165 @@
 # Digital4Better Open Data
 
-This repository contains the geographic and environmental data used by Digital4Better to calculate the footprints of digital services.
+Open datasets maintained by Digital4Better to describe the environmental footprint of digital services, cloud infrastructure, electricity systems, and AI models.
 
-This data is also used by the calculation engine of fruggr (www.fruggr.io), a service that automates the evaluation of the footprints of digital services.
+This repository is meant to be used as a data source, not as developer documentation. The main audience is analysts, sustainability teams, researchers, product teams, and anyone who needs reusable reference data in `JSON` or `CSV`.
 
-Each file is produced/generated in CSV and JSON format.
+These reference datasets are used, among other things, by [fruggr](https://www.fruggr.io), Digital4Better's platform for measuring and managing the environmental footprint of digital services.
 
-## Country data (country)
+## What You Can Find Here
 
-### Geographical regions (regions.csv)
+The repository is organized as a set of reusable data collections:
 
-This data is used to generate administrative data and to compute distances between regions.
+| Collection | What it covers | Main files |
+| --- | --- | --- |
+| [`data/ai`](./data/ai) | AI model catalog across vendors and cloud providers | `models.json` |
+| [`data/cloud`](./data/cloud) | Cloud regions, virtual machines, CPUs, accelerators | `*-regions.*`, `*-vms.*`, `cpus.*`, `accelerators.*` |
+| [`data/country`](./data/country) | Countries, regions, continents, and distance referentials | `regions.*`, `countries.*`, `continents.*`, `*-distances.*` |
+| [`data/energy`](./data/energy) | Environmental impacts of electricity production technologies | `energy-impacts.*` |
+| [`data/mix`](./data/mix) | Electricity mix by geography and time period | `world-*`, `continent-*`, `country-*`, `subdivision-*` |
+| [`data/factor`](./data/factor) | Electricity impact factors derived from energy mix data | `world-*`, `continent-*`, `country-*`, `subdivision-*` |
+| [`data/equipment`](./data/equipment) | Equipment energy and embodied impact reference data | `energy.*`, `embodied.*` |
 
-| Field       | Description                       |
-|-------------|-----------------------------------|
-| name        | Country name                      |
-| alpha-2     | ISO 3166-1 alpha-2 country code   |
-| alpha-3     | ISO 3166-1 alpha-3 country code   |
-| continent   | Region continent                  |
-| subdivision | ISO 3166-2 country subdivision    |
-| type        | continent, country or subdivision |
-| area        | Area                              |
-| lat         | Latitude                          |
-| lon         | Longitude                         |
+## Why This Repository Exists
 
-### Administrative data (countries.csv)
+These datasets are used to:
 
-This data is used to map data and to distribute impact factors (see Impact factors) by continent.
+- estimate the environmental footprint of digital services
+- compare cloud infrastructure options across providers and regions
+- model electricity-related impacts by country, continent, or subdivision
+- enrich internal or public sustainability dashboards
+- document AI models and their characteristics in a structured way
 
-| Field     | Description                     |
-|-----------|---------------------------------|
-| name      | Country name                    |
-| alpha-2   | ISO 3166-1 alpha-2 country code |
-| alpha-3   | ISO 3166-1 alpha-3 country code |
-| continent | Country continent               |
+## Highlights
 
-### Distances from country to country (country-to-country-distances)
+### AI Models
 
-This data can be used to determine the distance traveled by data on the network between a user and a datacenter located in different countries.
+The AI catalog in [`data/ai/models.json`](./data/ai/models.json) documents model families from providers such as OpenAI, Anthropic, Google, Mistral, Meta, Qwen, DeepSeek, Amazon, Cohere, and others.
 
-The distance is calculated between the baricenters in each country.
+This makes it useful for market mapping, observatories, governance, and cloud/AI portfolio analysis.
 
-| Field       | Description         |
-|-------------|---------------------|
-| origin      | Origin country      |
-| destination | Destination country |
-| distance    | Distance (km)       |
+Main source families:
 
-### Distances from region to region (region-to-region-distances)
+- cloud provider catalogs such as [AWS Bedrock](https://docs.aws.amazon.com/bedrock/latest/userguide/models-supported.html), [Azure AI Foundry](https://ai.azure.com/catalog/models/), [Google Cloud Vertex AI](https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/use-partner-models), [OVHcloud AI Endpoints](https://www.ovhcloud.com/en/public-cloud/ai-endpoints/catalog/), and [Scaleway Generative APIs](https://www.scaleway.com/en/docs/generative-apis/reference-content/supported-models/)
+- official model vendor documentation such as [OpenAI](https://platform.openai.com/docs/models), [Anthropic](https://docs.anthropic.com/en/docs/about-claude/models/overview), [Mistral](https://docs.mistral.ai/getting-started/models/), [Qwen](https://qwen.ai/), and [DeepSeek](https://api-docs.deepseek.com/)
+- model cards and open model hubs such as [Hugging Face](https://huggingface.co/)
+- technical reports and synthesis sources such as [LifeArchitect](https://lifearchitect.ai/models-table/) and [ApXML Models](https://apxml.com/models/)
 
-This data can be used to determine the distance traveled by data on the network between a user and a datacenter located in different countries or country subdivisions.
+### Cloud Infrastructure
 
-The distance is calculated between the baricenters in each country / subdivision.
+The cloud referentials in [`data/cloud`](./data/cloud) provide structured information for major providers including AWS, Azure, GCP, Oracle Cloud Infrastructure, OVHcloud, and Scaleway.
 
-| Field       | Description                       |
-|-------------|-----------------------------------|
-| origin      | Origin country / subdivision      |
-| destination | Destination country / subdivision |
-| distance    | Distance (km)                     |
+Typical use cases:
 
-### Average distance from a user to a datacenter (user-to-datacenter-distances.csv)
+- mapping regions and datacenter footprints
+- comparing VM families and hardware characteristics
+- linking compute infrastructure to sustainability calculations
 
-These data represent a rough estimate for each country of the average distance traveled by data on a network between a user and a datacenter.
+Main source families:
 
-| Field    | Description                     |
-|----------|---------------------------------|
-| alpha-2  | ISO 3166-1 alpha-2 country code |
-| distance | Distance (km)                   |
+- provider region and infrastructure documentation from [AWS](https://aws.amazon.com/about-aws/global-infrastructure/regions_az/), [Microsoft Azure](https://azure.microsoft.com/en-us/explore/global-infrastructure/geographies/), [Google Cloud](https://cloud.google.com/compute/docs/regions-zones), [Oracle Cloud Infrastructure](https://docs.oracle.com/en-us/iaas/Content/General/Concepts/regions.htm), [OVHcloud](https://eco.ovhcloud.com/en-ie/our-commitments/global-infrastructure/), and [Scaleway](https://www.scaleway.com/en/docs/console/my-project/how-to/view-the-list-of-scaleway-regions-and-availability-zones/)
+- manufacturer and hardware reference sources for CPUs and accelerators
+- provider sustainability disclosures used for `pue`, `wue`, and `ref`, including [AWS regional PUE/WUE](https://sustainability.aboutamazon.com/aws-wue-pue.csv), Microsoft regional fact sheets via [datacenters.microsoft.com](https://datacenters.microsoft.com/sustainability/efficiency/), [Google Cloud regional CFE%](https://cloud.google.com/sustainability/region-carbon), Oracle's [Corporate Citizenship Report](https://www.oracle.com/a/ocom/docs/corporate/citizenship/oracle-corp-citizenship-report-3941904.pdf), [OVHcloud FY25 KPIs](https://www.ovhcloud.com/sites/default/files/external_files/kpis_fy25.pdf) and [methodology note](https://corporate.ovhcloud.com/sites/default/files/2025-10/methodology_-_environmental_impact_tracker_fr.pdf), and Scaleway's [calculation reference values](https://www.scaleway.com/en/docs/environmental-footprint/additional-content/calculation-values-reference/) and [impact reports](https://www-uploads.scaleway.com/Impact_Report2024_A4_EN_9a7bd88445.pdf)
 
-## Impacts of ICT equipment manufacturing (embodied)
+Current cloud assumptions kept in the datasets:
 
-The environmental impacts associated with the manufacture of each of these equipment categories : mobile, desktop, network mobile, network fixed, vm small, vm medium, vm large. 
+- `aws`: `pue` and `wue` come from the 2024 AWS regional CSV; `ref` stays at `0` because AWS public renewable matching disclosures are not used as a region-level factor in this referential
+- `azure`: values come from Microsoft regional fact sheets, combining still-live PDFs with previously curated factsheet values for regions whose older PDFs are no longer publicly retrievable
+- `gcp`: `ref` comes from regional `CFE%`; `wue` comes from previously derived values based on Google environmental reporting and is kept until Google publishes a clearer general regional water metric
+- `oracle`: use a uniform `pue = 1.07` and provisional `wue = 0` until OCI publishes region-level metrics
+- `ovhcloud`: follow FY25 KPI values for `pue`, `wue`, and `ref`
+- `scaleway`: values come from documented datacenter figures, completed where needed with the provider's impact reports
 
-### Environmental impact (equipment-impacts)
+### Electricity Mix And Impact Factors
 
-| Impact  | Unit       | Description                                                     |
-|---------|------------|-----------------------------------------------------------------|
-| ADPe    | kg Sb-Eq   | Abiotic Depletion Potential (Resource use, minerals and metals) |
-| AP      | kg SO2-Eq  | Acidification Power                                             |
-| CTUe    | CTUe       | Comparative Toxic Unit (Ecotoxicity, freshwater)                |
-| CTUh-c  | CTUh       | Comparative Toxic Unit (Human, cancer)                          |
-| CTUh-nc | CTUh       | Comparative Toxic Unit (Human, non-cancer)                      |
-| GWP     | kg CO2-Eq  | Global Warming Potential (Climate change)                       |
-| IR      | kg U235-Eq | Ionising Radiation (human health)                               |
-| PM      | Disease    | Particulate Matter emission                                     |
-| WU      | m3 Water   | Water use                                                       |
+The datasets in [`data/mix`](./data/mix) and [`data/factor`](./data/factor) help translate electricity consumption into environmental impacts.
 
-## Impacts of energy production (energy)
+They are available at several levels:
 
-The environmental impacts associated with each of these energy production technologies: coal, gas, other fossil fuels, wind, solar, bioenergy, hydropower, other renewables, nuclear.
+- world
+- continent
+- country
+- subdivision
 
-### Environmental impact (energy-impacts)
+And across different time granularities:
 
-| Impact  | Unit       | Description                                                     |
-|---------|------------|-----------------------------------------------------------------|
-| ADPe    | kg Sb-Eq   | Abiotic Depletion Potential (Resource use, minerals and metals) |
-| AP      | kg SO2-Eq  | Acidification Power                                             |
-| CTUe    | CTUe       | Comparative Toxic Unit (Ecotoxicity, freshwater)                |
-| CTUh-c  | CTUh       | Comparative Toxic Unit (Human, cancer)                          |
-| CTUh-nc | CTUh       | Comparative Toxic Unit (Human, non-cancer)                      |
-| GWP     | kg CO2-Eq  | Global Warming Potential (Climate change)                       |
-| IR      | kg U235-Eq | Ionising Radiation (human health)                               |
-| PM      | Disease    | Particulate Matter emission                                     |
-| WU      | m3 Water   | Water use                                                       |
+- yearly
+- monthly
 
-### Source 
+Green-only variants are also available through files ending with `-green`.
 
-The impact data for each electricity generation technology per kWh come from various bibliographical sources. Due to the scarcity of such data in a global scope, an extrapolation is made and these values are generalized in our model.
+Main source families:
 
-Source : Life cycle assessment of electricity generation options, UNECE 2021 (1) et https://www.sciencedirect.com/science/article/pii/S0196890422008159#b0530 (2)
+- electricity generation data from [Ember monthly electricity data](https://ember-climate.org/data-catalogue/monthly-electricity-data/) and [Ember yearly electricity data](https://ember-climate.org/data-catalogue/yearly-electricity-data/)
+- impact factors built from lifecycle assessment literature, including [UNECE 2021 - Life cycle assessment of electricity generation options](https://unece.org/sed/documents/2021/10/reports/life-cycle-assessment-electricity-generation-options) and related academic work such as [this Energy paper](https://www.sciencedirect.com/science/article/pii/S0196890422008159#b0530)
 
-## Impact factors (factor)
+### Geography And Distances
 
-These data represent the environmental impact factors of one kWh of electricity consumption (not production) in each country, continent or worldwide.
-The amount of energy imported by each country is taken into account to adjust these factors.
+The datasets in [`data/country`](./data/country) provide geographic referentials used to map countries, continents, subdivisions, and estimated network distances.
 
-### Data generation
+Typical use cases:
 
-Impact factors are determined by country according to the national energy mix, as well as the environmental impacts associated with each of energy production sources (see Environmental impacts).
+- geographic normalization
+- country and subdivision mapping
+- rough estimation of distances between users, countries, regions, and datacenters
 
-Factors are generated on an annual and monthly basis starting in January 2019.
+Main source families:
 
-Files ending with the suffix `-green` contain impact factors for green energies only (bioenergy, hydro, solar and wind).
+- ISO country and subdivision standards
+- internally maintained geographic referentials used to derive administrative mappings and distance approximations
 
-### Source
+### Equipment Reference Data
 
-Our energy mix data for all countries are taken from https://ember-climate.org/.
+The datasets in [`data/equipment`](./data/equipment) provide reference values for embodied impacts and operational energy of common digital equipment categories.
 
-- Monthly : https://ember-climate.org/data-catalogue/monthly-electricity-data/
-- Yearly : https://ember-climate.org/data-catalogue/yearly-electricity-data/
+Typical use cases:
 
+- footprint modeling at equipment level
+- simplified lifecycle modeling for digital services
+- comparative analysis of device or infrastructure categories
+
+Main source families:
+
+- Digital4Better internal modeling inputs
+- lifecycle assessment literature and equipment reference datasets used for sustainability calculations
+
+## Formats
+
+Most collections are published in both formats:
+
+- `JSON` for structured or nested data
+- `CSV` for tabular exploration, spreadsheets, and BI tools
+
+If a collection is only available in one format, it is usually because that format is the most natural one for the data structure.
+
+## Quick Navigation
+
+- AI models: [`data/ai/models.json`](./data/ai/models.json)
+- Cloud regions: [`data/cloud`](./data/cloud)
+- Country and region referentials: [`data/country`](./data/country)
+- Energy impacts: [`data/energy/energy-impacts.json`](./data/energy/energy-impacts.json)
+- Electricity mix: [`data/mix`](./data/mix)
+- Electricity factors: [`data/factor`](./data/factor)
+- Equipment data: [`data/equipment`](./data/equipment)
+
+## Notes On Data Quality
+
+This repository aims to provide transparent and reusable reference data, but some values should be interpreted with care.
+
+- Some fields are derived from public documentation, model cards, technical reports, or literature rather than official disclosures.
+- Some collections include explicit uncertainty markers such as `estimated`.
+- AI and cloud catalogs evolve quickly, so historical and legacy entries may coexist with current ones.
+- Environmental factors are based on a mix of primary data, literature, and modeling assumptions.
+
+When available, source URLs are kept directly in the data files themselves.
+
+## Related Links
+
+- GitHub repository: [digital4better/data](https://github.com/digital4better/data)
+- Digital4Better: [digital4better.com](https://digital4better.com)
+- fruggr: [fruggr.io](https://www.fruggr.io)
+- Contributing guide: [CONTRIBUTING.md](./CONTRIBUTING.md)
+
+## License
+
+This repository is published under the [ODC Open Database License (ODbL)](./LICENCE).

package/data/cloud/accelerators.csv

@@ -36,3 +36,4 @@ nvidia-tesla-t4,gpu,nvidia,tesla,t4,turing,2560,16,70,12,545,13600
 nvidia-tesla-v10016,gpu,nvidia,tesla,v100,volta,5120,16,250,12,815,21100
 nvidia-tesla-v10032,gpu,nvidia,tesla,v100,volta,5120,32,250,12,815,21100
 qualcomm-ai100-standard,asic,qualcomm,ai100,standard,cloud ai,16,16,75,7,0,0
+amd-radeon-mi355x,gpu,amd,radeon,mi355x,instinct,,288,,,,

package/data/cloud/accelerators.json

@@ -516,5 +516,14 @@
     "process": 7,
     "die": 0,
     "transistors": 0
+  },
+  {
+    "id": "amd-radeon-mi355x",
+    "type": "gpu",
+    "manufacturer": "amd",
+    "serie": "radeon",
+    "model": "mi355x",
+    "platform": "instinct",
+    "memory": 288
   }
 ]

package/data/cloud/aws-regions.csv

@@ -1,33 +1,33 @@
 id,name,provider,lat,lon,location,country,subdivision,pue,wue,ref
-af-south-1,af-south-1,aws,-33.93,18.42,Cape Town,za,,1.135,0.18,0
-ap-east-1,ap-east-1,aws,22.27,114.16,Hong Kong,hk,,1.135,0.18,0
-ap-south-1,ap-south-1,aws,19.08,72.88,Mumbai,in,,1.135,0.18,0
-ap-south-2,ap-south-2,aws,17.387,78.492,Hyderabad,in,,1.135,0.18,0
-ap-northeast-1,ap-south-1,aws,35.41,139.42,Tokyo,jp,,1.135,0.18,0
-ap-northeast-2,ap-northeast-2,aws,37.56,126.98,Seoul,kr,,1.135,0.18,0
-ap-northeast-3,ap-northeast-3,aws,34.69,135.49,Osaka,jp,,1.135,0.18,0
-ap-southeast-1,ap-southeast-1,aws,1.37,103.8,Singapore,sg,,1.135,0.18,0
-ap-southeast-2,ap-southeast-2,aws,-33.86,151.2,Sydney,au,,1.135,0.18,0
-ap-southeast-3,ap-southeast-3,aws,-6.2,106.817,Jakarta,id,,1.135,0.18,0
-ap-southeast-4,ap-southeast-4,aws,-37.841,144.946,Melbourne,au,,1.135,0.18,0
-ap-southeast-5,ap-southeast-5,aws,3.141,101.693,Malaysia,my,,1.135,0.18,0
-ca-central-1,ca-central-1,aws,45.5,-73.6,Montreal,ca,qc,1.135,0.18,0
-ca-west-1,ca-west-1,aws,51.05,-114.067,Calgary,ca,ab,1.135,0.18,0
-cn-north-1,cn-north-1,aws,40,116.4,Beijing,cn,,1.135,0.18,0
-cn-northwest-1,cn-northwest-1,aws,37,106,Ningxia,cn,,1.135,0.18,0
-eu-central-1,eu-central-1,aws,50,8,Frankfurt,de,,1.135,0.18,0
-eu-central-2,eu-central-2,aws,47.451542,8.564572,Zurich,ch,,1.135,0.18,0
-eu-north-1,eu-north-1,aws,59.25,17.81,Stockholm,se,,1.135,0.18,0
-eu-south-1,eu-south-1,aws,45.43,9.29,Milan,it,,1.135,0.18,0
-eu-south-2,eu-south-2,aws,41.65,-0.89,Zaragoza,es,,1.135,0.18,0
-eu-west-1,eu-west-1,aws,53,-8,Dublin,ie,,1.135,0.18,0
-eu-west-2,eu-west-2,aws,51,-0.1,London,gb,,1.135,0.18,0
-eu-west-3,eu-west-3,aws,48.86,2.35,Paris,fr,,1.135,0.18,0
-il-central-1,il-central-1,aws,32.085,34.782,Tel Aviv,il,,1.135,0.18,0
-me-central-1,me-central-1,aws,24.466667,54.366669,Abu Dhabi,ae,,1.135,0.18,0
-me-south-1,me-south-1,aws,26.1,50.46,Bahrain,bh,,1.135,0.18,0
-sa-east-1,sa-east-1,aws,-23.34,-46.38,Sao Paulo,br,,1.135,0.18,0
-us-east-1,us-east-1,aws,38.13,-78.45,Ashburn,us,va,1.135,0.18,0
-us-east-2,us-east-2,aws,39.96,-83,Hilliard,us,oh,1.135,0.18,0
-us-west-1,us-west-1,aws,37.35,-121.96,San Jose,us,ca,1.135,0.18,0
-us-west-2,us-west-2,aws,46.15,-123.88,Madras,us,or,1.135,0.18,0
+af-south-1,af-south-1,aws,-33.93,18.42,Cape Town,za,,1.24,0.15,0
+ap-east-1,ap-east-1,aws,22.27,114.16,Hong Kong,hk,,1.15,0.15,0
+ap-south-1,ap-south-1,aws,19.08,72.88,Mumbai,in,,1.42,0.15,0
+ap-south-2,ap-south-2,aws,17.387,78.492,Hyderabad,in,,1.46,0.15,0
+ap-northeast-1,ap-south-1,aws,35.41,139.42,Tokyo,jp,,1.27,0.91,0
+ap-northeast-2,ap-northeast-2,aws,37.56,126.98,Seoul,kr,,1.15,0.15,0
+ap-northeast-3,ap-northeast-3,aws,34.69,135.49,Osaka,jp,,1.15,0.15,0
+ap-southeast-1,ap-southeast-1,aws,1.37,103.8,Singapore,sg,,1.32,1.68,0
+ap-southeast-2,ap-southeast-2,aws,-33.86,151.2,Sydney,au,,1.15,0.12,0
+ap-southeast-3,ap-southeast-3,aws,-6.2,106.817,Jakarta,id,,1.4,2.75,0
+ap-southeast-4,ap-southeast-4,aws,-37.841,144.946,Melbourne,au,,1.15,0.02,0
+ap-southeast-5,ap-southeast-5,aws,3.141,101.693,Malaysia,my,,1.15,0.15,0
+ca-central-1,ca-central-1,aws,45.5,-73.6,Montreal,ca,qc,1.19,0.04,0
+ca-west-1,ca-west-1,aws,51.05,-114.067,Calgary,ca,ab,1.17,0.08,0
+cn-north-1,cn-north-1,aws,40,116.4,Beijing,cn,,1.15,0.15,0
+cn-northwest-1,cn-northwest-1,aws,37,106,Ningxia,cn,,1.25,0.15,0
+eu-central-1,eu-central-1,aws,50,8,Frankfurt,de,,1.35,0.01,0
+eu-central-2,eu-central-2,aws,47.451542,8.564572,Zurich,ch,,1.15,0.15,0
+eu-north-1,eu-north-1,aws,59.25,17.81,Stockholm,se,,1.1,0.02,0
+eu-south-1,eu-south-1,aws,45.43,9.29,Milan,it,,1.15,0.15,0
+eu-south-2,eu-south-2,aws,41.65,-0.89,Zaragoza,es,,1.09,0.24,0
+eu-west-1,eu-west-1,aws,53,-8,Dublin,ie,,1.11,0.03,0
+eu-west-2,eu-west-2,aws,51,-0.1,London,gb,,1.15,0.15,0
+eu-west-3,eu-west-3,aws,48.86,2.35,Paris,fr,,1.15,0.15,0
+il-central-1,il-central-1,aws,32.085,34.782,Tel Aviv,il,,1.15,0.15,0
+me-central-1,me-central-1,aws,24.466667,54.366669,Abu Dhabi,ae,,1.27,0.15,0
+me-south-1,me-south-1,aws,26.1,50.46,Bahrain,bh,,1.33,0.15,0
+sa-east-1,sa-east-1,aws,-23.34,-46.38,Sao Paulo,br,,1.17,0.23,0
+us-east-1,us-east-1,aws,39.043719,-77.48749,Ashburn,us,va,1.15,0.12,0
+us-east-2,us-east-2,aws,39.96,-83,Hilliard,us,oh,1.13,0.1,0
+us-west-1,us-west-1,aws,37.35,-121.96,San Jose,us,ca,1.18,0.51,0
+us-west-2,us-west-2,aws,46.15,-123.88,Madras,us,or,1.12,0.16,0