giga-spatial 0.6.0__py3-none-any.whl → 0.6.2__py3-none-any.whl

{giga_spatial-0.6.0.dist-info → giga_spatial-0.6.2.dist-info}/METADATA

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: giga-spatial
-Version: 0.6.0
+Version: 0.6.2
 Summary: A package for spatial data download & processing
 Home-page: https://github.com/unicef/giga-spatial
 Author: Utku Can Ozturk
@@ -51,32 +51,35 @@ Dynamic: summary
 
 # GigaSpatial
 
-# ![GigaSpatial logo](https://github.com/unicef/giga-spatial/blob/main/docs/assets/logo.png)
+# ![GigaSpatial logo](https://raw.githubusercontent.com/unicef/giga-spatial/main/docs/assets/logo.png)
 Giga is a UNICEF-ITU initiative to connect every school to the Internet and every young person to information, opportunity and choice. 
-Giga maps schools’ Internet access in real time, creates models for innovative financing, and supports governments contracting for connectivity. 
+Giga maps schools' Internet access in real time, creates models for innovative financing, and supports governments contracting for connectivity. 
 
 ---
 
 ## About GigaSpatial
 
-**GigaSpatial** is a Python package developed as part of the Giga Applied Science Team to handle geospatial data efficiently. It provides tools for downloading, processing, and analyzing geospatial data, enabling users to work with datasets such as OpenStreetMap (OSM) and the Global Human Settlement Layer (GHSL). The package is designed to support Giga's mission by providing robust geospatial capabilities for mapping and analyzing school connectivity.
+**GigaSpatial** is a Python package developed as part of the Giga Applied Science Team to handle geospatial data efficiently. It provides tools for downloading, processing, and analyzing geospatial data, enabling users to work with datasets such as OpenStreetMap (OSM), Global Human Settlement Layer (GHSL), Microsoft Global Buildings, Google Open Buildings, and more. The package is designed to support Giga's mission by providing robust geospatial capabilities for mapping and analyzing school connectivity.
 
 ### Key Features
-- **Data Downloading**: Download geospatial data from various sources.
-- **Data Processing**: Process and transform geospatial data, such as GeoTIFF files and vector data.
-- **View Generators**: Enrich the spatial context and map data into grid or POI (Point of Interest) locations.
+- **Data Downloading**: Download geospatial data from various sources including GHSL, Microsoft Global Buildings, Google Open Buildings, OpenCellID, and HDX datasets.
+- **Data Processing**: Process and transform geospatial data, such as GeoTIFF files and vector data, with support for compression and efficient handling.
+- **View Generators**: 
+  - Enrich spatial context with POI (Point of Interest) data
+  - Support for raster point sampling and zonal statistics
+  - Area-weighted aggregation for polygon-based statistics
 - **Grid System**: Create and manipulate grid-based geospatial data for analysis and modeling.
-- **Data Storage**: Store and retrieve geospatial data in various formats.
-- **Configuration Management**: Easily configure paths, API keys, and other settings using environment variables or manual setup.
+- **Data Storage**: Flexible storage options with both local and cloud (ADLS) support.
+- **Configuration Management**: 
+  - Centralized configuration via environment variables or `.env` file
+  - Easy setup of API keys and paths
 
----
-
-## Supported Datasets
+### Supported Datasets
 
 The `gigaspatial` package supports data from the following providers:
 
 <div align="center">
-    <img src="https://github.com/unicef/giga-spatial/blob/main/docs/assets/datasets.png" alt="Dataset Providers" style="width: 70%; height: auto;"/>
+    <img src="https://raw.githubusercontent.com/unicef/giga-spatial/main/docs/assets/datasets.png" alt="Dataset Providers" style="width: 75%; height: auto;"/>
 </div>
 
 ---
@@ -87,20 +90,28 @@ The **view generators** in GigaSpatial are designed to enrich the spatial contex
 
 ### Key Capabilities
 1. **Spatial Context Enrichment**:
-   - Automatic attribution of geospatial variables to school locations.
-   - Contextual layers for environmental, infrastructural, and socioeconomic factors.
-   - Multi-resolution data availability for different analytical needs.
+   - Automatic attribution of geospatial variables to school locations
+   - Contextual layers for environmental, infrastructural, and socioeconomic factors
+   - Multi-resolution data availability for different analytical needs
+   - Support for both point and polygon-based enrichment
 
 2. **Mapping to Grid or POI Locations**:
-   - Map geospatial data to grid cells for scalable analysis.
-   - Map data to POI locations for detailed, location-specific insights.
+   - Map geospatial data to grid cells for scalable analysis
+   - Map data to POI locations for detailed, location-specific insights
+   - Support for chained enrichment using multiple datasets
+   - Built-in support for administrative boundary annotations
 
 ---
 
 ## Why Use GigaSpatial?
-- **Efficient Geospatial Handling**: Streamline the process of downloading, processing, and analyzing geospatial data.
-- **Scalable Analysis**: Map data to grid cells or POI locations for both scalable and detailed insights.
-- **Open Source**: Contribute to and benefit from a collaborative, transparent, and innovative geospatial toolset.
+- **Efficient Geospatial Handling**: Streamline the process of downloading, processing, and analyzing geospatial data
+- **Scalable Analysis**: Map data to grid cells or POI locations for both scalable and detailed insights
+- **Open Source**: Contribute to and benefit from a collaborative, transparent, and innovative geospatial toolset
+- **Modern Architecture**: Built with maintainability and extensibility in mind, featuring:
+  - Base handler orchestration for unified lifecycle management
+  - Dedicated reader classes for major datasets
+  - Modular source resolution for flexible data access
+  - Comprehensive error handling and logging
 
 ## Why Open Source?  
 

{giga_spatial-0.6.0.dist-info → giga_spatial-0.6.2.dist-info}/RECORD

@@ -1,6 +1,6 @@
-giga_spatial-0.6.0.dist-info/licenses/LICENSE,sha256=hIahDEOTzuHCU5J2nd07LWwkLW7Hko4UFO__ffsvB-8,34523
-gigaspatial/__init__.py,sha256=cID1jLnC_vj48GgMN6Yb1FA3JsQ95zNmCHmRYE8TFhY,22
-gigaspatial/config.py,sha256=UC8vjlVUaVaCz_fSu0l3_4O6SOllnkapcpayFvE3TYs,7969
+giga_spatial-0.6.2.dist-info/licenses/LICENSE,sha256=hIahDEOTzuHCU5J2nd07LWwkLW7Hko4UFO__ffsvB-8,34523
+gigaspatial/__init__.py,sha256=jFlbxEJFS0G44LE-yXXVSwXACA1J_NyYDk5E20_2zpc,22
+gigaspatial/config.py,sha256=yMf1ofOU0_I6iKDqshiFSYmK6TDIVpPm1AZo4e2okHU,8166
 gigaspatial/core/__init__.py,sha256=47DEQpj8HBSa-_TImW-5JCeuQeRkm5NMpJWZG3hSuFU,0
 gigaspatial/core/io/__init__.py,sha256=y4QNWx6US1-adTuAO_NZwLmjzSQj25HNDL5hUGvEHZc,263
 gigaspatial/core/io/adls_data_store.py,sha256=Zv-D_8d_2h57HnCUTJb0JWWjXqR_0XH4F8Nu_UFZK9E,11975
@@ -21,8 +21,8 @@ gigaspatial/grid/__init__.py,sha256=H8SnNAMDafJXJ9bUp2zU0Z3t6s8niqY5rGP5nFhnbLA,
 gigaspatial/grid/mercator_tiles.py,sha256=Z_3M4sy1tyxywAo2wmBb6niBP3x-IWgwMkmUp8LOSDg,10492
 gigaspatial/handlers/__init__.py,sha256=gh6LIzqr2fASX4fEzQ20v1j_IhnYpym-lcgOkAGHrdE,1430
 gigaspatial/handlers/base.py,sha256=rL94c3wDjsqzLp4na8FfYXW6tNjVGX6v4M-Ce4LrAro,26413
-gigaspatial/handlers/boundaries.py,sha256=184Ytmf3eBWR-BKcuAUDSg8MJSrcPw0L17qLIkUwxHI,11071
-gigaspatial/handlers/ghsl.py,sha256=EgFbrqh9Sb86dx4LlOXU804zi-yRCUqqSZWmmvxkRuU,27747
+gigaspatial/handlers/boundaries.py,sha256=hoO-b5MlFYwlCWogApcFyEx6OnxMJG29lqJurNGwOWg,11260
+gigaspatial/handlers/ghsl.py,sha256=YTXuhjSjNMl11nmgd6ZOtVMsJGg2PxDcZn4pu8aaypc,27749
 gigaspatial/handlers/giga.py,sha256=2aP1EenDAQXn-h-uCyuVxEVZvAFEvrL17_z0MiS8FDs,4867
 gigaspatial/handlers/google_open_buildings.py,sha256=Liqk7qJhDtB4Ia4uhBe44LFcf-XVKBjRfj-pWlE5erY,16594
 gigaspatial/handlers/hdx.py,sha256=8VAEHfO8UgvEx6_Xdx0_vNsPqO18z5Iiq6TjuEbg05k,8789
@@ -41,7 +41,7 @@ gigaspatial/processing/geo.py,sha256=D-S3IlhQwLIxrCcxy6NhNmKLrOIjoRHfK_eZJGKpe2U
 gigaspatial/processing/sat_images.py,sha256=YUbH5MFNzl6NX49Obk14WaFcr1s3SyGJIOk-kRpbBNg,1429
 gigaspatial/processing/tif_processor.py,sha256=4qCNx6ODtVsYm6lbSToIdUCrduIrPsWFBAABTQ2Vs24,17259
 gigaspatial/processing/utils.py,sha256=HC85vGKQakxlkoQAkZmeAXWHsenAwTIRn7jPKUA7x20,1500
-giga_spatial-0.6.0.dist-info/METADATA,sha256=aiay3xH1NKvaG4NlKw_IYoES1jNnNZk1P_5mxXjr2uY,6297
-giga_spatial-0.6.0.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
-giga_spatial-0.6.0.dist-info/top_level.txt,sha256=LZsccgw6H4zXT7m6Y4XChm-Y5LjHAwZ2hkGN_B3ExmI,12
-giga_spatial-0.6.0.dist-info/RECORD,,
+giga_spatial-0.6.2.dist-info/METADATA,sha256=PXfUtURxAxnej1IDhF3MGbOOdC8MYgsGtRHHTiPjQSQ,7104
+giga_spatial-0.6.2.dist-info/WHEEL,sha256=_zCd3N1l69ArxyTb8rzEoP9TpbYXkqRFSNOD5OuxnTs,91
+giga_spatial-0.6.2.dist-info/top_level.txt,sha256=LZsccgw6H4zXT7m6Y4XChm-Y5LjHAwZ2hkGN_B3ExmI,12
+giga_spatial-0.6.2.dist-info/RECORD,,

gigaspatial/__init__.py

@@ -1 +1 @@
-__version__ = "0.6.0"
+__version__ = "0.6.2"

gigaspatial/config.py

@@ -33,6 +33,12 @@ class Config(BaseSettings):
         default="", alias="GIGA_SCHOOL_LOCATION_API_KEY"
     )
 
+    ROOT_DATA_DIR: Path = Field(
+        default=Path("."),
+        description="Root directory for all data tiers",
+        alias="ROOT_DATA_DIR",
+    )
+
     BRONZE_DATA_DIR: Path = Field(
         default=Path("bronze"),
         description="Root directory for raw/bronze tier data",
@@ -129,12 +135,12 @@ class Config(BaseSettings):
                 f"Invalid tier: {tier}. Must be one of 'bronze', 'silver', 'gold', or 'views'."
             )
 
-        base_dir = getattr(self, f"{tier.upper()}_DATA_DIR")
+        tier_dir = getattr(self, f"{tier.upper()}_DATA_DIR")
         type_dir = self.DATA_TYPES[data_type]
         if version:
-            return base_dir / type_dir / version
+            return self.ROOT_DATA_DIR / tier_dir / type_dir / version
         else:
-            return base_dir / type_dir
+            return self.ROOT_DATA_DIR / tier_dir / type_dir
 
     def get_admin_path(
         self,

gigaspatial/handlers/boundaries.py

@@ -230,19 +230,22 @@ class AdminBoundaries(BaseModel):
         elif country_code is not None:
             from gigaspatial.handlers.unicef_georepo import GeoRepoClient
 
-            client = GeoRepoClient()
-
-            if client.check_connection():
-                cls.logger.info("GeoRepo connection successful.")
-                return cls.from_georepo(
-                    iso3_code,
-                    admin_level=admin_level,
-                )
-            else:
+            try:
+                client = GeoRepoClient()
+                if client.check_connection():
+                    cls.logger.info("GeoRepo connection successful.")
+                    return cls.from_georepo(
+                        iso3_code,
+                        admin_level=admin_level,
+                    )
+            except ValueError as e:
                 cls.logger.warning(
-                    "GeoRepo connection check failed. Falling back to GADM."
+                    f"GeoRepo initialization failed: {str(e)}. Falling back to GADM."
                 )
-                return cls.from_gadm(iso3_code, admin_level, **kwargs)
+            except Exception as e:
+                cls.logger.warning(f"GeoRepo error: {str(e)}. Falling back to GADM.")
+
+            return cls.from_gadm(iso3_code, admin_level, **kwargs)
         else:
             raise ValueError(
                 "Either country_code or (data_store, path) must be provided."

gigaspatial/handlers/ghsl.py

@@ -74,7 +74,7 @@ class GHSLDataConfig(BaseHandlerConfig):
 
     def __post_init__(self):
         super().__post_init__()
-        self.TILES_URL = self.TILES_URL.format(self.coord_system)
+        self.TILES_URL = self.TILES_URL.format(self.coord_system.value)
         self._load_tiles()
 
     def _load_tiles(self):
@@ -375,10 +375,9 @@ class GHSLDataDownloader(BaseHandlerDownloader):
 
                 for file in files_to_extract:
                     extracted_path = output_path.parent / Path(file).name
-                    with zip_ref.open(file) as source, open(
-                        extracted_path, "wb"
-                    ) as target:
-                        shutil.copyfileobj(source, target)
+                    with zip_ref.open(file) as source:
+                        file_content = source.read()
+                        self.data_store.write_file(str(extracted_path), file_content)
                     extracted_files.append(extracted_path)
                     self.logger.info(f"Extracted {file} to {extracted_path}")