greenmining 1.1.8__tar.gz → 1.1.9__tar.gz

{greenmining-1.1.8 → greenmining-1.1.9}/CHANGELOG.md

@@ -1,6 +1,6 @@
 # Changelog
 
-## [1.1.8] - 2026-01-31
+## [1.1.9] - 2026-01-31
 
 ### Removed
 - Web dashboard module (`greenmining/dashboard/`) and Flask dependency

{greenmining-1.1.8/greenmining.egg-info → greenmining-1.1.9}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: greenmining
-Version: 1.1.8
+Version: 1.1.9
 Summary: An empirical Python library for Mining Software Repositories (MSR) in Green IT research
 Author-email: Adam Bouafia <a.bouafia@student.vu.nl>
 License: MIT
@@ -70,7 +70,7 @@ An empirical Python library for Mining Software Repositories (MSR) in Green IT r
 
 - **Mine repositories at scale** - Search, Fetch and analyze GitHub repositories via GraphQL API with configurable filters
 
-- **Classify green commits** - Detect 122 sustainability patterns from the Green Software Foundation (GSF) catalog
+- **Classify green commits** - Detect 124 sustainability patterns from the Green Software Foundation (GSF) catalog
 - **Analyze any repository by URL** - Direct Git-based analysis with support for private repositories
 - **Measure energy consumption** - RAPL, CodeCarbon, and CPU Energy Meter backends for power profiling
 - **Carbon footprint reporting** - CO2 emissions calculation with 20+ country profiles and cloud region support
@@ -113,7 +113,7 @@ docker pull adambouafia/greenmining:latest
 from greenmining import GSF_PATTERNS, is_green_aware, get_pattern_by_keywords
 
 # Check available patterns
-print(f"Total patterns: {len(GSF_PATTERNS)}")  # 122 patterns across 15 categories
+print(f"Total patterns: {len(GSF_PATTERNS)}")  # 124 patterns across 15 categories
 
 # Detect green awareness in commit messages
 commit_msg = "Optimize Redis caching to reduce energy consumption"
@@ -670,8 +670,8 @@ config = Config(
 
 ### Core Capabilities
 
-- **Pattern Detection**: 122 sustainability patterns across 15 categories from the GSF catalog
-- **Keyword Analysis**: 321 green software detection keywords
+- **Pattern Detection**: 124 sustainability patterns across 15 categories from the GSF catalog
+- **Keyword Analysis**: 332 green software detection keywords
 - **Repository Fetching**: GraphQL API with date, star, and language filters
 - **URL-Based Analysis**: Direct Git-based analysis from GitHub URLs (HTTPS and SSH)
 - **Batch Processing**: Parallel analysis of multiple repositories with configurable workers
@@ -739,7 +739,7 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 
 ### Pattern Database
 
-**122 green software patterns based on:**
+**124 green software patterns based on:**
 - Green Software Foundation (GSF) Patterns Catalog
 - VU Amsterdam 2024 research on ML system sustainability
 - ICSE 2024 conference papers on sustainable software
@@ -749,11 +749,11 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 - **Coverage**: 67% of patterns actively detect in real-world commits
 - **Accuracy**: 100% true positive rate for green-aware commits
 - **Categories**: 15 distinct sustainability domains covered
-- **Keywords**: 321 detection terms across all patterns
+- **Keywords**: 332 detection terms across all patterns
 
 ## GSF Pattern Categories
 
-**122 patterns across 15 categories:**
+**124 patterns across 15 categories:**
 
 ### 1. Cloud (40 patterns)
 Auto-scaling, serverless computing, right-sizing instances, region selection for renewable energy, spot instances, idle resource detection, cloud-native architectures

{greenmining-1.1.8 → greenmining-1.1.9}/README.md

@@ -13,7 +13,7 @@ An empirical Python library for Mining Software Repositories (MSR) in Green IT r
 
 - **Mine repositories at scale** - Search, Fetch and analyze GitHub repositories via GraphQL API with configurable filters
 
-- **Classify green commits** - Detect 122 sustainability patterns from the Green Software Foundation (GSF) catalog
+- **Classify green commits** - Detect 124 sustainability patterns from the Green Software Foundation (GSF) catalog
 - **Analyze any repository by URL** - Direct Git-based analysis with support for private repositories
 - **Measure energy consumption** - RAPL, CodeCarbon, and CPU Energy Meter backends for power profiling
 - **Carbon footprint reporting** - CO2 emissions calculation with 20+ country profiles and cloud region support
@@ -56,7 +56,7 @@ docker pull adambouafia/greenmining:latest
 from greenmining import GSF_PATTERNS, is_green_aware, get_pattern_by_keywords
 
 # Check available patterns
-print(f"Total patterns: {len(GSF_PATTERNS)}")  # 122 patterns across 15 categories
+print(f"Total patterns: {len(GSF_PATTERNS)}")  # 124 patterns across 15 categories
 
 # Detect green awareness in commit messages
 commit_msg = "Optimize Redis caching to reduce energy consumption"
@@ -613,8 +613,8 @@ config = Config(
 
 ### Core Capabilities
 
-- **Pattern Detection**: 122 sustainability patterns across 15 categories from the GSF catalog
-- **Keyword Analysis**: 321 green software detection keywords
+- **Pattern Detection**: 124 sustainability patterns across 15 categories from the GSF catalog
+- **Keyword Analysis**: 332 green software detection keywords
 - **Repository Fetching**: GraphQL API with date, star, and language filters
 - **URL-Based Analysis**: Direct Git-based analysis from GitHub URLs (HTTPS and SSH)
 - **Batch Processing**: Parallel analysis of multiple repositories with configurable workers
@@ -682,7 +682,7 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 
 ### Pattern Database
 
-**122 green software patterns based on:**
+**124 green software patterns based on:**
 - Green Software Foundation (GSF) Patterns Catalog
 - VU Amsterdam 2024 research on ML system sustainability
 - ICSE 2024 conference papers on sustainable software
@@ -692,11 +692,11 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 - **Coverage**: 67% of patterns actively detect in real-world commits
 - **Accuracy**: 100% true positive rate for green-aware commits
 - **Categories**: 15 distinct sustainability domains covered
-- **Keywords**: 321 detection terms across all patterns
+- **Keywords**: 332 detection terms across all patterns
 
 ## GSF Pattern Categories
 
-**122 patterns across 15 categories:**
+**124 patterns across 15 categories:**
 
 ### 1. Cloud (40 patterns)
 Auto-scaling, serverless computing, right-sizing instances, region selection for renewable energy, spot instances, idle resource detection, cloud-native architectures

{greenmining-1.1.8 → greenmining-1.1.9}/greenmining/__init__.py

@@ -9,7 +9,7 @@ from greenmining.gsf_patterns import (
     is_green_aware,
 )
 
-__version__ = "1.1.8"
+__version__ = "1.1.9"
 
 
 def fetch_repositories(

{greenmining-1.1.8 → greenmining-1.1.9}/greenmining/controllers/repository_controller.py

@@ -1,4 +1,9 @@
-# Repository Controller - Handles repository fetching operations.
+# Repository Controller - Handles repository fetching + cloning operations.
+import os
+import re
+import shutil
+from pathlib import Path
+from typing import List, Dict
 
 from greenmining.config import Config
 from greenmining.models.repository import Repository
@@ -13,23 +18,81 @@ class RepositoryController:
         # Initialize controller with configuration.
         self.config = config
         self.graphql_fetcher = GitHubGraphQLFetcher(config.GITHUB_TOKEN)
-
-    def fetch_repositories(
-        self,
-        max_repos: int = None,
-        min_stars: int = None,
-        languages: list[str] = None,
-        keywords: str = None,
-        created_after: str = None,
-        created_before: str = None,
-        pushed_after: str = None,
-        pushed_before: str = None,
-    ) -> list[Repository]:
+        self.repos_dir = Path.cwd() / "greenmining_repos"
+
+    def _sanitize_repo_name(self, repo: Repository, index: int = 0) -> str:
+        """Safe unique dir name: owner_repo[_index]. Handles case collisions."""
+        base = re.sub(r'[^a-z0-9-]', '_', repo.full_name.replace('/', '_').lower())
+        name = f"{base}_{index}" if index else base
+        path = self.repos_dir / name
+        counter = 1
+        while path.exists():
+            name = f"{base}_{counter}"
+            path = self.repos_dir / name
+            counter += 1
+        return name
+
+    def clone_repositories(
+        self, 
+        repositories: List[Repository], 
+        github_token: str = None,
+        cleanup: bool = True,
+        depth: int = 1  # Shallow clone
+    ) -> List[Dict]:
+        """Clone repos to ./greenmining_repos/ with unique sanitized names."""
+        self.repos_dir.mkdir(exist_ok=True)
+        if cleanup:
+            shutil.rmtree(self.repos_dir, ignore_errors=True)
+            self.repos_dir.mkdir(exist_ok=True)
+            colored_print(f"Cleaned {self.repos_dir}", "yellow")
+
+        results = []
+        for i, repo in enumerate(repositories, 1):
+            safe_name = self._sanitize_repo_name(repo, i)
+            clone_path = self.repos_dir / safe_name
+            
+            colored_print(f"[{i}/{len(repositories)}] Cloning {repo.full_name} → {safe_name}", "cyan")
+            
+            url = f"https://{github_token}@github.com/{repo.full_name}.git" if github_token else repo.url
+            cmd = ["git", "clone", f"--depth={depth}", "-v", url, str(clone_path)]
+            
+            import subprocess
+            try:
+                subprocess.check_call(cmd, cwd=self.repos_dir.parent)
+                colored_print(f"{safe_name}", "green")
+                results.append({
+                    "full_name": repo.full_name,
+                    "local_path": str(clone_path),
+                    "success": True
+                })
+            except subprocess.CalledProcessError as e:
+                colored_print(f"{safe_name}: {e}", "red")
+                results.append({
+                    "full_name": repo.full_name,
+                    "local_path": str(clone_path),
+                    "success": False,
+                    "error": str(e)
+                })
+
+        # Save map for analyze_repositories
+        save_json_file(results, self.repos_dir / "clone_results.json")
+        success_rate = sum(1 for r in results if r["success"]) / len(results) * 100
+        colored_print(f"Cloned: {success_rate:.1f}% ({self.repos_dir}/clone_results.json)", "green")
+        return results
+
+
+
+
+
+    def fetch_repositories(self, max_repos: int = None, min_stars: int = None,
+                          languages: list[str] = None, keywords: str = None,
+                          created_after: str = None, created_before: str = None,
+                          pushed_after: str = None, pushed_before: str = None) -> list[Repository]:
         # Fetch repositories from GitHub using GraphQL API.
         max_repos = max_repos or self.config.MAX_REPOS
         min_stars = min_stars or self.config.MIN_STARS
         languages = languages or self.config.SUPPORTED_LANGUAGES
-        keywords = keywords or "microservices"
+        keywords = keywords 
 
         colored_print(f"Fetching up to {max_repos} repositories...", "cyan")
         colored_print(f"   Keywords: {keywords}", "cyan")

{greenmining-1.1.8 → greenmining-1.1.9/greenmining.egg-info}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: greenmining
-Version: 1.1.8
+Version: 1.1.9
 Summary: An empirical Python library for Mining Software Repositories (MSR) in Green IT research
 Author-email: Adam Bouafia <a.bouafia@student.vu.nl>
 License: MIT
@@ -70,7 +70,7 @@ An empirical Python library for Mining Software Repositories (MSR) in Green IT r
 
 - **Mine repositories at scale** - Search, Fetch and analyze GitHub repositories via GraphQL API with configurable filters
 
-- **Classify green commits** - Detect 122 sustainability patterns from the Green Software Foundation (GSF) catalog
+- **Classify green commits** - Detect 124 sustainability patterns from the Green Software Foundation (GSF) catalog
 - **Analyze any repository by URL** - Direct Git-based analysis with support for private repositories
 - **Measure energy consumption** - RAPL, CodeCarbon, and CPU Energy Meter backends for power profiling
 - **Carbon footprint reporting** - CO2 emissions calculation with 20+ country profiles and cloud region support
@@ -113,7 +113,7 @@ docker pull adambouafia/greenmining:latest
 from greenmining import GSF_PATTERNS, is_green_aware, get_pattern_by_keywords
 
 # Check available patterns
-print(f"Total patterns: {len(GSF_PATTERNS)}")  # 122 patterns across 15 categories
+print(f"Total patterns: {len(GSF_PATTERNS)}")  # 124 patterns across 15 categories
 
 # Detect green awareness in commit messages
 commit_msg = "Optimize Redis caching to reduce energy consumption"
@@ -670,8 +670,8 @@ config = Config(
 
 ### Core Capabilities
 
-- **Pattern Detection**: 122 sustainability patterns across 15 categories from the GSF catalog
-- **Keyword Analysis**: 321 green software detection keywords
+- **Pattern Detection**: 124 sustainability patterns across 15 categories from the GSF catalog
+- **Keyword Analysis**: 332 green software detection keywords
 - **Repository Fetching**: GraphQL API with date, star, and language filters
 - **URL-Based Analysis**: Direct Git-based analysis from GitHub URLs (HTTPS and SSH)
 - **Batch Processing**: Parallel analysis of multiple repositories with configurable workers
@@ -739,7 +739,7 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 
 ### Pattern Database
 
-**122 green software patterns based on:**
+**124 green software patterns based on:**
 - Green Software Foundation (GSF) Patterns Catalog
 - VU Amsterdam 2024 research on ML system sustainability
 - ICSE 2024 conference papers on sustainable software
@@ -749,11 +749,11 @@ print(f"Equivalent: {report.tree_months:.2f} tree-months to offset")
 - **Coverage**: 67% of patterns actively detect in real-world commits
 - **Accuracy**: 100% true positive rate for green-aware commits
 - **Categories**: 15 distinct sustainability domains covered
-- **Keywords**: 321 detection terms across all patterns
+- **Keywords**: 332 detection terms across all patterns
 
 ## GSF Pattern Categories
 
-**122 patterns across 15 categories:**
+**124 patterns across 15 categories:**
 
 ### 1. Cloud (40 patterns)
 Auto-scaling, serverless computing, right-sizing instances, region selection for renewable energy, spot instances, idle resource detection, cloud-native architectures

{greenmining-1.1.8 → greenmining-1.1.9}/pyproject.toml

@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
 
 [project]
 name = "greenmining"
-version = "1.1.8"
+version = "1.1.9"
 description = "An empirical Python library for Mining Software Repositories (MSR) in Green IT research"
 readme = "README.md"
 requires-python = ">=3.9"