apple-appstore-metadata-extractor 0.1.2__tar.gz

apple_appstore_metadata_extractor-0.1.2/CHANGELOG.md

@@ -0,0 +1,43 @@
+# Changelog
+
+All notable changes to this project will be documented in this file.
+
+The format is based on [Keep a Changelog](https://keepachangelog.com/en/1.0.0/),
+and this project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.html).
+
+## [0.1.2] - 2025-07-29
+
+### Fixed
+- Fixed PyPI publishing workflow to use API token authentication
+- Removed trusted publishing configuration that was causing authentication failures
+
+## [0.1.1] - 2025-07-29
+
+### Fixed
+- Attempted fix for PyPI publishing (incomplete)
+
+## [0.1.0] - 2025-07-29
+
+### Added
+- Initial release of appstore-metadata-extractor
+- Core functionality extracted from the full-stack project
+- iTunes API integration for basic metadata
+- Web scraping for extended metadata
+- Combined extraction mode for comprehensive data
+- CLI with commands: extract, extract-batch, watch
+- Async/concurrent processing support
+- Rate limiting and caching
+- Rich terminal output
+- Comprehensive error handling and retries
+- Type hints throughout the codebase
+- Full test suite with >80% coverage
+
+### Features
+- Extract app metadata from Apple App Store
+- Monitor apps for version changes
+- Batch processing with concurrent requests
+- Multiple output formats (JSON, pretty-print)
+- Configurable extraction modes
+- WBS (What-Boundaries-Success) framework compliance
+
+[0.1.0]: https://github.com/yourusername/appstore-metadata-extractor-python/releases/tag/v0.1.0

apple_appstore_metadata_extractor-0.1.2/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 Bickster LLC
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

apple_appstore_metadata_extractor-0.1.2/MANIFEST.in

@@ -0,0 +1,8 @@
+include README.md
+include LICENSE
+include CHANGELOG.md
+include requirements*.txt
+recursive-include examples *.py *.json
+recursive-include tests *.py
+global-exclude __pycache__
+global-exclude *.py[co]

apple_appstore_metadata_extractor-0.1.2/PKG-INFO

@@ -0,0 +1,298 @@
+Metadata-Version: 2.4
+Name: apple-appstore-metadata-extractor
+Version: 0.1.2
+Summary: Extract and monitor metadata from Apple App Store applications
+Author-email: Bickster LLC <support@bickster.com>
+License: MIT
+Project-URL: Homepage, https://github.com/Bickster-LLC/appstore-metadata-extractor-python
+Project-URL: Documentation, https://github.com/Bickster-LLC/appstore-metadata-extractor-python#readme
+Project-URL: Repository, https://github.com/Bickster-LLC/appstore-metadata-extractor-python
+Project-URL: Issues, https://github.com/Bickster-LLC/appstore-metadata-extractor-python/issues
+Project-URL: Changelog, https://github.com/Bickster-LLC/appstore-metadata-extractor-python/blob/main/CHANGELOG.md
+Keywords: app store,metadata,ios,apple,scraping,monitoring
+Classifier: Development Status :: 4 - Beta
+Classifier: Intended Audience :: Developers
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Programming Language :: Python :: 3.13
+Classifier: Topic :: Software Development :: Libraries
+Classifier: Topic :: Internet :: WWW/HTTP :: Dynamic Content
+Requires-Python: >=3.11
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: requests>=2.31.0
+Requires-Dist: beautifulsoup4>=4.12.0
+Requires-Dist: lxml>=4.9.0
+Requires-Dist: pydantic>=2.5.0
+Requires-Dist: aiohttp>=3.9.0
+Requires-Dist: tenacity>=8.2.0
+Requires-Dist: rich>=13.7.0
+Requires-Dist: click>=8.1.0
+Provides-Extra: dev
+Requires-Dist: pytest>=7.4.0; extra == "dev"
+Requires-Dist: pytest-cov>=4.1.0; extra == "dev"
+Requires-Dist: pytest-asyncio>=0.21.0; extra == "dev"
+Requires-Dist: black>=23.7.0; extra == "dev"
+Requires-Dist: isort>=5.12.0; extra == "dev"
+Requires-Dist: flake8>=6.1.0; extra == "dev"
+Requires-Dist: mypy>=1.5.0; extra == "dev"
+Requires-Dist: pre-commit>=3.3.0; extra == "dev"
+Requires-Dist: types-requests>=2.31.0; extra == "dev"
+Dynamic: license-file
+
+# Apple App Store Metadata Extractor
+
+[![PyPI version](https://badge.fury.io/py/apple-appstore-metadata-extractor.svg)](https://badge.fury.io/py/apple-appstore-metadata-extractor)
+[![Python Support](https://img.shields.io/pypi/pyversions/apple-appstore-metadata-extractor.svg)](https://pypi.org/project/apple-appstore-metadata-extractor/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+Extract and monitor metadata from Apple App Store applications with ease.
+
+## Features
+
+- 📱 **Extract comprehensive app metadata** - title, description, version, ratings, and more
+- 🔄 **Track version changes** - monitor app updates and metadata changes over time
+- 🚀 **Async support** - fast concurrent extraction for multiple apps
+- 💪 **Robust error handling** - automatic retries and graceful error recovery
+- 🛡️ **Rate limiting** - respect API limits and prevent blocking
+- 🎨 **Rich CLI** - beautiful command-line interface with progress tracking
+- 📊 **Multiple output formats** - JSON, pretty-printed, or custom formatting
+
+## Installation
+
+```bash
+pip install apple-appstore-metadata-extractor
+```
+
+## Quick Start
+
+### Command Line
+
+Extract metadata for a single app:
+
+```bash
+appstore-extractor extract https://apps.apple.com/us/app/example/id123456789
+```
+
+Extract from multiple apps:
+
+```bash
+appstore-extractor extract-batch apps.json
+```
+
+Monitor apps for changes:
+
+```bash
+appstore-extractor watch apps.json --interval 3600
+```
+
+### Python Library
+
+```python
+from appstore_metadata_extractor import AppStoreScraper
+
+# Initialize scraper
+scraper = AppStoreScraper()
+
+# Extract single app metadata
+metadata = scraper.extract("https://apps.apple.com/us/app/example/id123456789")
+print(f"App: {metadata.title}")
+print(f"Version: {metadata.version}")
+print(f"Rating: {metadata.rating}")
+
+# Extract multiple apps
+urls = [
+    "https://apps.apple.com/us/app/app1/id111111111",
+    "https://apps.apple.com/us/app/app2/id222222222"
+]
+results = scraper.extract_batch(urls)
+```
+
+### Async Usage
+
+```python
+import asyncio
+from appstore_metadata_extractor import CombinedExtractor
+
+async def main():
+    extractor = CombinedExtractor()
+
+    # Extract single app
+    result = await extractor.extract("https://apps.apple.com/us/app/example/id123456789")
+
+    # Extract multiple apps concurrently
+    urls = ["url1", "url2", "url3"]
+    results = await extractor.extract_batch(urls)
+
+asyncio.run(main())
+```
+
+## CLI Commands
+
+### `extract` - Extract single app metadata
+
+```bash
+appstore-extractor extract [OPTIONS] URL
+
+Options:
+  -o, --output PATH         Output file path
+  -f, --format [json|pretty]  Output format (default: pretty)
+  --no-cache               Disable caching
+  --country TEXT           Country code (default: us)
+```
+
+### `extract-batch` - Extract multiple apps
+
+```bash
+appstore-extractor extract-batch [OPTIONS] INPUT_FILE
+
+Options:
+  -o, --output PATH         Output file path
+  -f, --format [json|pretty]  Output format
+  --concurrent INTEGER     Max concurrent requests (default: 5)
+  --delay FLOAT           Delay between requests in seconds
+```
+
+### `watch` - Monitor apps for changes
+
+```bash
+appstore-extractor watch [OPTIONS] INPUT_FILE
+
+Options:
+  --interval INTEGER       Check interval in seconds (default: 3600)
+  --output-dir PATH       Directory for history files
+  --notify               Enable notifications for changes
+```
+
+## Input File Format
+
+For batch operations, use a JSON file:
+
+```json
+{
+  "apps": [
+    {
+      "name": "Example App 1",
+      "url": "https://apps.apple.com/us/app/example-1/id123456789"
+    },
+    {
+      "name": "Example App 2",
+      "url": "https://apps.apple.com/us/app/example-2/id987654321"
+    }
+  ]
+}
+```
+
+## Advanced Usage
+
+### Custom Extraction Modes
+
+```python
+from appstore_metadata_extractor import CombinedExtractor, ExtractionMode
+
+extractor = CombinedExtractor()
+
+# API-only mode (faster, less data)
+result = await extractor.extract(url, mode=ExtractionMode.API_ONLY)
+
+# Web scraping mode (slower, more complete)
+result = await extractor.extract(url, mode=ExtractionMode.WEB_SCRAPE)
+
+# Combined mode (default - best of both)
+result = await extractor.extract(url, mode=ExtractionMode.COMBINED)
+```
+
+### Rate Limiting Configuration
+
+```python
+from appstore_metadata_extractor import RateLimiter
+
+# Configure custom rate limits
+rate_limiter = RateLimiter(
+    calls_per_minute=20,  # iTunes API limit
+    min_delay=1.0        # Minimum delay between calls
+)
+
+scraper = AppStoreScraper(rate_limiter=rate_limiter)
+```
+
+### Caching
+
+```python
+from appstore_metadata_extractor import CacheManager
+
+# Configure cache
+cache = CacheManager(
+    ttl=300,  # Cache TTL in seconds
+    max_size=1000  # Maximum cache entries
+)
+
+scraper = AppStoreScraper(cache_manager=cache)
+```
+
+## Error Handling
+
+The library provides robust error handling with automatic retries:
+
+```python
+from appstore_metadata_extractor import AppNotFoundError, RateLimitError
+
+try:
+    metadata = scraper.extract(url)
+except AppNotFoundError:
+    print("App not found")
+except RateLimitError:
+    print("Rate limit exceeded, please wait")
+except Exception as e:
+    print(f"Extraction failed: {e}")
+```
+
+## Contributing
+
+Contributions are welcome! Please feel free to submit a Pull Request.
+
+1. Fork the repository
+2. Create your feature branch (`git checkout -b feature/amazing-feature`)
+3. Commit your changes (`git commit -m 'Add amazing feature'`)
+4. Push to the branch (`git push origin feature/amazing-feature`)
+5. Open a Pull Request
+
+## Development
+
+```bash
+# Clone the repository
+git clone https://github.com/yourusername/appstore-metadata-extractor-python.git
+cd appstore-metadata-extractor-python
+
+# Install in development mode
+pip install -e ".[dev]"
+
+# Run tests
+pytest
+
+# Run linting
+black src tests
+isort src tests
+flake8 src tests
+mypy src
+```
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+## Disclaimer
+
+This tool is for educational and research purposes only. Make sure to comply with Apple's Terms of Service and robots.txt when using this tool. Be respectful of rate limits and implement appropriate delays between requests.
+
+## Acknowledgments
+
+- Built with [Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/) for web scraping
+- Uses [Rich](https://github.com/Textualize/rich) for beautiful CLI output
+- Powered by [Pydantic](https://pydantic-docs.helpmanual.io/) for data validation
+
+## Related Projects
+
+For a full-featured solution with web API, authentication, and UI, check out the [parent project](https://github.com/Bickster-LLC/appstore-metadata-extractor).

apple_appstore_metadata_extractor-0.1.2/README.md

@@ -0,0 +1,254 @@
+# Apple App Store Metadata Extractor
+
+[![PyPI version](https://badge.fury.io/py/apple-appstore-metadata-extractor.svg)](https://badge.fury.io/py/apple-appstore-metadata-extractor)
+[![Python Support](https://img.shields.io/pypi/pyversions/apple-appstore-metadata-extractor.svg)](https://pypi.org/project/apple-appstore-metadata-extractor/)
+[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
+
+Extract and monitor metadata from Apple App Store applications with ease.
+
+## Features
+
+- 📱 **Extract comprehensive app metadata** - title, description, version, ratings, and more
+- 🔄 **Track version changes** - monitor app updates and metadata changes over time
+- 🚀 **Async support** - fast concurrent extraction for multiple apps
+- 💪 **Robust error handling** - automatic retries and graceful error recovery
+- 🛡️ **Rate limiting** - respect API limits and prevent blocking
+- 🎨 **Rich CLI** - beautiful command-line interface with progress tracking
+- 📊 **Multiple output formats** - JSON, pretty-printed, or custom formatting
+
+## Installation
+
+```bash
+pip install apple-appstore-metadata-extractor
+```
+
+## Quick Start
+
+### Command Line
+
+Extract metadata for a single app:
+
+```bash
+appstore-extractor extract https://apps.apple.com/us/app/example/id123456789
+```
+
+Extract from multiple apps:
+
+```bash
+appstore-extractor extract-batch apps.json
+```
+
+Monitor apps for changes:
+
+```bash
+appstore-extractor watch apps.json --interval 3600
+```
+
+### Python Library
+
+```python
+from appstore_metadata_extractor import AppStoreScraper
+
+# Initialize scraper
+scraper = AppStoreScraper()
+
+# Extract single app metadata
+metadata = scraper.extract("https://apps.apple.com/us/app/example/id123456789")
+print(f"App: {metadata.title}")
+print(f"Version: {metadata.version}")
+print(f"Rating: {metadata.rating}")
+
+# Extract multiple apps
+urls = [
+    "https://apps.apple.com/us/app/app1/id111111111",
+    "https://apps.apple.com/us/app/app2/id222222222"
+]
+results = scraper.extract_batch(urls)
+```
+
+### Async Usage
+
+```python
+import asyncio
+from appstore_metadata_extractor import CombinedExtractor
+
+async def main():
+    extractor = CombinedExtractor()
+
+    # Extract single app
+    result = await extractor.extract("https://apps.apple.com/us/app/example/id123456789")
+
+    # Extract multiple apps concurrently
+    urls = ["url1", "url2", "url3"]
+    results = await extractor.extract_batch(urls)
+
+asyncio.run(main())
+```
+
+## CLI Commands
+
+### `extract` - Extract single app metadata
+
+```bash
+appstore-extractor extract [OPTIONS] URL
+
+Options:
+  -o, --output PATH         Output file path
+  -f, --format [json|pretty]  Output format (default: pretty)
+  --no-cache               Disable caching
+  --country TEXT           Country code (default: us)
+```
+
+### `extract-batch` - Extract multiple apps
+
+```bash
+appstore-extractor extract-batch [OPTIONS] INPUT_FILE
+
+Options:
+  -o, --output PATH         Output file path
+  -f, --format [json|pretty]  Output format
+  --concurrent INTEGER     Max concurrent requests (default: 5)
+  --delay FLOAT           Delay between requests in seconds
+```
+
+### `watch` - Monitor apps for changes
+
+```bash
+appstore-extractor watch [OPTIONS] INPUT_FILE
+
+Options:
+  --interval INTEGER       Check interval in seconds (default: 3600)
+  --output-dir PATH       Directory for history files
+  --notify               Enable notifications for changes
+```
+
+## Input File Format
+
+For batch operations, use a JSON file:
+
+```json
+{
+  "apps": [
+    {
+      "name": "Example App 1",
+      "url": "https://apps.apple.com/us/app/example-1/id123456789"
+    },
+    {
+      "name": "Example App 2",
+      "url": "https://apps.apple.com/us/app/example-2/id987654321"
+    }
+  ]
+}
+```
+
+## Advanced Usage
+
+### Custom Extraction Modes
+
+```python
+from appstore_metadata_extractor import CombinedExtractor, ExtractionMode
+
+extractor = CombinedExtractor()
+
+# API-only mode (faster, less data)
+result = await extractor.extract(url, mode=ExtractionMode.API_ONLY)
+
+# Web scraping mode (slower, more complete)
+result = await extractor.extract(url, mode=ExtractionMode.WEB_SCRAPE)
+
+# Combined mode (default - best of both)
+result = await extractor.extract(url, mode=ExtractionMode.COMBINED)
+```
+
+### Rate Limiting Configuration
+
+```python
+from appstore_metadata_extractor import RateLimiter
+
+# Configure custom rate limits
+rate_limiter = RateLimiter(
+    calls_per_minute=20,  # iTunes API limit
+    min_delay=1.0        # Minimum delay between calls
+)
+
+scraper = AppStoreScraper(rate_limiter=rate_limiter)
+```
+
+### Caching
+
+```python
+from appstore_metadata_extractor import CacheManager
+
+# Configure cache
+cache = CacheManager(
+    ttl=300,  # Cache TTL in seconds
+    max_size=1000  # Maximum cache entries
+)
+
+scraper = AppStoreScraper(cache_manager=cache)
+```
+
+## Error Handling
+
+The library provides robust error handling with automatic retries:
+
+```python
+from appstore_metadata_extractor import AppNotFoundError, RateLimitError
+
+try:
+    metadata = scraper.extract(url)
+except AppNotFoundError:
+    print("App not found")
+except RateLimitError:
+    print("Rate limit exceeded, please wait")
+except Exception as e:
+    print(f"Extraction failed: {e}")
+```
+
+## Contributing
+
+Contributions are welcome! Please feel free to submit a Pull Request.
+
+1. Fork the repository
+2. Create your feature branch (`git checkout -b feature/amazing-feature`)
+3. Commit your changes (`git commit -m 'Add amazing feature'`)
+4. Push to the branch (`git push origin feature/amazing-feature`)
+5. Open a Pull Request
+
+## Development
+
+```bash
+# Clone the repository
+git clone https://github.com/yourusername/appstore-metadata-extractor-python.git
+cd appstore-metadata-extractor-python
+
+# Install in development mode
+pip install -e ".[dev]"
+
+# Run tests
+pytest
+
+# Run linting
+black src tests
+isort src tests
+flake8 src tests
+mypy src
+```
+
+## License
+
+This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.
+
+## Disclaimer
+
+This tool is for educational and research purposes only. Make sure to comply with Apple's Terms of Service and robots.txt when using this tool. Be respectful of rate limits and implement appropriate delays between requests.
+
+## Acknowledgments
+
+- Built with [Beautiful Soup](https://www.crummy.com/software/BeautifulSoup/) for web scraping
+- Uses [Rich](https://github.com/Textualize/rich) for beautiful CLI output
+- Powered by [Pydantic](https://pydantic-docs.helpmanual.io/) for data validation
+
+## Related Projects
+
+For a full-featured solution with web API, authentication, and UI, check out the [parent project](https://github.com/Bickster-LLC/appstore-metadata-extractor).

apple_appstore_metadata_extractor-0.1.2/examples/apps.json

@@ -0,0 +1,24 @@
+{
+  "apps": [
+    {
+      "name": "GitHub",
+      "url": "https://apps.apple.com/us/app/github/id1477376905"
+    },
+    {
+      "name": "Slack",
+      "url": "https://apps.apple.com/us/app/slack/id618783545"
+    },
+    {
+      "name": "Notion",
+      "url": "https://apps.apple.com/us/app/notion/id1232780281"
+    },
+    {
+      "name": "Spotify",
+      "url": "https://apps.apple.com/us/app/spotify/id324684580"
+    },
+    {
+      "name": "Discord",
+      "url": "https://apps.apple.com/us/app/discord/id985746746"
+    }
+  ]
+}