insta2table 0.1.0__tar.gz

insta2table-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 S. Kashyap
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

insta2table-0.1.0/MANIFEST.in

@@ -0,0 +1,3 @@
+include LICENSE
+include README.md
+recursive-include examples *.txt

insta2table-0.1.0/PKG-INFO

@@ -0,0 +1,86 @@
+Metadata-Version: 2.4
+Name: insta2table
+Version: 0.1.0
+Summary: Fetch Instagram captions (with optional OCR) and convert them to a normalized table via Gemini.
+Author: S. Kashyap
+License: MIT License
+Project-URL: Homepage, https://github.com/Sk1499/insta2table
+Project-URL: Issues, https://github.com/Sk1499/insta2table/issues
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: pandas>=2.0
+Requires-Dist: tqdm>=4.66
+Requires-Dist: tenacity>=8.2
+Requires-Dist: python-dotenv>=1.0
+Requires-Dist: instaloader>=4.12
+Requires-Dist: requests>=2.31
+Provides-Extra: ocr
+Requires-Dist: pytesseract>=0.3.10; extra == "ocr"
+Requires-Dist: Pillow>=10.0; extra == "ocr"
+Provides-Extra: genai
+Requires-Dist: langchain>=0.2.0; extra == "genai"
+Requires-Dist: langchain-google-genai>=2.0.0; extra == "genai"
+Dynamic: license-file
+
+# insta2table
+
+[![CI](https://github.com/Sk1499/insta2table/actions/workflows/ci.yml/badge.svg)](https://github.com/Sk1499/insta2table/actions)
+[![PyPI version](https://img.shields.io/pypi/v/insta2table.svg)](https://pypi.org/project/insta2table/)
+
+
+A tiny toolkit to:
+1. **Crawl Instagram links** from a text file, extract captions and (optionally) **OCR** text from images → `output.csv`
+2. **Convert** those rows into a clean **single-row table** per link using **Gemini** → `result.csv`
+
+> Credentials & keys via env:
+> - `IG_USER`, `IG_PASS` (optional): for Instaloader login (reduces 403s)
+> - `GOOGLE_API_KEY`: required for Gemini
+
+## Quickstart
+
+```bash
+# 1) (Recommended) Create and activate a virtualenv
+python -m venv .venv
+# Linux/macOS
+source .venv/bin/activate
+# Windows (PowerShell)
+# .venv\Scripts\Activate.ps1
+
+# 2) Install (with OCR & Gemini extras if you need them)
+pip install -e .[ocr,genai]
+
+# 3) Prepare links
+cp examples/links.txt .
+
+# 4) Crawl -> output.csv
+export IG_USER="your_user"
+export IG_PASS="your_pass"
+insta2csv --links links.txt --out output.csv
+
+# 5) Process with Gemini -> result.csv
+export GOOGLE_API_KEY="your_key"
+insta2table --in output.csv --out result.csv
+```
+
+## CLI
+
+```bash
+insta2csv --links links.txt --out output.csv [--no-ocr]
+insta2table --in output.csv --out result.csv
+```
+
+## Notes
+- OCR requires Tesseract installed on your system if you opt in.
+- Instagram scraping without login can trigger 403s. Supplying IG credentials helps.
+- Gemini formatting expects a single-row Markdown table per input.
+
+
+## Publishing
+
+We use **trusted publishing** from GitHub to PyPI (no API token needed).
+
+1. Create the project on PyPI (only first time) and enable **'Manage publishing'** with GitHub OIDC for your repo.
+2. In GitHub: create a new Release with a tag like `v0.1.0`.
+3. The **Publish to PyPI** workflow will build and upload the release automatically.
+4. Alternatively (manual): `make build` then `twine upload dist/*` (requires a PyPI token).

insta2table-0.1.0/README.md

@@ -0,0 +1,61 @@
+# insta2table
+
+[![CI](https://github.com/Sk1499/insta2table/actions/workflows/ci.yml/badge.svg)](https://github.com/Sk1499/insta2table/actions)
+[![PyPI version](https://img.shields.io/pypi/v/insta2table.svg)](https://pypi.org/project/insta2table/)
+
+
+A tiny toolkit to:
+1. **Crawl Instagram links** from a text file, extract captions and (optionally) **OCR** text from images → `output.csv`
+2. **Convert** those rows into a clean **single-row table** per link using **Gemini** → `result.csv`
+
+> Credentials & keys via env:
+> - `IG_USER`, `IG_PASS` (optional): for Instaloader login (reduces 403s)
+> - `GOOGLE_API_KEY`: required for Gemini
+
+## Quickstart
+
+```bash
+# 1) (Recommended) Create and activate a virtualenv
+python -m venv .venv
+# Linux/macOS
+source .venv/bin/activate
+# Windows (PowerShell)
+# .venv\Scripts\Activate.ps1
+
+# 2) Install (with OCR & Gemini extras if you need them)
+pip install -e .[ocr,genai]
+
+# 3) Prepare links
+cp examples/links.txt .
+
+# 4) Crawl -> output.csv
+export IG_USER="your_user"
+export IG_PASS="your_pass"
+insta2csv --links links.txt --out output.csv
+
+# 5) Process with Gemini -> result.csv
+export GOOGLE_API_KEY="your_key"
+insta2table --in output.csv --out result.csv
+```
+
+## CLI
+
+```bash
+insta2csv --links links.txt --out output.csv [--no-ocr]
+insta2table --in output.csv --out result.csv
+```
+
+## Notes
+- OCR requires Tesseract installed on your system if you opt in.
+- Instagram scraping without login can trigger 403s. Supplying IG credentials helps.
+- Gemini formatting expects a single-row Markdown table per input.
+
+
+## Publishing
+
+We use **trusted publishing** from GitHub to PyPI (no API token needed).
+
+1. Create the project on PyPI (only first time) and enable **'Manage publishing'** with GitHub OIDC for your repo.
+2. In GitHub: create a new Release with a tag like `v0.1.0`.
+3. The **Publish to PyPI** workflow will build and upload the release automatically.
+4. Alternatively (manual): `make build` then `twine upload dist/*` (requires a PyPI token).

insta2table-0.1.0/examples/links.txt

@@ -0,0 +1,4 @@
+https://www.instagram.com/p/CxxExample1/
+https://www.instagram.com/reel/CyyExample2/
+https://www.instagram.com/your_favorite_place/
+https://google.com/

insta2table-0.1.0/pyproject.toml

@@ -0,0 +1,37 @@
+[build-system]
+requires = ["setuptools>=68", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "insta2table"
+version = "0.1.0"
+description = "Fetch Instagram captions (with optional OCR) and convert them to a normalized table via Gemini."
+readme = "README.md"
+requires-python = ">=3.9"
+license = {text = "MIT License"}
+authors = [{name = "S. Kashyap"}]
+dependencies = [
+  "pandas>=2.0",
+  "tqdm>=4.66",
+  "tenacity>=8.2",
+  "python-dotenv>=1.0",
+  "instaloader>=4.12",
+  "requests>=2.31"
+]
+
+[project.optional-dependencies]
+ocr = ["pytesseract>=0.3.10", "Pillow>=10.0"]
+genai = ["langchain>=0.2.0", "langchain-google-genai>=2.0.0"]
+
+[project.scripts]
+insta2csv = "insta2table.cli:crawl"
+insta2table = "insta2table.cli:process"
+
+[tool.setuptools]
+package-dir = {"" = "src"}
+
+[tool.setuptools.packages.find]
+where = ["src"]
+[project.urls]
+Homepage = "https://github.com/Sk1499/insta2table"
+Issues = "https://github.com/Sk1499/insta2table/issues"

insta2table-0.1.0/setup.cfg

@@ -0,0 +1,7 @@
+[tool:pytest]
+addopts = -q
+
+[egg_info]
+tag_build = 
+tag_date = 0
+

insta2table-0.1.0/src/insta2table/__init__.py

@@ -0,0 +1,7 @@
+"""
+insta2table
+-----------
+Fetch Instagram captions (with optional OCR) and convert them to a normalized table via Gemini.
+"""
+__all__ = ["crawler", "processor"]
+__version__ = "0.1.1"

insta2table-0.1.0/src/insta2table/cli.py

@@ -0,0 +1,38 @@
+from __future__ import annotations
+import argparse, logging, os
+from .crawler import crawl_links
+from .processor import process_csv
+
+logging.basicConfig(level=os.getenv("INSTA2TABLE_LOG","INFO"))
+
+def crawl(argv=None):
+    p = argparse.ArgumentParser(description="Crawl Instagram links -> output.csv")
+    p.add_argument("--links", required=True, help="Path to links.txt (one URL per line)")
+    p.add_argument("--out", default="output.csv", help="Path to write output CSV")
+    p.add_argument("--no-ocr", action="store_true", help="Disable OCR")
+    p.add_argument("--proxies-file", help="Path to a file with proxies (one per line)")
+    p.add_argument("--user-agents-file", help="Path to a file with user agents (one per line)")
+    p.add_argument("--proxy", action='append', help="Provide a proxy (can be used multiple times). Example: http://user:pass@1.2.3.4:3128")
+    p.add_argument("--user-agent", action='append', help="Provide a user-agent (can be used multiple times).")
+    args = p.parse_args(argv)
+    proxies = None
+    user_agents = None
+    if args.proxy:
+        proxies = args.proxy
+    if args.user_agent:
+        user_agents = args.user_agent
+    # Files override env if provided via CLI
+    if args.proxies_file:
+        os.environ['PROXIES_FILE'] = args.proxies_file
+    if args.user_agents_file:
+        os.environ['USER_AGENTS_FILE'] = args.user_agents_file
+    out = crawl_links(args.links, args.out, do_ocr=not args.no_ocr, proxies=proxies, user_agents=user_agents)
+    print(out)
+
+def process(argv=None):
+    p = argparse.ArgumentParser(description="Convert output.csv to result.csv using Gemini")
+    p.add_argument("--in", dest="in_csv", required=True, help="Input CSV from insta2csv")
+    p.add_argument("--out", dest="out_csv", default="result.csv", help="Path to write result CSV")
+    args = p.parse_args(argv)
+    out = process_csv(args.in_csv, args.out_csv)
+    print(out)

insta2table-0.1.0/src/insta2table/crawler.py

@@ -0,0 +1,224 @@
+from __future__ import annotations
+import os, csv, io, logging, requests
+from typing import List
+from dataclasses import dataclass
+from .utils import classify_url, safe_sleep
+
+from itertools import cycle
+from typing import Iterable, Optional, Iterator
+import random
+import itertools
+
+def _read_list_from_file(path: Optional[str]) -> list:
+    if not path:
+        return []
+    p = Path(path)
+    if not p.exists():
+        return []
+    return [line.strip() for line in p.read_text(encoding="utf-8").splitlines() if line.strip()]
+
+def _coerce_list(env_var: Optional[str]) -> list:
+    if not env_var:
+        return []
+    # Accept comma-separated lists or newline separated
+    items = [i.strip() for i in env_var.replace("\\r","").split(",") if i.strip()]
+    if len(items) == 1 and "\\n" in env_var:
+        items = [i.strip() for i in env_var.splitlines() if i.strip()]
+    return items
+
+def _make_cycle(items: Iterable[str]) -> Iterator[str]:
+    items = list(items) or [None]
+    # If only one item and None, cycle will yield None allowing caller to skip proxies/UA when None.
+    return cycle(items)
+
+def _apply_to_instaloader_session(L, user_agent: Optional[str], proxy: Optional[str]):
+    """
+    Apply user-agent & proxy settings to an Instaloader session if available.
+    We try to update L.context._session (requests.Session) headers & proxies.
+    """
+    try:
+        if getattr(L, 'context', None) and hasattr(L.context, '_session'):
+            sess = getattr(L.context, '_session')
+            if user_agent:
+                sess.headers.update({'User-Agent': user_agent})
+            if proxy:
+                sess.proxies.update({'http': proxy, 'https': proxy})
+    except Exception:
+        pass
+
+
+log = logging.getLogger("insta2table")
+
+try:
+    import instaloader
+except Exception as e:
+    instaloader = None
+    log.warning("Instaloader not available: %s", e)
+
+# Optional OCR deps
+try:
+    from PIL import Image
+    import pytesseract
+except Exception:
+    Image = None
+    pytesseract = None
+
+@dataclass
+class Row:
+    url: str
+    category: str
+    caption: str = ""
+    image_urls: str = ""
+    image_text: str = ""
+    image_count: int = 0
+    error: str = ""
+
+def _login_loader():
+    if instaloader is None:
+        return None
+    L = instaloader.Instaloader(download_pictures=False, download_comments=False, save_metadata=False, compress_json=False)
+    user = os.getenv("IG_USER")
+    pw = os.getenv("IG_PASS")
+    if user and pw:
+        try:
+            L.login(user, pw)
+            log.info("Logged into Instagram as %s", user)
+        except Exception as e:
+            log.warning("Login failed; continuing unauthenticated: %s", e)
+    return L
+
+def _fetch_post(L, shortcode: str):
+    try:
+        return instaloader.Post.from_shortcode(L.context, shortcode)
+    except Exception as e:
+        log.debug("Failed fetching shortcode %s: %s", shortcode, e)
+        return None
+
+def _gather_image_urls(post) -> List[str]:
+    urls = []
+    try:
+        if post.typename == "GraphSidecar":
+            for node in post.get_sidecar_nodes():
+                if not node.is_video and node.display_url:
+                    urls.append(node.display_url)
+        else:
+            if not post.is_video and getattr(post, "url", None):
+                urls.append(post.url)
+    except Exception as e:
+        log.debug("Error collecting image URLs: %s", e)
+    return urls
+
+def _ocr_images(urls: List[str]) -> str:
+    # uses outer ua_cycle/proxy_cycle if available (rotates per image)
+    if not urls or Image is None or pytesseract is None:
+        return ""
+    texts = []
+    for u in urls:
+        try:
+            hdrs = {}
+            try:
+                ua = next(ua_cycle)
+            except Exception:
+                ua = None
+            try:
+                proxy = next(proxy_cycle)
+            except Exception:
+                proxy = None
+            if ua:
+                hdrs['User-Agent'] = ua
+            kwargs = {'timeout': 30}
+            if hdrs:
+                kwargs['headers'] = hdrs
+            if proxy:
+                kwargs['proxies'] = {'http': proxy, 'https': proxy}
+            r = requests.get(u, **kwargs)
+            r.raise_for_status()
+            img = Image.open(io.BytesIO(r.content))
+            txt = pytesseract.image_to_string(img)
+            if txt:
+                texts.append(txt.strip())
+        except Exception:
+            continue
+    return " || ".join(t.strip() for t in texts if t.strip())
+
+def crawl_links(links_path: str, out_csv: str, do_ocr: bool = True, proxies: Optional[Iterable[str]] = None, user_agents: Optional[Iterable[str]] = None) -> str:
+    """
+    Read links from file, fetch caption & image URLs (and optionally OCR), write CSV.
+    Returns the output CSV path.
+    """
+    L = _login_loader() if instaloader else None
+
+    # Prepare proxy & user-agent cycles. Sources (in priority):
+    # 1) explicit args passed to crawl_links
+    # 2) environment variables PROXIES and USER_AGENTS (comma-separated)
+    # 3) files referenced by PROXIES_FILE / USER_AGENTS_FILE in env (newline separated)
+    proxies_list = list(proxies) if proxies else _coerce_list(os.getenv("PROXIES"))
+    # fallbacks from files
+    if not proxies_list and os.getenv("PROXIES_FILE"):
+        proxies_list = _read_list_from_file(os.getenv("PROXIES_FILE"))
+    user_agents_list = list(user_agents) if user_agents else _coerce_list(os.getenv("USER_AGENTS"))
+    if not user_agents_list and os.getenv("USER_AGENTS_FILE"):
+        user_agents_list = _read_list_from_file(os.getenv("USER_AGENTS_FILE"))
+
+    proxy_cycle = _make_cycle([p for p in proxies_list if p])
+    ua_cycle = _make_cycle([u for u in user_agents_list if u])
+
+    rows: List[Row] = []
+    with open(links_path, "r", encoding="utf-8") as f:
+        for raw in f:
+            url = raw.strip()
+            if not url:
+                continue
+            category, shortcode = classify_url(url)
+            if category in ("not-instagram", "insta-page"):
+                rows.append(Row(url=url, category=category))
+                continue
+            caption = ""
+            image_urls = []
+            image_text = ""
+            image_count = 0
+            error = ""
+            post = None
+            if shortcode and L:
+                # rotate UA & proxy for this fetch
+                try:
+                    ua = next(ua_cycle)
+                except Exception:
+                    ua = None
+                try:
+                    proxy = next(proxy_cycle)
+                except Exception:
+                    proxy = None
+                _apply_to_instaloader_session(L, ua, proxy)
+                post = _fetch_post(L, shortcode)
+            if post is None and category != "not-instagram":
+                error = "failed to fetch (unauthenticated or invalid link)"
+            else:
+                try:
+                    caption = (post.caption or "").strip()
+                    image_urls = _gather_image_urls(post)
+                    image_count = len(image_urls) if image_urls else (0 if post.is_video else 1)
+                    if do_ocr:
+                        image_text = _ocr_images(image_urls)
+                except Exception as e:
+                    error = str(e)
+            rows.append(Row(
+                url=url,
+                category=category,
+                caption=caption,
+                image_urls=";".join(image_urls) if image_urls else "",
+                image_text=image_text,
+                image_count=image_count,
+                error=error
+            ))
+            safe_sleep(0.5)
+
+    fieldnames = ["url","category","caption","image_urls","image_text","image_count","error"]
+
+    with open(out_csv, "w", newline="", encoding="utf-8-sig") as f:
+        import csv as _csv
+        w = _csv.DictWriter(f, fieldnames=fieldnames)
+        w.writeheader()
+        for r in rows:
+            w.writerow({k:getattr(r,k) for k in fieldnames})
+    return out_csv

insta2table-0.1.0/src/insta2table/processor.py

@@ -0,0 +1,77 @@
+from __future__ import annotations
+import os, csv, logging
+from typing import List
+from tenacity import retry, stop_after_attempt, wait_fixed
+
+log = logging.getLogger("insta2table")
+
+PROMPT = """You are given data from an Instagram link.
+Summarize into ONE single-row Markdown table with EXACTLY these columns:
+| Place | City | Country | Category | Brief Description | Social Media / Website |
+
+If information is missing, leave that cell blank. Do not add extra rows or text.
+Content:
+CAPTION: {caption}
+OCR_TEXT: {image_text}
+URL: {url}
+"""
+
+def _get_llm():
+    api_key = os.getenv("GOOGLE_API_KEY")
+    if not api_key:
+        raise RuntimeError("GOOGLE_API_KEY is required for processing with Gemini.")
+    from langchain_google_genai import ChatGoogleGenerativeAI
+    return ChatGoogleGenerativeAI(model="gemini-2.5-flash", api_key=api_key)
+
+@retry(stop=stop_after_attempt(3), wait=wait_fixed(1))
+def _call_llm(llm, url: str, caption: str, image_text: str) -> str:
+    prompt = PROMPT.format(url=url, caption=caption or "", image_text=image_text or "")
+    resp = llm.invoke(prompt)
+    text = getattr(resp, "content", None) or str(resp)
+    return text.strip()
+
+def _parse_single_row_table(md: str) -> List[str]:
+    lines = [l.rstrip() for l in md.splitlines() if l.strip()]
+    start = None
+    for i,l in enumerate(lines):
+        if l.strip().startswith("|") and "Place" in l and "Country" in l:
+            start = i
+            break
+    if start is None or start+2 >= len(lines):
+        raise ValueError("No valid markdown table header found.")
+    data_line = lines[start+2] if lines[start+1].strip().startswith("|-") else lines[start+1]
+    cells = [c.strip() for c in data_line.strip("|").split("|")]
+    if len(cells) != 6:
+        raise ValueError(f"Expected 6 columns, got {len(cells)}")
+    return cells
+
+def process_csv(in_csv: str, out_csv: str) -> str:
+    llm = _get_llm()
+    with open(in_csv, "r", encoding="utf-8") as f:
+        rows = list(csv.DictReader(f))
+    out_rows = []
+    for r in rows:
+        url = r.get("url","" )
+        caption = r.get("caption","" )
+        image_text = r.get("image_text","" )
+        md = _call_llm(llm, url, caption, image_text)
+        try:
+            cells = _parse_single_row_table(md)
+        except Exception as e:
+            log.warning("Parse failed for %s: %s", url, e)
+            cells = ["","","","","",url]
+        out_rows.append({
+            "Place": cells[0],
+            "City": cells[1],
+            "Country": cells[2],
+            "Category": cells[3],
+            "Brief Description": cells[4],
+            "Social Media / Website": cells[5],
+        })
+    fieldnames = ["Place","City","Country","Category","Brief Description","Social Media / Website"]
+    with open(out_csv, "w", newline="", encoding="utf-8-sig") as f:
+        w = csv.DictWriter(f, fieldnames=fieldnames)
+        w.writeheader()
+        for r in out_rows:
+            w.writerow(r)
+    return out_csv

insta2table-0.1.0/src/insta2table/utils.py

@@ -0,0 +1,44 @@
+from __future__ import annotations
+import os, re, io, time, logging, urllib.parse as urlparse
+from typing import Optional, Tuple
+
+log = logging.getLogger("insta2table")
+
+def classify_url(url: str) -> Tuple[str, Optional[str]]:
+    """
+    Returns (category, shortcode_or_none)
+
+    Categories:
+      - insta-reel  -> path contains '/reel/<shortcode>'
+      - insta-image -> path contains '/p/<shortcode>' or '/tv/<shortcode>'
+      - insta-page  -> instagram host but not a specific post
+      - not-instagram -> non-instagram host
+    """
+    try:
+        u = urlparse.urlparse(url)
+        host = (u.netloc or "").lower()
+        if "instagram.com" not in host:
+            return "not-instagram", None
+
+        # split and remove empty segments
+        parts = [p for p in (u.path or "/").split("/") if p]
+
+        # search known markers anywhere in the path
+        for marker in ("reel", "p", "tv"):
+            if marker in parts:
+                idx = parts.index(marker)
+                shortcode = parts[idx + 1] if len(parts) > idx + 1 else None
+                if marker == "reel":
+                    return "insta-reel", shortcode
+                else:
+                    return "insta-image", shortcode
+
+        return "insta-page", None
+    except Exception:
+        return "not-instagram", None
+
+def safe_sleep(seconds: float):
+    try:
+        time.sleep(seconds)
+    except Exception:
+        pass

insta2table-0.1.0/src/insta2table.egg-info/PKG-INFO

@@ -0,0 +1,86 @@
+Metadata-Version: 2.4
+Name: insta2table
+Version: 0.1.0
+Summary: Fetch Instagram captions (with optional OCR) and convert them to a normalized table via Gemini.
+Author: S. Kashyap
+License: MIT License
+Project-URL: Homepage, https://github.com/Sk1499/insta2table
+Project-URL: Issues, https://github.com/Sk1499/insta2table/issues
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Requires-Dist: pandas>=2.0
+Requires-Dist: tqdm>=4.66
+Requires-Dist: tenacity>=8.2
+Requires-Dist: python-dotenv>=1.0
+Requires-Dist: instaloader>=4.12
+Requires-Dist: requests>=2.31
+Provides-Extra: ocr
+Requires-Dist: pytesseract>=0.3.10; extra == "ocr"
+Requires-Dist: Pillow>=10.0; extra == "ocr"
+Provides-Extra: genai
+Requires-Dist: langchain>=0.2.0; extra == "genai"
+Requires-Dist: langchain-google-genai>=2.0.0; extra == "genai"
+Dynamic: license-file
+
+# insta2table
+
+[![CI](https://github.com/Sk1499/insta2table/actions/workflows/ci.yml/badge.svg)](https://github.com/Sk1499/insta2table/actions)
+[![PyPI version](https://img.shields.io/pypi/v/insta2table.svg)](https://pypi.org/project/insta2table/)
+
+
+A tiny toolkit to:
+1. **Crawl Instagram links** from a text file, extract captions and (optionally) **OCR** text from images → `output.csv`
+2. **Convert** those rows into a clean **single-row table** per link using **Gemini** → `result.csv`
+
+> Credentials & keys via env:
+> - `IG_USER`, `IG_PASS` (optional): for Instaloader login (reduces 403s)
+> - `GOOGLE_API_KEY`: required for Gemini
+
+## Quickstart
+
+```bash
+# 1) (Recommended) Create and activate a virtualenv
+python -m venv .venv
+# Linux/macOS
+source .venv/bin/activate
+# Windows (PowerShell)
+# .venv\Scripts\Activate.ps1
+
+# 2) Install (with OCR & Gemini extras if you need them)
+pip install -e .[ocr,genai]
+
+# 3) Prepare links
+cp examples/links.txt .
+
+# 4) Crawl -> output.csv
+export IG_USER="your_user"
+export IG_PASS="your_pass"
+insta2csv --links links.txt --out output.csv
+
+# 5) Process with Gemini -> result.csv
+export GOOGLE_API_KEY="your_key"
+insta2table --in output.csv --out result.csv
+```
+
+## CLI
+
+```bash
+insta2csv --links links.txt --out output.csv [--no-ocr]
+insta2table --in output.csv --out result.csv
+```
+
+## Notes
+- OCR requires Tesseract installed on your system if you opt in.
+- Instagram scraping without login can trigger 403s. Supplying IG credentials helps.
+- Gemini formatting expects a single-row Markdown table per input.
+
+
+## Publishing
+
+We use **trusted publishing** from GitHub to PyPI (no API token needed).
+
+1. Create the project on PyPI (only first time) and enable **'Manage publishing'** with GitHub OIDC for your repo.
+2. In GitHub: create a new Release with a tag like `v0.1.0`.
+3. The **Publish to PyPI** workflow will build and upload the release automatically.
+4. Alternatively (manual): `make build` then `twine upload dist/*` (requires a PyPI token).

insta2table-0.1.0/src/insta2table.egg-info/SOURCES.txt

@@ -0,0 +1,18 @@
+LICENSE
+MANIFEST.in
+README.md
+pyproject.toml
+setup.cfg
+examples/links.txt
+src/insta2table/__init__.py
+src/insta2table/cli.py
+src/insta2table/crawler.py
+src/insta2table/processor.py
+src/insta2table/utils.py
+src/insta2table.egg-info/PKG-INFO
+src/insta2table.egg-info/SOURCES.txt
+src/insta2table.egg-info/dependency_links.txt
+src/insta2table.egg-info/entry_points.txt
+src/insta2table.egg-info/requires.txt
+src/insta2table.egg-info/top_level.txt
+tests/test_import.py

insta2table-0.1.0/src/insta2table.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

insta2table-0.1.0/src/insta2table.egg-info/entry_points.txt

@@ -0,0 +1,3 @@
+[console_scripts]
+insta2csv = insta2table.cli:crawl
+insta2table = insta2table.cli:process

insta2table-0.1.0/src/insta2table.egg-info/requires.txt

@@ -0,0 +1,14 @@
+pandas>=2.0
+tqdm>=4.66
+tenacity>=8.2
+python-dotenv>=1.0
+instaloader>=4.12
+requests>=2.31
+
+[genai]
+langchain>=0.2.0
+langchain-google-genai>=2.0.0
+
+[ocr]
+pytesseract>=0.3.10
+Pillow>=10.0

insta2table-0.1.0/src/insta2table.egg-info/top_level.txt

@@ -0,0 +1 @@
+insta2table

insta2table-0.1.0/tests/test_import.py

@@ -0,0 +1,3 @@
+def test_import():
+    import insta2table
+    assert hasattr(insta2table, "__version__")