machineconfig 1.6__tar.gz → 1.8__tar.gz

machineconfig-1.8/MANIFEST.in

@@ -0,0 +1,7 @@
+
+graft ./src/machineconfig/settings/*
+graft ./src/machineconfig/jobs/*
+graft ./src/machineconfig/profile/*
+graft ./src/machineconfig/scripts/*
+graft ./src/machineconfig/setup_linux/*
+graft ./src/machineconfig/setup_windows/*

machineconfig-1.8/PKG-INFO

@@ -0,0 +1,132 @@
+Metadata-Version: 2.1
+Name: machineconfig
+Version: 1.8
+Summary: Dotfiles management package
+Home-page: https://github.com/thisismygitrepo/machineconfig
+Author: Alex Al-Saffar
+Author-email: programmer@usa.com
+Project-URL: Bug Tracker, https://github.com/thisismygitrepo/machineconfig/issues
+Classifier: Programming Language :: Python :: 3
+Classifier: License :: OSI Approved :: MIT License
+Classifier: Operating System :: OS Independent
+Requires-Python: >=3.9
+Description-Content-Type: text/markdown
+
+
+<p align="center">
+
+<a href="https://github.com/thisismygitrepo/machineconfig/commits">
+<img src="https://img.shields.io/github/commit-activity/m/thisismygitrepo/machineconfig" />
+</a>
+
+</p>
+
+
+# Welcome to machineconfig
+
+# Shortcuts
+* `bit.ly/cfgroot` is a shortcut to this repo.
+* `curl bit.ly/cfgread -L | bat -l md --style="header"` to get the readme file.
+
+Machineconfig is a package for managing configuration files (aka dotfiles). The idea is to collect those critical, time-consuming-files-to-setup in one directory and reference them via symbolic links from their original locations. Thus, when a new machine is to be setup, all that is required is to clone the repo in that machine and create the symbolic links.
+Dotfiles include, but are not limited to:
+* `~/.gitconfig`
+* `~/.ssh`
+* `~/.aws`
+* `~/.bash_profile`
+* `~/.bashrc`
+* `~/.config`
+* `$profile` in Windows Powershell
+* etc
+
+
+Additionally, files that contain data, sensitive information that should not be pushed to a repository are contained in a directory `~/dotfiles`. The files therein are encrypted before backedup.
+
+
+## Windows Setup
+With elevated `PowerShell`, run the following: (short `curl bit.ly/cfgallwindows -L | iex`)
+```shell
+# apps  # short: `(iwr bit.ly/cfgappswindows).Content | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/apps.ps1 | Invoke-Expression
+# virtual enviornment  # short (iwr bit.ly/cfgvewindows).Content | iex OR `curl bit.ly/cfgvewindows -L | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/ve.ps1 | Invoke-Expression
+# dev repos  # short `(iwr bit.ly/cfgreposwindows).Content | iex` OR `curl bit.ly/cfgreposwindows -L | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/repos.ps1 | Invoke-Expression
+# symlinks # short `curl bit.ly/cfgsymlinkswindows -L | iex` OR `(iwr bit.ly/cfgsymlinkswindows).Content | iex`
+. ~/code/machineconfig/src/machineconfig/setup_windows/symlinks.ps1
+# devapps:
+~/code/machineconfig/src/machineconfig/setup_windows/devapps.ps1
+# pwsh and wt settings: (iwr bit.ly/cfgwt).Content | iex
+iwr https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/wt_and_pwsh.ps1 | iex
+
+```
+
+```shell
+(iwr bit.ly/cfgappswindows).Content | iex
+(iwr bit.ly/cfgvewindows).Content | iex
+(iwr bit.ly/cfgreposwindows).Content | iex
+. ~/code/machineconfig/src/machineconfig/setup_windows/devapps.ps1
+(iwr bit.ly/cfgwt).Content | iex
+. ~/code/machineconfig/src/machineconfig/setup_windows/symlinks.ps1
+```
+
+###### Setup SSH connection:
+```shell
+# CHANGE pubkey_string APPROPRIATELY
+$pubkey_string=(Invoke-WebRequest 'https://github.com/thisismygitrepo.keys').Content
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/openssh_all.ps1 | Invoke-Expression
+```
+short `(iwr bit.ly/cfgsshwindows).Content | iex` OR `curl bit.ly/cfgsshwindows -L | iex`
+
+###### Install Croshell Terminal Directly,
+```shell
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/web_shortcuts/croshell.ps1 | Invoke-Expression
+```
+short: `curl bit.ly/cfgcroshellwindows -L | iex` OR `(iwr bit.ly/cfgcroshellwindows).Content | iex`
+
+
+# Linux Setup
+With `sudo` access, run the following: (short `curl bit.ly/cfgalllinux -L | bash`)
+```bash
+export package_manager="apt"
+export package_manager="nix"
+
+# apps  # short: `curl bit.ly/cfgappslinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/apps.sh | bash
+# Optionally: curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/apps_dev.sh | bash
+
+# virtual enviornment  # short `curl bit.ly/cfgvelinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/ve.sh | bash
+
+# repos  # short `curl bit.ly/cfgreposlinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/repos.sh | bash
+# symlinks and bash profile: # short `curl bit.ly/cfgsymlinkslinux -L | bash`
+source ~/code/machineconfig/src/machineconfig/setup_linux/symlinks.sh  # requires sudo since it invloves chmod of dotfiles/.ssh, however sudo doesn't work with source. best to have sudo -s earlier.
+
+# devapps
+source <(sudo cat ~/code/machineconfig/src/machineconfig/setup_linux/devapps.sh)
+```
+
+###### Setup SSH connection:
+```bash
+pubkey_url='https://github.com/thisismygitrepo.keys'  # (CHANGE APPROPRIATELY)
+export pubkey_string=$(curl --silent $pubkey_url)
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/openssh_all.sh | sudo bash
+# For WSL only, also run the following:
+export port=2223
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/openssh_wsl.sh | sudo bash  
+# don't forget to run `wsl_ssh_windows_port_forwarding -p 2223` from Windows using the designated port with 
+```
+short `curl bit.ly/cfgsshlinux -L | bash`
+
+
+###### Install Croshell Terminal Directly
+```bash
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/web_shortcuts/croshell.sh | sudo bash
+```
+short `curl bit.ly/cfgcroshelllinux -L | bash`
+
+
+# Author
+Alex Al-Saffar. [email](mailto:programmer@usa.com)
+

machineconfig-1.8/README.md

@@ -0,0 +1,118 @@
+
+<p align="center">
+
+<a href="https://github.com/thisismygitrepo/machineconfig/commits">
+<img src="https://img.shields.io/github/commit-activity/m/thisismygitrepo/machineconfig" />
+</a>
+
+</p>
+
+
+# Welcome to machineconfig
+
+# Shortcuts
+* `bit.ly/cfgroot` is a shortcut to this repo.
+* `curl bit.ly/cfgread -L | bat -l md --style="header"` to get the readme file.
+
+Machineconfig is a package for managing configuration files (aka dotfiles). The idea is to collect those critical, time-consuming-files-to-setup in one directory and reference them via symbolic links from their original locations. Thus, when a new machine is to be setup, all that is required is to clone the repo in that machine and create the symbolic links.
+Dotfiles include, but are not limited to:
+* `~/.gitconfig`
+* `~/.ssh`
+* `~/.aws`
+* `~/.bash_profile`
+* `~/.bashrc`
+* `~/.config`
+* `$profile` in Windows Powershell
+* etc
+
+
+Additionally, files that contain data, sensitive information that should not be pushed to a repository are contained in a directory `~/dotfiles`. The files therein are encrypted before backedup.
+
+
+## Windows Setup
+With elevated `PowerShell`, run the following: (short `curl bit.ly/cfgallwindows -L | iex`)
+```shell
+# apps  # short: `(iwr bit.ly/cfgappswindows).Content | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/apps.ps1 | Invoke-Expression
+# virtual enviornment  # short (iwr bit.ly/cfgvewindows).Content | iex OR `curl bit.ly/cfgvewindows -L | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/ve.ps1 | Invoke-Expression
+# dev repos  # short `(iwr bit.ly/cfgreposwindows).Content | iex` OR `curl bit.ly/cfgreposwindows -L | iex`
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/repos.ps1 | Invoke-Expression
+# symlinks # short `curl bit.ly/cfgsymlinkswindows -L | iex` OR `(iwr bit.ly/cfgsymlinkswindows).Content | iex`
+. ~/code/machineconfig/src/machineconfig/setup_windows/symlinks.ps1
+# devapps:
+~/code/machineconfig/src/machineconfig/setup_windows/devapps.ps1
+# pwsh and wt settings: (iwr bit.ly/cfgwt).Content | iex
+iwr https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/wt_and_pwsh.ps1 | iex
+
+```
+
+```shell
+(iwr bit.ly/cfgappswindows).Content | iex
+(iwr bit.ly/cfgvewindows).Content | iex
+(iwr bit.ly/cfgreposwindows).Content | iex
+. ~/code/machineconfig/src/machineconfig/setup_windows/devapps.ps1
+(iwr bit.ly/cfgwt).Content | iex
+. ~/code/machineconfig/src/machineconfig/setup_windows/symlinks.ps1
+```
+
+###### Setup SSH connection:
+```shell
+# CHANGE pubkey_string APPROPRIATELY
+$pubkey_string=(Invoke-WebRequest 'https://github.com/thisismygitrepo.keys').Content
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/openssh_all.ps1 | Invoke-Expression
+```
+short `(iwr bit.ly/cfgsshwindows).Content | iex` OR `curl bit.ly/cfgsshwindows -L | iex`
+
+###### Install Croshell Terminal Directly,
+```shell
+Invoke-WebRequest https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_windows/web_shortcuts/croshell.ps1 | Invoke-Expression
+```
+short: `curl bit.ly/cfgcroshellwindows -L | iex` OR `(iwr bit.ly/cfgcroshellwindows).Content | iex`
+
+
+# Linux Setup
+With `sudo` access, run the following: (short `curl bit.ly/cfgalllinux -L | bash`)
+```bash
+export package_manager="apt"
+export package_manager="nix"
+
+# apps  # short: `curl bit.ly/cfgappslinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/apps.sh | bash
+# Optionally: curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/apps_dev.sh | bash
+
+# virtual enviornment  # short `curl bit.ly/cfgvelinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/ve.sh | bash
+
+# repos  # short `curl bit.ly/cfgreposlinux -L | bash`
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/repos.sh | bash
+# symlinks and bash profile: # short `curl bit.ly/cfgsymlinkslinux -L | bash`
+source ~/code/machineconfig/src/machineconfig/setup_linux/symlinks.sh  # requires sudo since it invloves chmod of dotfiles/.ssh, however sudo doesn't work with source. best to have sudo -s earlier.
+
+# devapps
+source <(sudo cat ~/code/machineconfig/src/machineconfig/setup_linux/devapps.sh)
+```
+
+###### Setup SSH connection:
+```bash
+pubkey_url='https://github.com/thisismygitrepo.keys'  # (CHANGE APPROPRIATELY)
+export pubkey_string=$(curl --silent $pubkey_url)
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/openssh_all.sh | sudo bash
+# For WSL only, also run the following:
+export port=2223
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/openssh_wsl.sh | sudo bash  
+# don't forget to run `wsl_ssh_windows_port_forwarding -p 2223` from Windows using the designated port with 
+```
+short `curl bit.ly/cfgsshlinux -L | bash`
+
+
+###### Install Croshell Terminal Directly
+```bash
+curl https://raw.githubusercontent.com/thisismygitrepo/machineconfig/main/src/machineconfig/setup_linux/web_shortcuts/croshell.sh | sudo bash
+```
+short `curl bit.ly/cfgcroshelllinux -L | bash`
+
+
+# Author
+Alex Al-Saffar. [email](mailto:programmer@usa.com)
+

machineconfig-1.8/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

machineconfig-1.8/setup.py

@@ -0,0 +1,41 @@
+
+""" Setup file for machineconfig package.
+"""
+
+import setuptools
+from src.machineconfig import __version__
+# this is a comment
+with open("README.md", "r", encoding="utf-8") as fh:
+    long_description = fh.read()
+
+setuptools.setup(
+    name="machineconfig",
+    version=__version__,
+    author="Alex Al-Saffar",
+    author_email="programmer@usa.com",
+    description="Dotfiles management package",
+    long_description=long_description,
+    long_description_content_type="text/markdown",
+    url="https://github.com/thisismygitrepo/machineconfig",
+    project_urls={
+        "Bug Tracker": "https://github.com/thisismygitrepo/machineconfig/issues",
+    },
+    classifiers=[
+        "Programming Language :: Python :: 3",
+        "License :: OSI Approved :: MIT License",
+        "Operating System :: OS Independent",
+    ],
+    package_dir={"": "src"},
+    packages=setuptools.find_packages(where="src"),
+    python_requires=">=3.9",
+    install_requires=[
+        "rich",  # required for pretty printing of many scripts.
+        "paramiko",  # required by SSH
+        "gitpython",  # required by repo commands
+        "pudb",  # required by fire command
+        "pyfzf",
+        "clipboard",
+        "psutil",
+        "pydantic"
+    ],
+)

machineconfig-1.8/src/machineconfig/__init__.py

@@ -0,0 +1,8 @@
+
+"""DS
+"""
+
+__version__ = "1.8"
+release_notes = """
+enhanced ve management
+"""

machineconfig-1.8/src/machineconfig/jobs/linux/archive/quirks.sh

@@ -0,0 +1,27 @@
+
+
+# to disable suspension with lid closing: https://askubuntu.com/questions/141866/keep-ubuntu-server-running-on-a-laptop-with-the-lid-closed/1426611#1426611?newreg=b07cf38c193d4abd97bd9c05f3ace8d2
+# Edit file: /etc/systemd/logind.conf Adjust these two parameters:
+sudo sed -i 's/#HandleLidSwitch=suspend/HandleLidSwitch=ignore/g' /etc/systemd/logind.conf
+sudo sed -i 's/#HandleLidSwitchExternalPower=suspend/HandleLidSwitchExternalPower=ignore/g' /etc/systemd/logind.conf
+
+# https://askubuntu.com/questions/972215/a-start-job-is-running-for-wait-for-network-to-be-configured-ubuntu-server-17-1
+# This is the network config written by 'subiquity'
+
+network:
+  ethernets:
+    enp0s31f6:
+      dhcp4: true
+      optional: true
+  version: 2
+
+
+sudo sed -i 's/dhcp4: true/dhcp4: true\n      optional: true/g' /etc/netplan/00-installer-config.yaml
+
+# see sed and awk
+# https://unix.stackexchange.com/questions/642578/command-line-for-editing-a-configuration-file-value-without-an-interactive-edito
+# file format
+# https://askubuntu.com/questions/304999/not-able-to-execute-a-sh-file-bin-bashm-bad-interpreter
+# plocate:
+# https://unix.stackexchange.com/questions/113670/can-i-just-disable-updatedb/113681#113681
+# https://askubuntu.com/questions/1251484/why-does-it-take-so-much-time-to-initialize-mlocate-database

machineconfig-1.8/src/machineconfig/jobs/python/archive/python_tools.txt

@@ -0,0 +1,12 @@
+
+revChatGPT  # talk to gpt from terminal
+you-get  # download content from internet with CLI
+pydot  # additionally required by tensorflow to plot a model
+pyinstaller
+glance
+
+
+# pip install python-lsp-server
+# pip install --user pylint
+# pip install --user yapf
+# pip install --user isort

machineconfig-1.8/src/machineconfig/jobs/python/check_installations.py

@@ -0,0 +1,173 @@
+
+"""CI
+"""
+
+
+import time
+import pandas as pd
+import platform
+from rich.console import Console
+# from rich.progress import track
+from machineconfig.utils.utils import LIBRARY_ROOT, INSTALL_VERSION_ROOT
+from machineconfig.utils.installer import get_installed_cli_apps
+from crocodile.core import List as L, install_n_import, Struct
+from crocodile.file_management import P
+from crocodile.meta import Terminal
+from tqdm import tqdm
+from typing import Optional
+
+
+APP_SUMMARY_PATH = LIBRARY_ROOT.joinpath(f"profile/records/{platform.system().lower()}/apps_summary_report.csv")
+CLOUD: str = "gdw"  # Read.ini(DEFAULTS_PATH)['general']['rclone_config_name']
+# my onedrive doesn't allow sharing.
+
+
+def scan(path: P, pct: float = 0.0):
+    vt = install_n_import(library="vt", package="vt-py")
+    client = vt.Client(P.home().joinpath("dotfiles/creds/tokens/virustotal").read_text().split("\n")[0])
+    console = Console()
+    console.rule(f"Scanning {path}. {pct:.2f}% done")
+    if path.is_dir():
+        print(f"Skipping {path} as it is a directory.")
+        return None
+    with open(str(path), "rb") as f:
+        analysis = client.scan_file(f)
+    repeat_counter = 0
+    while True:
+        with console.status(f"waiting for scan of {path} ... "):
+            try:
+                anal = client.get_object("/analyses/{}", analysis.id)
+                if anal.status == "completed": break
+            except Exception as ex:  # type: ignore
+                repeat_counter += 1
+                if repeat_counter > 2:
+                    raise ValueError(f"Error in scanning {path}") from ex
+                print(f"Error in scanning, trying again.")
+            time.sleep(30)
+    df = pd.DataFrame(anal.results.values())
+    malicious = []
+    for _idx, row in df.iterrows():
+        # try:
+        #     print(row.result)
+        # except Exception as ex:  # type: ignore
+        #     print(row)
+        if row.result is None and row.category in ["undetected", "type-unsupported", "failure", "timeout", "confirmed-timeout"]: continue
+        else:
+            Struct(row.to_dict()).print(as_config=True, title=f"Found Category {row.category}")
+            malicious.append(row)
+    positive_pct: float = round(number=len(malicious) / len(df) * 100, ndigits=1)
+    print(f"positive_ratio = {positive_pct:.1f} %")
+    return positive_pct, df
+
+
+def main() -> None:
+    apps_paths_tmp: L[P] = get_installed_cli_apps()
+    versions_files_paths: L[P] = INSTALL_VERSION_ROOT.search()
+    app_versions: list[Optional[str]] = []
+    apps_paths_raw: L[P] = L([])
+    for an_app in apps_paths_tmp:
+        version_path = versions_files_paths.filter(lambda x: x.stem == an_app.stem)
+        if len(version_path) == 1:
+            app_versions.append(version_path.list[0].read_text())
+            apps_paths_raw.append(an_app)
+        # if an_app.stem in versions_files_paths.stem:
+        #     app_versions.append(versions_files_paths.filter(lambda x: x.stem == an_app.stem.replace(".exe", "")).list[0].read_text())
+        # else:
+        #     print(f"🤔 Cloud not find a documented version for installation of {an_app.stem}, trying to get it from the app itself.")
+        #     tmp = Terminal().run(f"{an_app.stem} --version", shell="powershell").capture().op_if_successfull_or_default(strict_err=False, strict_returcode=False)
+        #     if tmp is not None: tmp = tmp.split("\n")[0]
+        #     print(f"➡️ Found version `{tmp}` for {an_app.stem}.")
+        #     app_versions.append(None)
+    print(f"Checking tools collected from `{INSTALL_VERSION_ROOT}`:")
+    apps_paths_raw.print()
+    positive_pct: list[Optional[float]] = []
+    detailed_results: list[dict[str, Optional[pd.DataFrame]]] = []
+    for idx, app in enumerate(apps_paths_raw):
+        try: res = scan(path=app, pct=idx / len(apps_paths_raw) * 100)
+        except ValueError as ve:
+            print(ve)
+            res = None
+        if res is None:
+            positive_pct.append(None)
+            detailed_results.append({app.stem: None})
+        else:
+            ppct, df = res
+            positive_pct.append(ppct)
+            detailed_results.append({app.stem: df})
+
+    res_df = pd.DataFrame({"app_name": apps_paths_raw.apply(lambda x: x.stem).list, "version": app_versions, "positive_pct": positive_pct,
+                                "app_path": apps_paths_raw.apply(lambda x: x.collapseuser(strict=False).as_posix()).list})
+
+    app_url: list[Optional[str]] = []
+    for idx, row in tqdm(res_df.iterrows(), total=res_df.shape[0]):
+        apps_safe_url = upload(P(str(row["app_path"])).expanduser())
+        app_url.append(apps_safe_url.as_posix() if type(apps_safe_url) is P else apps_safe_url)
+    res_df["app_url"] = app_url
+    res_df.to_csv(APP_SUMMARY_PATH.with_suffix(".csv").create(parents_only=True), index=False)
+    APP_SUMMARY_PATH.with_suffix(".md").write_text(res_df.to_markdown())
+    print(f"Safety Report:")
+    print(res_df)
+
+
+def upload(path: P):
+    set_time_out = install_n_import("call_function_with_timeout").SetTimeout
+    func_with_timeout = set_time_out(lambda: path.to_cloud(CLOUD, rel2home=True, share=True, os_specific=True), timeout=180)
+    is_done, _is_timeout, _erro_message, results = func_with_timeout()
+    if is_done: return results
+    else: return None
+
+
+class PrecheckedCloudInstaller:
+    def __init__(self):
+        install_n_import("gdown")
+        self.df = pd.read_csv(APP_SUMMARY_PATH)
+
+    @staticmethod
+    def download_google_links(url: str):
+        # if "drive.google.com" in str(url): url = str(url).replace("open?", "uc?")
+        # else: raise NotImplementedError("Only google drive is supported for now.")
+        # return P(url).download(name=name)
+        gdrive_id = P(url).parts[-1].split("id=")[1]
+        gdown = install_n_import("gdown")
+        result = P(gdown.download(id=gdrive_id)).absolute()
+        return result
+
+    @staticmethod
+    def install_cli_apps(app_url: str):
+        try:
+            exe = PrecheckedCloudInstaller.download_google_links(app_url)
+        except Exception as ex:  # type: ignore
+            print(f"Error in downloading {app_url} {ex}")
+            return None
+        if platform.system().lower() == "linux":
+            Terminal().run(f"chmod +x {exe}")
+            Terminal().run(f"mv {exe} /usr/local/bin/")
+        elif platform.system().lower() == "windows":
+            exe.move(folder=P.home().joinpath("AppData/Local/Microsoft/WindowsApps"), overwrite=True)
+        return True
+
+    def download_safe_apps(self, name: str = "AllEssentials"):
+        # if platform.system().lower() == "windows":
+        #     from machineconfig.jobs.python.python_windows_installers_all import get_cli_py_installers
+        #     cli_installers = get_cli_py_installers()
+        # elif platform.system().lower() == "linux":
+        #     from machineconfig.jobs.python.python_linux_installers_all import get_cli_py_installers
+        #     cli_installers = get_cli_py_installers()
+        # else: raise NotImplementedError(f"Platform {platform.system().lower()} is not supported yet.")
+
+        if name == "AllEssentials":
+            print(f"Downloading {self.df.shape[0]} apps ...")
+            print(self.df)
+            _res = L(self.df.app_url).apply(PrecheckedCloudInstaller.install_cli_apps, jobs=20)
+        else:
+            app_url = self.df[self.df.app_name == name].iloc[0].app_url
+            _res = PrecheckedCloudInstaller.install_cli_apps(app_url=app_url)
+
+        # print("\n" * 3)
+        # for item_flag, item_name in zip(res, self.df["app_name"]):
+        #     if item_flag: print(f"✅ {item_name} is installed. 😁")
+        #     else: print(f"❌ {item_name} failed to install for reasons explained in the log above, try manually.")
+
+
+if __name__ == '__main__':
+    pass

machineconfig-1.8/src/machineconfig/jobs/python/checkout_version.py

@@ -0,0 +1,117 @@
+
+"""checkout_version.py
+"""
+
+from crocodile.file_management import P, Save, randstr
+from crocodile.meta import Terminal
+from machineconfig.utils.ve import get_ve_profile, get_ve_specs, get_ve_install_script
+from machineconfig.scripts.python.repos import record_a_repo, install_repos
+import platform
+
+
+# TODO: add data requirements for added isolation of file system.
+
+
+def checkout_version(version: str, repo_root: P, exclude_editable: bool = False):
+    """Checkout a version of the repo and install its requirements."""
+    ve_name = get_ve_profile(init_path=repo_root)
+    ve_path = P.home().joinpath("venvs", ve_name)
+    ve_specs = get_ve_specs(ve_path)
+    py_version = ve_specs['version_major_minor']
+    sys = platform.system().lower()
+
+    target_dir = repo_root.expanduser().absolute().joinpath(f"versions/{version}").as_posix()
+    if exclude_editable:
+        editable_json = get_editable_packages(ve_name=ve_name)
+        specs_path = P(target_dir).expanduser().joinpath("editable_packages.json")
+        Save.json(obj=editable_json, path=specs_path, indent=4)
+        install_editable_packages = install_repos(specs_path=str(specs_path), editable_install=True)
+    else: install_editable_packages = ""
+
+    version_root = repo_root.collapseuser().joinpath(f"versions/{version}").as_posix()
+    version_root_obj = P(version_root).expanduser().create()
+    checkout_ve = f"{repo_root.name}-{version}-prod" if not exclude_editable else ve_name
+    checkout_ve = input(f"Name of the ve to create (default: {checkout_ve}): ") or checkout_ve
+
+    ve_template = get_ve_install_script(ve_name=checkout_ve, py_version=py_version, system="Windows", delete_if_exists=False, install_crocodile_and_machineconfig=False)
+    version_root_obj.joinpath("install_ve.ps1").write_text(ve_template)
+    ve_template = get_ve_install_script(ve_name=checkout_ve, py_version=py_version, system="Linux", delete_if_exists=False, install_crocodile_and_machineconfig=False)
+    version_root_obj.joinpath("install_ve.sh").write_text(ve_template)
+
+    install_requirements = f"""
+. $HOME/scripts/activate_ve {ve_name}
+cd {version_root}
+pip install -r requirements_{sys}.txt
+{install_editable_packages}
+"""
+    if sys == "windows":
+        version_root_obj.joinpath("install_requirements.ps1").write_text(install_requirements)
+        if not version_root_obj.joinpath("install_requirements.sh").exists(): version_root_obj.joinpath("install_requirements.sh").write_text(install_requirements)
+    elif sys == "linux":
+        version_root_obj.joinpath("install_requirements.sh").write_text(install_requirements)
+        if not version_root_obj.joinpath("install_requirements.ps1").exists(): version_root_obj.joinpath("install_requirements.ps1").write_text(install_requirements)
+    else: raise NotImplementedError(f"System {sys} not supported.")
+
+    pip_freeze_script = f"""
+cd '{target_dir}'
+. "$HOME/scripts/activate_ve" {ve_name}
+python -m pip freeze {'--exclude-editable' if exclude_editable else ''} > requirements_{sys}.txt
+"""
+    Terminal().run_script(pip_freeze_script, verbose=True, shell="default").print()
+
+    install_all_script = r"""
+#!/usr/bin/bash
+
+CUR_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )"
+. $CUR_DIR/install_ve.sh
+. $CUR_DIR/install_requirements.sh
+"""
+    version_root_obj.joinpath("install.sh").write_text(install_all_script)
+    install_all_script = r"""
+
+$CUR_DIR = Split-Path $MyInvocation.MyCommand.Path -Parent
+. $CUR_DIR/install_ve.ps1
+. $CUR_DIR/install_requirements.ps1
+
+"""
+    version_root_obj.joinpath("install.ps1").write_text(install_all_script)
+    print(f"✅ Installed requirements for version {version}.")
+
+
+def main():
+    from git.repo import Repo
+    from git.exc import InvalidGitRepositoryError
+    try:
+        repo = Repo(P.cwd(), search_parent_directories=True)
+        print(f"✅ Found repo at {repo.working_dir}")
+    except InvalidGitRepositoryError as err:
+        print(f"❌ No repo found at {P.cwd()} or its parents.")
+        raise err
+    version = input("Enter version name: ")
+    from rich.prompt import Confirm
+    exclude_editable = Confirm.ask("Exclude editable packages?", default=False)
+
+    repo_root = P(repo.working_dir)
+    checkout_version(version, repo_root, exclude_editable=exclude_editable)
+
+
+def get_editable_packages(ve_name: str):
+    file = P.tmp().joinpath(f"tmp_files/editable_requirements_{randstr()}.txt")
+    editable_packages_script = f"""
+. $HOME/scripts/activate_ve {ve_name}
+pip list --editable > {file}
+"""
+    Terminal().run_script(editable_packages_script, verbose=True, shell="default").print()
+    try: tmp3 = file.read_text(encoding='utf-16').splitlines()[2:]
+    except UnicodeError: tmp3 = file.read_text().splitlines()[2:]
+
+    res = []
+    for a_pkg in tmp3:
+        tmp = P(a_pkg.split(" ")[-1].rstrip())
+        tmp1 = record_a_repo(tmp, search_parent_directories=True)  # pip list --editable returns path to package or repo in a way not yet understood.
+        res.append(tmp1)
+    return res
+
+
+if __name__ == "__main__":
+    pass