neetob-ud 0.1.0

data/README.md

@@ -0,0 +1,412 @@
+# neetob temp ll
+The `neetob` gem gives different commands for interacting with Github and Heroku instances of existing neeto projects.
+
+## Table of Contentssss
+
+1. [Getting Started](#getting-started)
+   1. [Installation](#installation)
+2. [Usage](#usage)
+3. [Working with GitHub](#working-with-github)
+   1. [Issues](#issues)
+   2. [Labels](#labels)
+   3. [Search](#search)
+   4. [Protect Branch](#protect-branch)
+   5. [Make PR](#make-pr)
+   6. [Login](#login)
+4. [Working with Heroku](#working-with-heroku)
+   1. [Config Vars](#config-vars)
+   2. [Access](#access)
+   3. [Execute](#execute)
+5. [Working with Users](#working-with-users)
+   1. [Audit](#audit)
+   2. [Commits](#commits)
+6. [Working with Make Repos Uptodate](#working-with-make-repos-uptodate)
+7. [Working with local Repos](#working-with-local-repos)
+   1. [ls](#ls)
+8. [Testing](#testing)
+
+## Getting started
+
+### Installation
+
+Clone the repository onto your system using the following command:
+
+
+
+```sh
+git clone https://github.com/bigbinary/neetob.git
+```
+
+
+
+Navigate to the root of the application directory.
+
+
+
+```sh
+cd neetob
+```
+
+To set up `neetob`, execute the below command from the root of the application directory.
+
+```sh
+bin/setup
+```
+
+
+
+## Usage
+
+Utilize the `help` keyword to access a comprehensive list of all the available commands and options.
+
+```
+neetob help
+
+Commands:
+  neetob github          # Interact with any resource in Github
+  neetob help [COMMAND]  # Describe available commands or one specific command
+  neetob heroku          # Interact with any resource in Heroku
+  neetob users           # Interact with the contributors of neeto apps
+  neetob make-repos-uptodate # Update all neeto repos
+
+Options:
+  [--sandbox] # All the commands in sandbox mode will run only on the "neeto-dummy" app.
+```
+
+**By default, all commands will be executed in non-sandbox mode.**
+
+### Useful command-line options
+
+| Option       | Meaning                           |
+| ------------ | --------------------------------- |
+| --apps       | Target app names                  |
+| --sandbox    | Sandbox mode                      |
+| --no-sandbox | Non-Sandbox mode                  |
+| --help       | Provides information on a command |
+
+**Note:** The commands within `neetob` should be used with caution, as improper usage may result in unintended consequences, and some actions may not be reversible.
+
+## Working with GitHub
+
+Efficiently gain access to a comprehensive list of all the available subcommands for the `github` command by utilizing the `help` keyword.
+
+```sh
+neetob github help
+```
+
+### Issues
+
+The `issues` command offers valuable insights into GitHub issues.
+
+```sh
+# To efficiently list and count all the open issues that are currently unassigned
+neetob github issues list --count --state open --assignee none --apps "neeto-*-web"
+
+# To list, count and filter all unassigned open issues that are labeled as "bug"
+neetob github issues list --count --label bug --state open --assignee none --apps "neeto-*-web"
+```
+
+### Labels
+
+The `labels` command provides an interface for interacting with Github labels.
+
+```sh
+# The `list` command lists the details of all the labels in the Github repo
+neetob github labels list --apps "neeto-*-web"
+
+# The `show` command gives the details for a specific label in the Github repo
+neetob github labels show --name priority --apps "neeto-*-web"
+
+# The `update` command updates the name of a label
+neetob github labels update --old-name "High Priority" --new-name \
+"high-priority" --all-neeto-repos
+
+# The `upsert` command updates and inserts all the labels mentioned in the
+# JSON file "data/github-labels.json"
+neetob github labels upsert --all-neeto-repos
+
+# The `upsert` command accepts a different JSON file using `path` option
+neetob github labels upsert --path ~/Desktop/labels.json --apps "neeto-*-web"
+
+# The `delete` command deletes the given labels from the Github repos
+neetob github labels delete --labels "High Priority" "Priority 1" "bug" \
+--apps "neeto-*-web"
+
+# The `delete_all` command deletes all the labels from the Github repos
+neetob github labels delete_all --apps "neeto-*-web"
+```
+
+Check out the default labels [file](data/github-labels.json) for the required JSON file structure.
+
+All neeto repos list is maintained at [neeto_compliance](https://github.com/bigbinary/neeto-compliance/blob/main/data/neeto_repos.json).
+
+### Search
+
+Easily search for keywords across multiple neeto projects within specified files by utilizing the `search` command.
+
+```sh
+neetob github search --keyword neeto --path README.md --apps "neeto-*-web"
+```
+
+### Protect branch
+
+Update branch protection rules in neeto repos by using the `protect_branch` command.
+
+```sh
+neetob github protect_branch --branch main --apps neeto-dummy
+```
+
+By default, this [file](data/branch-protection-rules.json) will be used for updating the branch protection rules.
+
+The `protect_branch` command can also be used with a different JSON file using `path` option.
+
+For example, assume we have a file named `branch-protection-rules.json` on the `Desktop` with the following rules:
+
+```json
+{
+  "required_conversation_resolution": true,
+  "has_required_deployments": true
+}
+```
+
+
+
+To update the above-mentioned branch protection rules for the `main` branch of all the neeto products, use the following command:
+
+```sh
+neetob github protect_branch --branch main --path ~/Desktop/branch-protection-rules.json \
+--apps neeto-dummy
+```
+
+We can also use the `--all-neeto-repos` option with the above mentioned command so that the
+branch protection rules can be updated for
+all [neeto repos](https://github.com/bigbinary/neeto-compliance/blob/main/data/neeto_repos.json).
+
+```sh
+neetob github protect_branch --branch main --path ~/Desktop/branch-protection-rules.json \
+--all-neeto-repos
+```
+
+**Note:** Unfortunately, utilizing the Github API, we are unable to update the `Require deployments to succeed before merging` rule, as it is currently not defined as a parameter within the API. For further information on available options to update different branch protection rules, kindly refer to the official Github [documentation](https://docs.github.com/en/rest/branches/branch-protection#update-branch-protection).
+
+### Make PR
+
+The `make-pr` command creates pull requests across Github repos.
+
+```sh
+# The `compliance-fix` command executes a `bundle` inside all repos and creates a PR
+neetob github make-pr compliance-fix
+
+# The `script` command runs the given script for each product and create a PR
+neetob github make-pr script --path ~/Desktop/fix-folders.sh --branch "neetob-test" \
+--title "PR title"
+```
+
+### Login
+
+Authenticate through your browser and update your Github access token by utilizing the `login` command.
+
+```sh
+neetob github login
+```
+
+## Working with Heroku
+
+Utilize the `help` command to list all the available subcommands under the Heroku module for interacting with the Heroku resources.
+
+```sh
+neetob heroku help
+```
+
+### Config vars
+
+The `config_vars` command is useful to interact with Heroku config variables.
+
+```sh
+# The `list` command lists all the Heroku config variables
+neetob heroku config_vars list --apps "neeto-*-production"
+
+# We can list specific Heroku config variables using `keys` option
+neetob heroku config_vars list --apps "neeto-*-production" --keys key1 key2  key3
+
+# We can also use a file to specify required config vars for `list` command
+# Checkout the `data/config-vars-list.json` file for the required structure.
+neetob heroku config_vars list --apps "neeto-*-production" --path \
+neetob/data/config-vars-list.json
+
+# The `audit` command will check the config variables against the JSON file named as
+# `required-config-vars.json` that is present inside the `data` directory at the root of
+# installed `neetob` gem.
+neetob heroku config_vars audit --apps "neeto-*-production"
+
+# The `audit` command can also be used with a different JSON file using `--path` option.
+neetob heroku config_vars audit --path ~/Desktop/config.json --apps "neeto-*-production"
+
+# The `upsert` command adds or updates the config variables from the
+# `data/config-vars-upsert.json` file present at the root of installed `neetob` gem.
+neetob heroku config_vars upsert --apps "neeto-*-staging"
+
+
+# The `remove` command is used to delete `config_vars`.
+neetob heroku config_vars remove --keys=TEST_KEY_1 TEST_KEY_2 --apps "neeto-*-staging"
+```
+
+We can use a custom JSON file with `upsert` command using the `path` option.
+
+
+For example, assume we have a file named `config.json` on the Desktop, like so:
+
+
+```json
+{
+  "NEETO_WIDGET_API_KEY": "jh4c1SC5cS5BvRbcBk4LD",
+  "NEETO_KB_API_KEY": "Lxh7vUKkRewfxSg4dg834",
+  "NEETO_CHAT_API_KEY": "sYnMTSCWLxkNbkHRXL1Xtd"
+}
+```
+
+To update the above-mentioned config variables to all staging apps, we can use the upsert command like so:
+
+```sh
+neetob heroku config_vars upsert --path ~/Desktop/config.json --apps "neeto-*-staging"
+```
+
+The `upsert` command can also be used to update and insert project-specific config variables.
+
+For example, assume we have a file named `config.json` on the `Desktop` with the following properties:
+
+```json
+{
+  "neeto-chat-web-staging": {
+    "NEETO_WIDGET_API_KEY": "jh4c1SC5cS5BvRbcBk4LD"
+  },
+  "neeto-testify-web-production": {
+    "NEETO_KB_API_KEY": "Lxh7vUKkRewfxSg4dg834"
+  },
+  "neeto-desk-web-staging": {
+    "NEETO_CHAT_API_KEY": "sYnMTSCWLxkNbkHRXL1Xtd"
+  }
+}
+```
+
+To update the above-mentioned config variables under the defined project, we can use the upsert command like so:
+
+```sh
+neetob heroku config_vars upsert --path_with_project_keys ~/Desktop/config.json
+```
+
+### Access
+
+We can list, add, and remove users from multiple Heroku apps using the `access` command.
+
+```sh
+# The `list` command retrieves a list of all the users from Heroku apps.
+neetob heroku access list --apps "neeto-*-production"
+
+# Add new users to the Heroku apps.
+neetob heroku access add --users oliver@bigbinary.com eve@bigbinary.com --apps "neeto-*-staging"
+
+# Remove the users from the Heroku apps.
+neetob heroku access remove --users oliver@bigbinary.com eve@bigbinary.com --apps \
+"neeto-*-staging"
+```
+
+### Execute
+
+Utilize the `execute` command to run a Heroku CLI command or a Rails console command for multiple neeto apps in one go.
+
+```sh
+# We can check who has access to the neeto Heroku apps like so:
+neetob heroku execute -c "heroku access" --apps "neeto-*-production"
+
+# We can run a command in the Rails console for different neeto Heroku apps like so:
+neetob heroku execute -c "Sidekiq::Cron::Job.destroy \"server_side_worker\"" --apps \
+"neeto-*-staging" --rails
+```
+
+## Working with users
+
+Using the `users` command, we can interact with the contributors of neeto applications.
+
+### Audit
+
+The `audit` command enables the ability to comprehensively audit contributors across all neeto applications by providing functionality to check for contributors with multiple emails and users with third-party domain emails.
+
+This command will search and use the neeto repos in the current working directory.
+To fetch and update all neeto repos execute [make_repos_uptodate](#working-with-make-repos-uptodate) command before the `audit` command.
+
+```sh
+neetob users audit
+```
+
+### Commits
+
+Using `commits` command we can list the commits for a user in a defined duration.
+
+```sh
+# The below mentioned command will open a list of all the commits across neeto
+# product repos made by "udai1931" in the duration of last 6 months.
+neetob users commits --author udai1931 --duration 6.months
+
+# We can list commits for a specific product using `--apps` option.
+neetob users commits --author udai1931 --duration 6.months --apps neeto-kb-web
+
+# We can list commits for all neeto repos using the `--all-neeto-repos` option.
+neetob users commits --author udai1931 --duration 6.months --all-neeto-repos
+```
+
+## Working with Make Repos Uptodate
+
+Using the `make_repos_uptodate` command, we can uptodate all neeto repos.
+The list of neeto repos is picked up from [neeto_compliance](https://github.com/bigbinary/neeto-compliance/blob/main/lib/neeto_compliance/neeto_repos.rb).
+
+```sh
+neetob make_repos_uptodate
+
+# We have a `--all-neeto-repos` option for this command too so that we can
+# fetch and update all the neeto repos in the current working directory.
+neetob make_repos_uptodate --all-neeto-repos
+```
+
+Executing the above mentioned command will check and clone all the missing neeto repos in the current working directory and will update all of them to the latest version. After the execution of command the directories will look something like this:
+
+```
+neeto-chat-web
+neeto-desk-web
+neeto-kb-web
+```
+
+
+
+## Working with local Repos
+
+Using the `local` command, we can interact with the local neeto repos.
+
+### ls
+
+The `ls` command can list the files from all the local neeto repos.
+
+This command will search and use the neeto repos in the current working directory.
+To fetch and update all neeto repos execute [make_repos_uptodate](#working-with-make-repos-uptodate) command before the `ls` command.
+
+```sh
+# The `ls` command will list all the files in the root directory of neeto repos.
+neetob local ls --apps "*"
+
+# The `ls` command can also list files in a specific directory using the
+# `--dir` option.
+neetob local ls --dir public --apps "*"
+
+# We can also list files in a nested directory.
+neetob local ls --dir app/controllers --apps "*"
+```
+
+## Testing
+
+For testing `github` commands use - [neeto-dummy](https://github.com/bigbinary/neeto-dummy) repo.
+
+For testing `heroku` commands use - [neeto-dummy](https://dashboard.heroku.com/apps/neeto-dummy) app.
+
+
+
+**Note:** Contact your respective Team Lead if you don't have access.

data/Rakefile

@@ -0,0 +1,16 @@
+# frozen_string_literal: true
+
+require "bundler/gem_tasks"
+require "rake/testtask"
+
+Rake::TestTask.new(:test) do |t|
+  t.libs << "test"
+  t.libs << "lib"
+  t.test_files = FileList["test/**/*_test.rb"]
+end
+
+require "rubocop/rake_task"
+
+RuboCop::RakeTask.new
+
+task default: %i[test rubocop]

data/data/branch-protection-rules.json

@@ -0,0 +1,25 @@
+// Check out the official [documentation](https://docs.github.com/en/rest/branches/branch-protection#update-branch-protection) 
+// by Github to know about all the available parameters or options to update different branch protection rules.
+{
+  "required_status_checks": {
+    "strict": true,
+    "contexts": ["ci/semaphoreci/pr: cicheck"]
+  },
+  "required_conversation_resolution": true,
+  "has_required_deployments": true,
+  "required_pull_request_reviews": {
+    "dismiss_stale_reviews": false,
+    "require_last_push_approval": false,
+    "require_code_owner_reviews": false,
+    "required_approving_review_count": 0
+  },
+  "required_signatures": false,
+  "enforce_admins": false,
+  "required_linear_history": false,
+  "allow_force_pushes": false,
+  "allow_deletions": true,
+  "block_creations": false,
+  "lock_branch": false,
+  "allow_fork_syncing": false,
+  "restrictions": null
+}

data/data/config-vars-audit.json

@@ -0,0 +1,18 @@
+{
+  "RACK_ENV": "production",
+  "RAILS_ENV": "production",
+  "AWS_REGION": "us-east-1",
+  "DEFAULT_SUBDOMAIN": "app",
+  "ENABLE_SSO": "true",
+  "NODE_MODULES_CACHE": "true",
+  "RAILS_LOG_TO_STDOUT": "enabled",
+  "RAILS_SERVE_STATIC_FILES": "enabled",
+  "SIDEKIQ_WEB_PASSWORD": "oneringtorulethemall",
+  "SPARKPOST_ADDRESS": "smtp.sparkpostmail.com",
+  "SPARKPOST_DOMAIN": "neeto.com",
+  "YARN_CACHE": "true",
+  "YARN_PRODUCTION": "true",
+  "ZEROBOUNCE_API_KEY": "b74debc37c9747fc84e79d7fb4dbdd68",
+  "AREA51_AUTHORIZED_EMAILS":"neeraj@bigbinary.com,unnikrishnan.kp@bigbinary.com,subin.siby@bigbinary.com"
+ 
+}

data/data/config-vars-list.json

@@ -0,0 +1 @@
+["key1"]

data/data/github-labels.json

@@ -0,0 +1,197 @@
+[
+  {
+    "name": "0.25D",
+    "description": "Estimate - 2 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "0.5D",
+    "description": "Estimate - 4 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "0.75D",
+    "description": "Estimate - 6 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "1D",
+    "description": "Estimate - 8 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "1.25D",
+    "description": "Estimate - 10 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "1.5D",
+    "description": "Estimate - 12 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "1.75D",
+    "description": "Estimate - 14 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "2D",
+    "description": "Estimate - 16 hours",
+    "color": "B0C4DE"
+  },
+  {
+    "name": "accepted",
+    "description": "The issue has been reviewed and considered a valid issue.",
+    "color": "A2D9CE"
+  },
+  {
+    "name": "backend",
+    "description": "Deals with Ruby & Rails code majorly.",
+    "color": "C2E0C6"
+  },
+  {
+    "name": "bug",
+    "description": "Something isn't working.",
+    "color": "D73A4A"
+  },
+  {
+    "name": "cypress-completed",
+    "description": "Cypress tests have finished running.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-flaky-test",
+    "description": "Fix cypress flaky tests.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-happy-path-completed",
+    "description": "Cypress happy path tests have finished running.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-happy-path-run",
+    "description": "Run the Cypress tests with the tag happy-path.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-happy-path-triggered",
+    "description": "Cypress happy path tests have been triggered.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-needed",
+    "description": "Cypress tests need to be written.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-run",
+    "description": "Run the Cypress tests.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "cypress-triggered",
+    "description": "Cypress tests have been triggered.",
+    "color": "FEF2C0"
+  },
+  {
+    "name": "documentation",
+    "description": "Improvements or additions to documentation.",
+    "color": "0075CA"
+  },
+  {
+    "name": "enhancement",
+    "description": "Enhancement or feature request.",
+    "color": "A2EEEF"
+  },
+  {
+    "name": "epic",
+    "description": "Will get closed when sub-issues fixed and this issue tracked in monthly milestone.",
+    "color": "6A5ACD"
+  },
+  {
+    "name": "frontend",
+    "description": "Deals with JS(React or JS configs etc) code majorly.",
+    "color": "C2E0C6"
+  },
+  {
+    "name": "high-priority",
+    "description": "Urgent fix required. Should be done within a day at max.",
+    "color": "B60205"
+  },
+  {
+    "name": "honeybadger",
+    "description": "Issue created by honeybadger.",
+    "color": "D3D3D3"
+  },
+  {
+    "name": "low-priority",
+    "description": "Other open issues can be taken up before this one.",
+    "color": "BFDADC"
+  },
+  {
+    "name": "neeto*-dependent",
+    "description": "This issue depends upon some other issue from neeto engines/frontend packages.",
+    "color": "E54D82"
+  },
+  {
+    "name": "on-hold",
+    "description": "Reason should be specified as a comment before putting issue/PR on-hold.",
+    "color": "E54D82"
+  },
+  {
+    "name": "perf-optimization",
+    "description": "Performance improvements, load testing, profiling etc.",
+    "color": "CAEE3E"
+  },
+  {
+    "name": "POC",
+    "description": "Proof of concept or doing spike work.",
+    "color": "008080"
+  },
+  {
+    "name": "PR",
+    "description": "The issue has a PR associated with it.",
+    "color": "D4C5F9"
+  },
+  {
+    "name": "priority",
+    "description": "Means I am waiting for this issue to be fixed in order to take care of other issues.",
+    "color": "BA080D"
+  },
+  {
+    "name": "refactoring",
+    "description": "Code changes, better way to organize code etc.",
+    "color": "CAEE3E"
+  },
+  {
+    "name": "security",
+    "description": "Vulnerabilities, security concerns etc.",
+    "color": "BA080D"
+  },
+  {
+    "name": "UI",
+    "description": "UI/CSS work needed.",
+    "color": "8250df"
+  },
+  {
+    "name": "UI-weekly-milestone",
+    "description": "This issue is part of the UI weekly milestone.",
+    "color": "F9D0C4"
+  },
+  {
+    "name": "UX-design-needed",
+    "description": "This issue is part of the UI weekly milestone.",
+    "color": "366FB9"
+  },
+  {
+    "name": "engineer-needed",
+    "description": "Engineer is needed to work on the issue",
+    "color": "#B0C4DE"
+  },
+  {
+    "name": "working",
+    "description": "This issue is part of the UI weekly milestone.",
+    "color": "D0ECE7"
+  }
+]

data/env.sample

@@ -0,0 +1 @@
+AUTH_PARAMS='{"provider": "github","client_id": "9aefff37f98713262fd0","grant_type": "urn:ietf:params:oauth:grant-type:device_code","auth_uris": {"auth_req": "https://github.com/login/device/code","token_req": "https://github.com/login/oauth/access_token"},"scope": "repo,user"}'