isoc-ams 0.0.1__py2.py3-none-any.whl

isoc_ams-0.0.1.dist-info/METADATA

@@ -0,0 +1,186 @@
+Metadata-Version: 2.4
+Name: isoc-ams
+Version: 0.0.1
+Summary: A Python 3 module to cope with ISOC-AMS.
+Author-email: Klaus Birkenbihl <klaus.birkenbihl@isoc.de>
+Maintainer: Klaus Birkenbihl
+Description-Content-Type: text/markdown
+Classifier: License :: OSI Approved :: MIT License
+License-File: LICENSE
+Requires-Dist: selenium>4
+Project-URL: Home, https://github.com/birkenbihl/isoc-ams
+
+
+# isoc-ams
+
+A Python Interface to access the 'Advanced Members Administration System' (AMS) of the 'Internet Society' (ISOC). This especially usefulfor ISOC Chapter Admins who want to synchronize their Chapter Database with AMS (semi)automatically.
+
+After 10 years+  of sorrow, millions minutes of waiting for answers from the AMS web interface, tons of useless clicks, many (in fact) rejected requests to provide an API access: the author decided to build an API himself. Even if it might not be more than a demonstrator for the functionality needed. Anyhow (see below): for now it is running on a weekly basis doing a great job in avoiding manual work. 
+
+Unfortunately the constraints are severe:
+- access had to be through the web interface since this is the only interface provided. As a consequence it is slow, sometimes unreliable and hard to implement. At least there are working implementations of the "W3C webdriver" recommendtion. One of them is Selenium used for this project.
+- the existing web interface is far from being stable or guarateed. So changes to the web interface might spoil the whole project. There is great chance that few weeks from now a new "super dooper" AMS will be announced and as always after these announcements things will get worse.
+- tests are close to impossible. There is no such thing as a TEST AMS.
+
+Is there a possible good exit? Well, maybe some day soon - in 10 or 20 years if ISOC still exists - there will be an API provided by ISOC that makes this project obsolete. Or at least may be an all-mighty AI will step in. Let's dream on!
+
+## Features
+ISOC maintains two main Lists that are relevant for the operation of this interface: 
+- a list of ISOC members registered as members of the Chapter
+- a list of ISOC members that applied for a Chapter membership.
+  
+Consequently isoc-ams provides methods for the following tasks:
+1. read list of ISOC members registered as Chapter members
+1. read list of ISOC members that applied for a Chapter membership
+1. approve ISOC AMS applications
+1. deny ISOC AMS applications
+1. delete members from ISOC AMS Chapters Member list
+1. add members to  ISOC AMS Chapters Member list (Chapter admins are not authorized to do this. So the author suggest to write a mail to ams-support.)
+
+Don't forget: it takes time and you may see many kinds of errors. Often the cure is "try again later". Any expectation of flawless is not appropriate.
+
+So here we go:
+
+## Installation
+
+Install isoc-ams with pip.
+
+```bash
+  python -m pip install -U isoc-ams
+```
+
+Best would be to use a virtual environment (venv).
+
+## Running isoc_ams
+
+You may select a webdriver of your choice (provided it is one of "firefox" or "chrome") by setting an environment variable ISOC_AMS_WEBDRIVER e.g.:
+```bash
+ISOC_AMS_WEBDRIVER=firefox
+```
+Recommended (and default) is "firefox".
+
+Since crazy things may happen it is important to keep track of what is going on. So ISOC_AMS lets you know what it is doing.
+by providing a logfile (goes to stdout by default).
+
+So this happens if we call the module with:
+```bash
+python -m isoc_ams
+```
+
+```
+Username: xxx
+Password: 
+
+AMS 2025-07-03 10:49:07 logging in
+AMS 2025-07-03 10:49:11 log in started
+AMS 2025-07-03 10:49:20 now on community portal
+AMS 2025-07-03 10:49:25 waiting for Chapter Leader portal
+AMS 2025-07-03 10:49:27 Chapter Leader portal OK
+
+
+AMS 2025-07-03 10:49:27 start build members list
+AMS 2025-07-03 10:49:27 Creating page for Members
+AMS 2025-07-03 10:49:33 Members page created
+AMS 2025-07-03 10:49:33 Loading Members
+AMS 2025-07-03 10:49:39 got list of Members
+AMS 2025-07-03 10:49:39 collecting the following fields: "ISOC-ID", "first name", "last name", "email"
+AMS 2025-07-03 10:49:39 Total (records expected): 38
+AMS 2025-07-03 10:49:39 Waiting for Total to stabilise
+AMS 2025-07-03 10:49:42 Total (records expected): 59
+AMS 2025-07-03 10:49:45 calling reader with 31 table rows,  (collected records so far: 0 )
+AMS 2025-07-03 10:49:50 calling reader with 32 table rows,  (collected records so far: 29 )
+AMS 2025-07-03 10:49:54 calling reader with 24 table rows,  (collected records so far: 53 )
+AMS 2025-07-03 10:49:55 records collected / total 59  / 59
+AMS 2025-07-03 10:49:55 Creating page for Member Contacts
+AMS 2025-07-03 10:50:00 Member Contacts page created
+AMS 2025-07-03 10:50:00 Loading Member Contacts
+AMS 2025-07-03 10:50:04 got list of Member Contacts
+AMS 2025-07-03 10:50:04 collecting the following fields: "action link" (for taking actions), "email" (to connect with members list)
+AMS 2025-07-03 10:50:04 Total (records expected): 8
+AMS 2025-07-03 10:50:04 Waiting for Total to stabilise
+AMS 2025-07-03 10:50:07 Total (records expected): 59
+AMS 2025-07-03 10:50:10 calling reader with 30 table rows,  (collected records so far: 0 )
+AMS 2025-07-03 10:50:14 calling reader with 31 table rows,  (collected records so far: 28 )
+AMS 2025-07-03 10:50:18 calling reader with 25 table rows,  (collected records so far: 51 )
+AMS 2025-07-03 10:50:18 records collected / total 59  / 59
+AMS 2025-07-03 10:50:18 members list finished
+
+
+AMS 2025-07-03 10:50:18 start build pending applications
+AMS 2025-07-03 10:50:18 Creating page for Pending Applications
+AMS 2025-07-03 10:50:22 collecting the following fields: "name", "email", "action link", "date"
+AMS 2025-07-03 10:50:24 Total (records expected): 8
+AMS 2025-07-03 10:50:24 Waiting for Total to stabilise
+AMS 2025-07-03 10:50:27 Total (records expected): 8
+AMS 2025-07-03 10:50:30 calling reader with 8 table rows,  (collected records so far: 0 )
+AMS 2025-07-03 10:50:31 records collected / total 8  / 8
+AMS 2025-07-03 10:50:31 pending application list finished
+
+
+MEMBERS
+1 ...
+2 ...
+...
+
+PENDING APPLICATIONS
+1 ...
+2 ...
+...
+```
+
+Normally isoc_ams wont show any browser output - running headless. To do debugging it might useful to follow the activities in the browser. If you call isoc_ams with a -h option the browser will open.
+
+## Using the API
+
+isoc_ams unleashes its full power when used as API to make things happen without human intervention. Check the file "isoc_de_ams_main.py" as an example for fully automatic synchronizing of local membership administration with AMS.
+
+Here an excerpt of the output:
+```
+Pending Applications:
+
+   the following pending applications will be approved:
+   ...
+   the following pending applications will be denied:
+   ...
+   the following pending applications will be invited:
+   ...
+   the following pending applications will be waiting:
+   ...
+
+Members:
+   the following members will be deleted from AMS:
+   ...
+   for the following members a nagging mail will be sent to AMS-support (we are not authorized to fix it!):
+   ...
+   the following members are in sync
+   ...
+      
+AMS 2025-07-03 12:00:32 start delete ... from AMS Chapter members list
+   ...
+
+Dear MAS-support team,
+this is an automatic, complimentary Message from the ISOC German Chapter
+Members Administration System (ISOC.DE MAS).
+
+The following individuals are legally registered paying members
+of ISOC.DE - many of them for more than 25 years.
+...
+   Uwe Mayer, xxx@yyy.com (ISOC-ID=1234567)
+   ...
+   
+Thank you,
+Your ISOC.DE MAS support team
+...
+
+DEVIATIONS FROM EXPECTED RESULTS
+not deleted from members
+...
+not approved from pending applicants list
+...
+not removed from pending applicants list
+...
+```
+See file isoc_ams.doc for doc on the API interface.
+
+Have fun!
+

isoc_ams-0.0.1.dist-info/RECORD

@@ -0,0 +1,5 @@
+isoc_ams.py,sha256=_856QxwvSovWra0iOyOafpYm6K_aVVg_D14X4drq62M,31231
+isoc_ams-0.0.1.dist-info/licenses/LICENSE,sha256=BJcMew_kvBWHjs-_Hd_OMHnxOLmeczeT88V4gFCT21U,1067
+isoc_ams-0.0.1.dist-info/WHEEL,sha256=Dyt6SBfaasWElUrURkknVFAZDHSTwxg3PaTza7RSbkY,100
+isoc_ams-0.0.1.dist-info/METADATA,sha256=nfcgOmUP9GbfkcXdb4UIJtqoYy-dRFkdT-PFxLOG8eQ,7746
+isoc_ams-0.0.1.dist-info/RECORD,,

isoc_ams-0.0.1.dist-info/WHEEL

@@ -0,0 +1,5 @@
+Wheel-Version: 1.0
+Generator: flit 3.12.0
+Root-Is-Purelib: true
+Tag: py2-none-any
+Tag: py3-none-any

isoc_ams-0.0.1.dist-info/licenses/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2025 birkenbihl
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

isoc_ams.py

@@ -0,0 +1,818 @@
+#!/usr/bin/env python3
+
+# -*- coding: utf-8 -*-
+
+"""Extract or modify Chapter Data of the ISOC AMS (Salesforce) Database.
+
+This module consists of a Class ISOC_AMS wrapping _ISOC_AMS which subclasses
+the webdriver.<browser> of Selenium. Up to now ownly firefox and chrome
+drivers are implemented and tested.
+
+The ISOC_AMS class provides the following properties:
+    members_list:
+        a list of Chapter members (according to AMS) with data (and links)
+    pending_applicants_list:
+        a list of pending appplicants  (according to AMS) for a Chapter
+        membership with data (and links)
+these properties are initialized on first access ... and it will take time
+
+The ISOC_AMS class provides the following methods:
+    build_members_list:
+        to build a list of Chapter members with data (and links)
+    build_pending_applicants_list:
+        to build a list of pending appplicants for a Chapter membership with data (and links)
+    deny_applicants:
+        to deny Chapter membership for a list of applicants
+    approve_applicants:
+        to approve Chapter membership for a list of applicants
+    delete_members:
+        to revoke Chapter membership for members from the members list
+    difference_from_expected:
+        to reread AMS and check if all operations were successfull (not ever
+        problem can be detected by the methods)
+
+ISOC_AMS will log you in to ISOC.ORG and check your authorization at
+instantiation.
+
+To select a webdriver, an ISOC_AMS_WEBDRIVER environment variable can be used.
+E.g.
+    ISOC_AMS_WEBDRIVER=Firefox
+
+Default is Firefox. Only Firefox and Chrome are allowed for now.
+
+Example
+_______
+    from isoc_ams import ISOC_AMS
+    userid, password = "myuserid", "mysecret"
+
+    # this will log you in
+    # and instantiate an ISOC_AMS object
+    ams = ISOC_AMS(userid, password)
+
+    # this will read the list of members,
+    # registered as chapters members
+    members = ams.members_list
+
+    # print the results
+    for isoc_id, member in members.items():
+        print(isoc_id,
+              member["first name"],
+              member["last name"],
+              member["email"],
+             )
+    # select members to be deleted
+    deletees = <...>  # various formats are allowed for operation methods
+    delete_members(deletees)
+
+    # check if all went well
+    print(difference_from_expected())
+
+"""
+__version__ = "0.0.1"
+
+from selenium import webdriver
+from selenium.webdriver.common.by import By
+from selenium.webdriver.support.wait import WebDriverWait, TimeoutException
+from selenium.webdriver.support import expected_conditions as EC
+from datetime import datetime
+
+import io
+import time
+import sys
+import os
+
+_dr = os.environ.get("ISOC_AMS_WEBDRIVER", "firefox").lower()
+
+if  _dr == "firefox":
+    _options = webdriver.FirefoxOptions()
+    Driver = webdriver.Firefox
+elif _dr == "chrome":
+    _options = webdriver.ChromeOptions()
+    Driver = webdriver.Chrome
+else:
+    sys.exit("Selenium Driver " + _dr + " not implemented.")
+
+
+def _WaitForTextInElement(element):
+
+    def _predicate(_):
+        return element.text
+    return _predicate
+
+
+class ISOC_AMS:
+    """Perform admin operations on a Chaper's members list stored in AMS.
+
+    Since it is about web driving the activities on the website are logged
+    to check what's going on (on the Website)'. Default is logging to
+    stdout.
+
+    By default all operations run headless. If you want to follow it on
+    a browser window use headless=False.
+
+    Args
+    ____
+        user: username (email) for ISO.ORG login
+        password: password for ISO.ORG login
+        logfile: where to write ISOC_AMS log output
+        headless: run without GUI
+
+    """
+
+    def __init__(self,
+                 user: str,
+                 password: str,
+                 logfile: io.StringIO | str = sys.stdout,
+                 headless: bool = True):
+        if _dr == "firefox" and headless:
+            _options.add_argument("--headless")
+        elif _dr == "chrome" and headless:
+            _options.add_argument("--headless=new")
+        self._members_list: dict | None = None
+        self._pending_applications_list: dict | None = None
+        self._ams = _ISOC_AMS(user, password, logfile)
+
+    @property
+    def members_list(self) -> dict:
+        """Collects data about Chapter members.
+
+        Collects the relevant data about ISOC members
+        registered as Chapter members in AMS
+
+        Returns
+        -------
+            dictionary with the following scheme:
+                {<ISOC-ID>:
+                     {"first name": <first name>,
+                      "last name": <last name>,
+                      "email": <Email address>',
+                      "action link": <url of page to edit this entry>
+                     },
+                  ...
+                 }
+
+        So ISOC-ID is used as key for the entries
+        """
+        if self._members_list is None:
+            self._members_list = self._ams.build_members_list()
+        return self._members_list
+
+    @property
+    def pending_applications_list(self) -> dict:
+        """Collects data about pending Chapter applicants.
+
+        Collects the relevant data about pending Chapter applicants
+        registered as pending Chapter applicants in AMS
+
+        Returns
+        -------
+            dictionary with the following scheme:
+                {<ISOC-ID>:
+                     {"name": <name>,
+                      "email": <Email address>',
+                      "action link": <url of page to edit this entry>
+                     },
+                  ...
+                 }
+        ---------------------------------------------
+        So ISOC-ID is used as key for the entries
+        """
+        if self._pending_applications_list is None:
+            self._pending_applications_list = \
+                self._ams.build_pending_applicants_list()
+        return self._pending_applications_list
+
+    def delete_members(self, delete_list: list | dict | str | int):
+        """Delete Member(s) from AMS-list of Chapter members.
+
+        Args
+        ----
+            delete_list: list of dict-entrys, or ISOC-IDs, or single entry
+                         or ISOC-ID
+
+        deletes delete_list entries from AMS-list of Chapter members
+        """
+        if type(delete_list) in (str, int):
+            delete_list = str(delete_list),
+        for deletee in delete_list:
+            if deletee in self._members_list:
+                self._ams.delete(self._members_list[deletee])
+                del self._members_list[deletee]
+            else:
+                self._ams.strong_msg("ISOC-ID", deletee,
+                                     "is not in AMS Chapter members list" )
+
+
+    def approve_pending_applications(self, approve_list: list | dict | str | int):
+        """Approve pending Members as Chapter members.
+
+        Args
+        ----
+            approve_list: list of dict-entrys, or ISOC-IDs, or single entry
+                          or ISOC-ID
+
+        approves pending members on approve_list as Chapter members
+        """
+        if type(approve_list) in (int, str):
+            approve_list = str(approve_list),
+        for approvee in approve_list:
+            if approvee in self._pending_applications_list:
+                self._ams.approve(self._pending_applications_list[approvee])
+                del self._pending_applications_list[approvee]
+            else:
+                self._ams.strong_msg("ISOC-ID", approvee,
+                                     "is not in pending applications list" )
+
+    def deny_pending_applications(self,
+                                  deny_list: list | dict | str | int,
+                                  reason: str = "Timeout, did not apply"):
+        """Denies pending Members Chapter membership.
+
+        Args
+        ----
+            deny_list: list of dict-entrys, or ISOC-IDs, or single entry
+                       or ISOC-ID
+            reason: All denied applicants are denied for
+
+        denies Chapter membership for members on deny_list
+
+        """
+        if type(deny_list) in (str, int):
+            deny_list = str(deny_list),
+        for denyee in deny_list:
+            if denyee in self._pending_applications_list:
+                self._ams.deny(self._pending_applications_list[denyee],
+                                  reason)
+                del self._pending_applications_list[denyee]
+            else:
+                self._ams.strong_msg("ISOC-ID", denyee,
+                                     "is not in pending applications list" )
+
+    def difference_from_expected(self) -> dict:
+        """Compare intended outcome of operations with real outcome.
+
+        Returns
+        -------
+        A dict containing deviations of the inteded outcome:
+            {
+                "not deleted from members":
+                    All entries in AMS-Chapter-Members that were supposed
+                    to be deleted,
+                "not approved from pending applicants list":
+                    All entries in pending applications that were supposed
+                    to be approved but were not added to the AMS-Chapter-Members
+                "not removed from pending applicants list":
+                    All entries in pending applications that should be
+                    removed - either since approved or since denied
+            }
+
+        """
+        self._ams.log(date=False)
+        self._ams.log("collect differences from expected result after operations")
+
+        not_deleted = {}
+        not_approved = {}
+        not_removed_from_pending = {}
+        new_members_list = self._ams.build_members_list()
+        for nm in new_members_list:
+            if nm not in self._members_list:
+                not_deleted[nm] = new_members_list[nm]
+        for nm in self._members_list:
+            if nm not in new_members_list:
+                not_approved[nm] = self._members_list[nm]
+        new_pending_applications_list = self._ams.build_pending_applicants_list()
+        for np in new_pending_applications_list:
+            if np not in self._pending_applications_list:
+                not_removed_from_pending[np] = new_pending_applications_list[np]
+
+        return {"not deleted from members": not_deleted,
+                "not approved from pending applicants list": not_approved,
+                "not removed from pending applicants list": not_removed_from_pending}
+
+class _ISOC_AMS(Driver):
+
+    def __init__(self, user: str, password: str, logfile: str = sys.stdout):
+
+        super().__init__(_options)
+        self.windows = {}
+        self.logfile = logfile
+        if type(self.logfile) is str:
+            self.logfile = open(self.log, "a")
+        self.login(user, password)
+
+    def __del__(self):
+        self.quit()
+
+#
+# utilities
+#
+
+    def log(self, *args, date=True, **kwargs):
+        if date:
+            print("AMS", datetime.now().isoformat(" ", timespec="seconds"),
+                  *args,
+                  file=self.logfile,
+                  **kwargs)
+        else:
+            print(
+                  *args,
+                  file=self.logfile,
+                  **kwargs)
+
+    def strong_msg(self, *args, **kwargs):
+        x = 0
+        for t in args:
+            x += len(str(t)) + 1
+        x = x + 1 + 30
+        self.log("\n" + x * "*", date=False)
+        self.log(*args, **kwargs)
+        self.log(x * "*", date=False)
+
+    def activate_window(self, name: str, url: str | None = None, refresh: bool = False):
+        if self.windows.get(name):
+            # self.log("switching to window", name)
+            self.switch_to.window(self.windows[name])
+            if refresh:
+                self.navigate().refresh()
+            if url:
+                self.get(url)
+            return True
+        elif url:
+            # self.log("switching to NEW window", name)
+            self.switch_to.new_window('tab')
+            self.windows[name] = self.current_window_handle
+            self.get(url)
+            return True
+        else:
+            sys.exit('neither name nor url specified for "activate_window"'
+                     'or window "' + name + '" not found')
+
+
+    def waitfor(self, cond, val, timeout=20, message="", by=By.XPATH):
+        try:
+            if val:
+                elem = WebDriverWait(self, timeout).until(
+                    cond((by, val)))
+            else:
+                elem = WebDriverWait(self, timeout).until(cond)
+            return elem
+        except TimeoutException:
+            self.strong_msg(message)
+            raise
+
+#
+# setup session, init windows
+#
+
+    def login(self, user: str, password: str):
+        # Sign on user and navigate to the Chapter leaders page,
+
+        self.log(date=False)
+        self.log("logging in")
+
+        # go to community home page after succesfullogin
+        self.get("https://community.internetsociety.org/s/home-community")
+        # login
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "next",
+                            by=By.ID,
+                            message="timelimit exceeded while waiting "
+                            "for login page to complete")
+        # we use JS to fill the logi form, since sendkeys doesn'twork properly
+        self.execute_script(
+            "document.getElementById('signInName').value='%s';"
+            "document.getElementById('password').value='%s';"
+            "arguments[0].click();"
+            % (user, password),
+            elem)
+
+        # self.set_window_size(1600, 300)
+        self.log("log in started")
+        # community portal
+        self.waitfor(EC.presence_of_element_located,
+                     "siteforceStarterBody",
+                     by=By.CLASS_NAME,
+                     message="timelimit exceeded while waiting "
+                     "for Community portal to open")
+
+        self.log("now on community portal")
+
+        # open chapter Leader Portal
+        self.get("https://community.internetsociety.org/leader")
+        self.log("waiting for Chapter Leader portal")
+
+        # look if menue appears to be ready (and grab link to reports page)
+        reports_ref = self.waitfor(EC.element_to_be_clickable,
+                                   "//a[starts-with(@href,"
+                                   "'/leader/s/report/')]",
+                                   message="timelimit exceeded while waiting "
+                                   "for Chapter Leader portal to open"
+                                   )
+        # since group applications from the report page don't provide an ISOC ID
+        # we need it from the leader page menue
+        group_application_ref = self.waitfor(
+            EC.element_to_be_clickable,
+            "//a[starts-with(@href,"
+            "'/leader/s/isoc-group-application/')]",
+            message="timelimit exceeded while waiting "
+            "for Chapter Leader portal to open"
+            )
+
+        self.windows["leader"] = self.current_window_handle
+        self.log("Chapter Leader portal OK")
+        self.log(date=False)
+
+        # get lists (in an extra "reports" tab)
+        self.reports_link = reports_ref.get_attribute('href')
+        self.group_application_link = group_application_ref.get_attribute('href')
+        self.reports_page_ready = (EC.element_to_be_clickable,
+                                   "//table//lightning-button//button")
+#
+#   functions to aquire data
+#
+
+    def build_members_list(self) -> dict:
+
+        # we have to scrape data from 2 pages called:
+        #   Active Chapter Members
+        #   Active Members with Contact Info
+        # reason is Active Chapter Members doesn't give us the link to
+        # act on the list (to delete members)
+
+        self.log(date=False)
+        self.log("start build members list")
+        self.create_report_page("Members",
+                                "Active Chapter Members")
+        self.load_report("Members")
+        members = self.get_table(self.get_members)
+
+        self.create_report_page("Member Contacts",
+                                "Active Members with Contact Info")
+        self.load_report("Member Contacts")
+        contacts = self.get_table(self.get_member_contacts)
+
+        for k, v in members.items():
+            v["action link"] = contacts.get(v["email"])
+        self.log("members list finished")
+        self.log(date=False)
+        return members
+
+    def build_pending_applicants_list(self) -> dict:
+        """Collect the relevant dataabout members registered as chapters members.
+
+        Returns:
+            A 2 level dictionary
+                ISOC-ID of pending applicants: dictionary with relevant fields
+        """
+        # we have to scrape data from the page provided via the menue
+        # reason is the page referred to in the reports page doesn't give
+        # us the ISOC-ID
+
+        self.log(date=False)
+        self.log("start build pending applications")
+        self.log("Creating page for Pending Applications")
+        msg = "timelimit exceeded while waiting " \
+            "for report page for Pending Application report"
+        cond = (EC.presence_of_element_located,
+#                "table.slds-table td.cellcontainer a.forceOutputLookup")
+                "table")
+        self.activate_window("report",
+                             url=self.group_application_link)
+        pendings = self.get_table(self.get_pendings)
+        self.log("pending application list finished")
+        self.log(date=False)
+        return pendings
+
+    def create_report_page(self, subject, button_title):
+        self.log("Creating page for", subject)
+        msg = "timelimit exceeded while waiting " \
+            "for report page for " + subject + " report"
+        self.activate_window("report",
+                             url=self.reports_link)
+        elem = WebDriverWait(self, 30).until(EC.element_to_be_clickable((
+            By.XPATH,
+            "//table//lightning-button"
+            "//button[@title='%s']" % button_title)
+            ))
+        time.sleep(1)
+        self.execute_script('arguments[0].click();', elem)
+        self.log(subject, "page created")
+
+    def load_report(self, subject):
+        self.log("Loading", subject)
+        cond = EC.presence_of_element_located;
+        val = "iframe"
+        msg = "timelimit exceeded while waiting " \
+              "waiting for list of " + subject
+        iframe = self.waitfor(EC.presence_of_element_located, "iframe.isView",
+                     message=msg, timeout=30, by=By.CSS_SELECTOR)
+
+        # this is so strange: this page doesnt hold all columns (fields) if
+        # they don't fit on the iframe. So we have to set a new (big) width
+        # to receive the required data
+        self.execute_script('arguments[0].style.width = "4000px";', iframe)
+
+        WebDriverWait(self, 5).until(
+            EC.frame_to_be_available_and_switch_to_it((By.CSS_SELECTOR,
+                                                       "iframe.isView")))
+        self.waitfor(EC.presence_of_element_located, "//table//tbody//td",
+                     message=msg)
+        self.log("got list of", subject)
+
+    def get_table(self, reader: callable):
+        # this is a wrapper for reading tables
+        # the reading itself is done by the reader argument
+        def getint(s: str) -> int:
+            # get integer from start of string
+            i = 0
+            for c in s:
+                if c.isdigit():
+                    i += 1
+                else:
+                    break
+            return int(s[:i])
+        if reader == self.get_members:
+            self.log('collecting the following fields: "ISOC-ID", "first name", '
+                '"last name", "email"')
+        if reader == self.get_member_contacts:
+            self.log('collecting the following fields: '
+                '"action link" (for taking actions), '
+                '"email" (to connect with members list)')
+        if reader == self.get_pendings:
+            self.log('collecting the following fields: "name", "email", '
+                '"action link", "date"')
+        # if reader == self.get_pendings:
+        #     self.log('collecting the following fields: "name", "email", '
+        #         '"contact link", "action link", "date"')
+
+
+        if reader == self.get_pendings:
+            tableselector = "table.uiVirtualDataTable tbody tr"
+            total_elem = self.waitfor(
+                EC.presence_of_element_located,
+                "//force-list-view-manager-status-info/span/span",
+                message="timeout waiting for Metrics",
+                timeout=30)
+        else:
+            tableselector = "table.data-grid-full-table tbody tr"
+            self.waitfor(EC.presence_of_element_located,
+                         "span.metricsAnnouncement",
+                         by=By.CSS_SELECTOR,
+                         message="timeout waiting for Metrics",
+                         timeout=30)
+            total_selector = "div.metricsValue"
+            total_elem = self.find_element(By.CSS_SELECTOR, total_selector)
+        WebDriverWait(self, 10).until(_WaitForTextInElement(total_elem))
+        total = getint(total_elem.text)
+        self.log("Total (records expected):", total)
+        self.log("Waiting for Total to stabilise")
+        # wait a few seconds for total to become stable
+        time.sleep(3)
+        total = getint(total_elem.text)
+        self.log("Total (records expected):", total)
+        data = {}
+        while total > len(data):
+            time.sleep(3)
+            rows = self.find_elements(
+                By.CSS_SELECTOR, tableselector)
+            self.log("calling reader with", len(rows), "table rows, ",
+                  "(collected records so far:", len(data),")")
+            scr_to = reader(rows, data)
+            if getint(total_elem.text) != total:
+                total = getint(total_elem.text)
+                self.log("Total was updated, now:", total)
+            if len(data) < total:
+                self.execute_script('arguments[0].scrollIntoView(true);', scr_to)
+            else:
+                self.log("records collected / total", len(data), " /", total)
+                return data
+
+    def get_members(self, rows, members):
+        for row in rows:
+            cells = row.find_elements(By.CSS_SELECTOR, "td")
+            # self.log(row.text.replace("\n"," / "))
+            if cells and cells[0].text and cells[0].text not in members.keys():
+                member = {}
+                member["first name"] = cells[1].text
+                member["last name"] = cells[2].text
+                member["email"] = cells[7].text
+                members[cells[0].text] = member
+            orow = row
+        return orow
+
+    def get_member_contacts(self, rows, members):
+        for row in rows:
+            # self.log(row.text.replace("\n"," / "))
+            cells = row.find_elements(By.CSS_SELECTOR, "td")
+            # self.log(len(cells), "cells")
+            if cells and \
+                    len(cells) > 11 and \
+                    cells[11].text and \
+                    cells[11].text not in members.keys():
+                lnk = cells[1].find_element(By.CSS_SELECTOR, "a[href]"). \
+                    get_attribute('href')
+                members[cells[11].text] = lnk
+            orow = row
+        return orow
+
+    def get_pendings(self, rows, pendings):
+        for row in rows:
+            cells = row.find_elements(By.CSS_SELECTOR, ".slds-cell-edit")
+            # self.log(row.text.replace("\n"," / "))
+            if cells and cells[3].text:
+                pending = {}
+                pending["name"] = cells[4].text
+                pending["email"] = cells[5].text
+                # pending["contact link"] = cells[4]. \
+                #     find_element(By.CSS_SELECTOR, "a[href]"). \
+                #         get_attribute('href')
+                pending["action link"] = cells[3]. \
+                    find_element(By.CSS_SELECTOR, "a[href]"). \
+                        get_attribute('href')
+                pending["date"] = datetime.strptime(
+                    cells[10].text, "%m/%d/%Y")
+                    # . strftime("%Y-%m-%d ")  + " 00:00:00"
+                pendings[cells[6].text] = pending
+            orow = row
+        return orow
+
+#
+#  operations on data
+#
+
+    def deny(self, entry, reason):
+        time_to_wait = 100
+        self.log(date=False)
+        self.log("start denial for", entry["name"])
+        # operation will take place in an own tab
+        self.activate_window("action",
+                             url=entry["action link"])
+
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            '//button'
+                            '[contains(text(),'
+                            '"Deny Applicant")]',
+                            message="timelimit exceeded while waiting "
+                            "waiting for details page for " +
+                            entry["name"] + " to complete")
+
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+
+        d_close = WebDriverWait(self, 10, 0.3). \
+                until(EC.presence_of_element_located((
+                    By.CSS_SELECTOR, 'button.slds-modal__close')))
+
+        self.log("select a reason for denial to feed AMS's couriosity")
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "//div"
+                            "[contains(concat(' ',normalize-space(@class),' '),"
+                            "'slds-dropdown-trigger')]",
+                            message="timelimit exceeded while waiting "
+                            "for deny reason box")
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+###
+        self.log("Waiting for combobox, chose 'other'")
+
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "//lightning-base-combobox-item"
+                            "[@data-value='Other']",
+                            message="timelimit exceeded while waiting "
+                            "for deny reason 'Other'")
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+
+        elem = self.waitfor(EC.presence_of_element_located,
+                            "//flowruntime-record-field"
+                            "//lightning-primitive-input-simple"
+                            "//input",
+                            message="timelimit exceeded while waiting "
+                            "for deny reason 'Other - Details'")
+        self.log(f"we'll give '{reason}' as reason")
+        time.sleep(1)
+        # elem.send_keys(reason)
+        self.execute_script(f'arguments[0].value="{reason}";', elem)
+        self.log("finally click next")
+
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "//flowruntime-navigation-bar"
+                            "/footer"
+                            "//lightning-button/button",
+                            message="timelimit exceeded while waiting "
+                            "for 'Next' button to complete")
+        time.sleep(2)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+        try:
+            WebDriverWait(self, 15).until(EC.staleness_of(d_close))
+        except TimeoutException:
+            self.strong_msg("Timeout: Maybe operation was not performed")
+            self.log(date=False)
+            return False
+        self.log("done")
+        return True
+
+    def approve(self, entry):
+        self.log(date=False)
+        self.log("start approval for", entry["name"])
+
+        self.activate_window("action",
+                             url=entry["action link"])
+
+        elem = self.waitfor(EC.presence_of_element_located,
+                            '//button'
+                            '[contains(text(),'
+                            '"Approve Applicant")]',
+                            message="timelimit exceeded while waiting "
+                            "waiting for details page for " +
+                            entry["name"] + " to complete")
+
+        self.log("starting with approval")
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+
+        d_close = WebDriverWait(self, 10, 0.3). \
+                until(EC.presence_of_element_located((
+                    By.CSS_SELECTOR, 'button.slds-modal__close')))
+
+        self.log("finally click next")
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "//flowruntime-navigation-bar"
+                            "/footer"
+                            "//lightning-button/button",
+                            message="timelimit exceeded while waiting "
+                            "for 'Next' button to complete")
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+
+        try:
+            WebDriverWait(self, 15).until(EC.staleness_of(d_close))
+        except TimeoutException:
+            self.strong_msg("Timeout: Maybe operation was not performed")
+            self.log(date=False)
+            return False
+        self.log("done")
+        return True
+
+
+    def delete(self, entry):
+        self.log(date=False)
+        name = entry["first name"] + " " + entry["last name"]
+        self.log("start delete", name, "from AMS Chapter members list" )
+
+        self.activate_window("action",
+                             url=entry["action link"])
+
+        elem = self.waitfor(EC.element_to_be_clickable,
+                            "//runtime_platform_actions-action-renderer"
+                            "[@title='Terminate']"
+                            "//button",
+                            message="timelimit exceeded while waiting "
+                            "waiting for details page for " +
+                            name + " to complete")
+
+        time.sleep(1)  # for what ist worth?
+        self.execute_script('arguments[0].click();', elem)
+
+        d_close = WebDriverWait(self, 10, 0.3). \
+                until(EC.presence_of_element_located((
+                    By.CSS_SELECTOR, 'button.slds-modal__close')))
+
+        try:
+            WebDriverWait(self, 15).until(EC.staleness_of(d_close))
+        except TimeoutException:
+            self.strong_msg("Timeout: Maybe operation was not performed")
+            self.log(date=False)
+            return False
+        self.log("done")
+        return True
+
+
+if __name__ == "__main__":
+    from getpass import getpass
+    headless = True
+    if "-h" in sys.argv:
+        headless=False
+    print("Username", end=":")
+    user_id = input()
+    password = getpass()
+    ams = ISOC_AMS(
+        user_id,
+        password,
+        headless=headless)
+    members = ams.members_list
+    pendings = ams.pending_applications_list
+
+    print("\nMEMBERS")
+    i = 0
+    for k, v in members.items():
+        i += 1
+        print(i, k + ":", v["first name"], v["last name"], v["email"], v["action link"])
+
+    print("\nPENDING APPLICATIONS")
+    i = 0
+    for k, v in pendings.items():
+        i += 1
+        # print(i, k, v)
+        print(i, k, v["name"], v["email"], v["action link"],
+              v["date"].isoformat()[:19])