citation-map 3.7__tar.gz → 3.9__tar.gz

{citation-map-3.7 → citation-map-3.9}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: citation-map
-Version: 3.7
+Version: 3.9
 Summary: A simple tool to generate your Google Scholar citation world map.
 Home-page: https://github.com/ChenLiu-1996/CitationMap
 Author: Chen Liu
@@ -43,10 +43,6 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Usage
 1. Install the package.
-    ```
-    pip install citation-map
-    ```
-    Remember to upgrade to the latest version if you installed an earlier version.
     ```
     pip install citation-map --upgrade
     ```
@@ -91,8 +87,23 @@ If you open it on a browser, you will see your own version of the following cita
         If true, print the list of citing institutions (affiliations of citing authors).
     ```
 
+## Limitations
+
+1. This tool is purely based on Google Scholar. As a result, you are expected to have underestimations due to reasons such as:
+    - Your Google Scholar profile is not up-to-date.
+    - Some papers citing you are not indexed by Google Scholar.
+    - Some authors citing you do not have Google Scholar profile.
+    - Some authors citing you do not report their affiliations.
+2. `geopy.geocoders` is used to convert the citing authors' affiliations to geographic coordinates. To facilitate the process, I used some simple rule-based natural language processing to clean up the affiliations. As a result, you are expected to have:
+    - Underestimation if correct affiliations are not found by `geopy.geocoders`.
+    - Underestimation if we experience communication error with `geopy.geocoders`.
+    - Overestimation if non-affiliation terms are incorrectly identified as locations by `geopy.geocoders`.
+
+    **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+
+
 ## Debug
-1. `scholarly._proxy_generator.MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
+1. `MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
 
     - From my experience, both are good indicators that your IP address is blocked by Google Scholar due to excessive crawling (using the `scholarly` package).
     - One hot fix I found was to hop on a University VPN and run again. I typically experience this error after running the tool twice, and I need to disconnect and reconnect my VPN to "unblock" myself.
@@ -100,33 +111,49 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Changelog
 
-### Version 3.7
-I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
+<details>
+<summary>Version 3.9</summary>
+<br>
+In 3.9, I slightly improved the logic for affiliation extraction.
+
+In 3.8, I removed multiprocessing for `geopy.geocoders` as per their official documentation. Also I cleaned up some unnecessary `scholarly` calls which further helps us not get blacklisted by Google Scholar.
+
+In 3.7, I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
 
-**Now we should be able to handle users with more citations than before. I tested on a profile with 400 citations without running into any issue.**
+**Now we should be able to handle users with more citations than before. I tested on a profile with 1000 citations without running into any issue.**
+</details>
 
-### Version 3.0
-I realized a problem with how I used `geopy.geocoders`. A majority of the authors' self-entered affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
+<details>
+<summary>Version 3.0</summary>
+<br>
+I realized a problem with how I used `geopy.geocoders`. A majority of the authors' affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
 
 For example, we would want the substring "Yale University" from the string "Assistant Professor at Yale University".
 
 I applied a simple fix with some rule-based natural language processing. This helps us identify many missing citing locations.
 
 **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+</details>
 
-### Version 2.0
+<details>
+<summary>Version 2.0</summary>
+<br>
 I finally managed to **drastically speed up** the process using multiprocessing, in a way that avoids being blocked by Google Scholar.
 
 On my personal computer, processing my profile with 100 citations took 1 hour with version 1.0 while it's now taking 5 minutes with version 2.0.
 
 With that said, please be careful and do not run this tool frequently. I can easily get on Google Scholar's blacklist after a few runs.
+</details>
 
-### Version 1.0
+<details>
+<summary>Version 1.0</summary>
+<br>
 Very basic functionality.
 
 This script is a bit slow. On my personal computer, it takes half a minute to process each citation. If you have thousands of citations, it may or may not be a good idea to use this script.
 
 I tried to use multiprocessing, but unfortunately the excessive visits get me blocked by Google Scholar.
+</details>
 
 ## Dependencies
 Dependencies (`scholarly`, `geopy`, `folium`, `tqdm`) are already taken care of when you install via pip.

{citation-map-3.7 → citation-map-3.9}/README.md

@@ -27,10 +27,6 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Usage
 1. Install the package.
-    ```
-    pip install citation-map
-    ```
-    Remember to upgrade to the latest version if you installed an earlier version.
     ```
     pip install citation-map --upgrade
     ```
@@ -75,8 +71,23 @@ If you open it on a browser, you will see your own version of the following cita
         If true, print the list of citing institutions (affiliations of citing authors).
     ```
 
+## Limitations
+
+1. This tool is purely based on Google Scholar. As a result, you are expected to have underestimations due to reasons such as:
+    - Your Google Scholar profile is not up-to-date.
+    - Some papers citing you are not indexed by Google Scholar.
+    - Some authors citing you do not have Google Scholar profile.
+    - Some authors citing you do not report their affiliations.
+2. `geopy.geocoders` is used to convert the citing authors' affiliations to geographic coordinates. To facilitate the process, I used some simple rule-based natural language processing to clean up the affiliations. As a result, you are expected to have:
+    - Underestimation if correct affiliations are not found by `geopy.geocoders`.
+    - Underestimation if we experience communication error with `geopy.geocoders`.
+    - Overestimation if non-affiliation terms are incorrectly identified as locations by `geopy.geocoders`.
+
+    **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+
+
 ## Debug
-1. `scholarly._proxy_generator.MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
+1. `MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
 
     - From my experience, both are good indicators that your IP address is blocked by Google Scholar due to excessive crawling (using the `scholarly` package).
     - One hot fix I found was to hop on a University VPN and run again. I typically experience this error after running the tool twice, and I need to disconnect and reconnect my VPN to "unblock" myself.
@@ -84,33 +95,49 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Changelog
 
-### Version 3.7
-I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
+<details>
+<summary>Version 3.9</summary>
+<br>
+In 3.9, I slightly improved the logic for affiliation extraction.
+
+In 3.8, I removed multiprocessing for `geopy.geocoders` as per their official documentation. Also I cleaned up some unnecessary `scholarly` calls which further helps us not get blacklisted by Google Scholar.
+
+In 3.7, I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
 
-**Now we should be able to handle users with more citations than before. I tested on a profile with 400 citations without running into any issue.**
+**Now we should be able to handle users with more citations than before. I tested on a profile with 1000 citations without running into any issue.**
+</details>
 
-### Version 3.0
-I realized a problem with how I used `geopy.geocoders`. A majority of the authors' self-entered affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
+<details>
+<summary>Version 3.0</summary>
+<br>
+I realized a problem with how I used `geopy.geocoders`. A majority of the authors' affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
 
 For example, we would want the substring "Yale University" from the string "Assistant Professor at Yale University".
 
 I applied a simple fix with some rule-based natural language processing. This helps us identify many missing citing locations.
 
 **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+</details>
 
-### Version 2.0
+<details>
+<summary>Version 2.0</summary>
+<br>
 I finally managed to **drastically speed up** the process using multiprocessing, in a way that avoids being blocked by Google Scholar.
 
 On my personal computer, processing my profile with 100 citations took 1 hour with version 1.0 while it's now taking 5 minutes with version 2.0.
 
 With that said, please be careful and do not run this tool frequently. I can easily get on Google Scholar's blacklist after a few runs.
+</details>
 
-### Version 1.0
+<details>
+<summary>Version 1.0</summary>
+<br>
 Very basic functionality.
 
 This script is a bit slow. On my personal computer, it takes half a minute to process each citation. If you have thousands of citations, it may or may not be a good idea to use this script.
 
 I tried to use multiprocessing, but unfortunately the excessive visits get me blocked by Google Scholar.
+</details>
 
 ## Dependencies
 Dependencies (`scholarly`, `geopy`, `folium`, `tqdm`) are already taken care of when you install via pip.

{citation-map-3.7 → citation-map-3.9}/citation_map/citation_map.py

@@ -1,15 +1,16 @@
+import itertools
 import re
 import random
 import time
-import itertools
 
+from multiprocessing import Pool
+import pycountry
+from tqdm import tqdm
 from typing import List, Tuple
-from scholarly import scholarly, ProxyGenerator
-from geopy.geocoders import Nominatim
 
 import folium
-from tqdm import tqdm
-from multiprocessing import Pool
+from geopy.geocoders import Nominatim
+from scholarly import scholarly, ProxyGenerator
 
 from .scholarly_support import get_author_ids
 
@@ -24,58 +25,71 @@ def fetch_google_scholar_profile(scholar_id: str):
 
 def find_all_citing_institutions(publications, num_processes: int = 16) -> List[Tuple[str]]:
     '''
-    Step 2. Final all citing institutions (i.e., insitutions of citing authors).
+    Step 2. Find all citing institutions (i.e., insitutions of citing authors).
     '''
+    # Fetch metadata for all publications.
     if num_processes > 1 and isinstance(num_processes, int):
-        # Fetch metadata for all publications, in parallel.
         with Pool(processes=num_processes) as pool:
             all_publications = list(tqdm(pool.imap(__fill_publication_metadata, publications),
-                                        desc='Filling metadata for all publications...',
-                                        total=len(publications)))
+                                         desc='Filling metadata for your %d publications' % len(publications),
+                                         total=len(publications)))
     else:
         all_publications = []
-        for pub in tqdm(publications, desc='Filling metadata for all publications...', total=len(publications)):
+        for pub in tqdm(publications,
+                        desc='Filling metadata for your %d publications' % len(publications),
+                        total=len(publications)):
             all_publications.append(__fill_publication_metadata(pub))
 
+    # Convert all publications to Google Scholar publication IDs.
+    # This is fast and no parallel processing is needed.
     all_publication_ids = []
     for pub in all_publications:
         if 'cites_id' in pub:
             for cites_id in pub['cites_id']:
                 all_publication_ids.append(cites_id)
 
+    # Find all citing authors from all publications.
     if num_processes > 1 and isinstance(num_processes, int):
-        # Find all citing papers from all publications, in parallel.
         with Pool(processes=num_processes) as pool:
             all_citing_authors_nested = list(tqdm(pool.imap(__citing_author_ids_from_publication, all_publication_ids),
-                                                 desc='Finding all citing authors..',
+                                                 desc='Finding citing authors from your %d publications' % len(all_publication_ids),
                                                  total=len(all_publication_ids)))
     else:
         all_citing_authors_nested = []
-        for pub in tqdm(all_publication_ids, desc='Finding all citing authors...', total=len(all_publication_ids)):
+        for pub in tqdm(all_publication_ids,
+                        desc='Finding citing authors from your %d publications' % len(all_publication_ids),
+                        total=len(all_publication_ids)):
             all_citing_authors_nested.append(__citing_author_ids_from_publication(pub))
     all_citing_authors = list(itertools.chain(*all_citing_authors_nested))
 
+    # Find all citing insitutions from all citing authors.
     if num_processes > 1 and isinstance(num_processes, int):
-        # Find all citing insitutions from all citing authors, in parallel.
         with Pool(processes=num_processes) as pool:
             author_institution_tuple_list = list(tqdm(pool.imap(__institutions_from_authors, all_citing_authors),
-                                                    desc='Finding all citing institutions...',
-                                                    total=len(all_citing_authors)))
+                                                      desc='Finding citing institutions from %d citing authors' % len(all_citing_authors),
+                                                      total=len(all_citing_authors)))
     else:
         author_institution_tuple_list = []
-        for author in tqdm(all_citing_authors, desc='Finding all citing institutions...', total=len(all_citing_authors)):
+        for author in tqdm(all_citing_authors,
+                           desc='Finding citing institutions from %d citing authors' % len(all_citing_authors),
+                           total=len(all_citing_authors)):
             author_institution_tuple_list.append(__institutions_from_authors(author))
 
     return author_institution_tuple_list
 
 def clean_institution_names(author_institution_tuple_list: List[Tuple[str]]) -> List[Tuple[str]]:
     '''
-    Step 3. Clean up the name of institutions from the author's self-entered Google Scholar affiliation.
+    Step 3. Clean up the names of institutions from the authors' affiliations on their Google Scholar profiles.
+    NOTE: This logic is very naive. Please send an issue or pull request if you have any idea how to improve it.
+    Currently we will not consider any paid service or tools that pose extra burden on the users, such as GPT API.
     '''
     cleaned_author_institution_tuple_list = []
     for author_name, institution_string in author_institution_tuple_list:
-        # Use a regular expression to split the string by ',', ';', or 'and'.
-        substring_list = [part.strip() for part in re.split(r'[;,]|\band\b', institution_string)]
+        # Use a regular expression to split the string by ';' or 'and'.
+        substring_list = [part.strip() for part in re.split(r'[;]|\band\b', institution_string)]
+        # Further split the substrings by ',' if the latter component is not a country.
+        substring_list = __country_aware_comma_split(substring_list)
+
         for substring in substring_list:
             # Use a regular expression to remove anything before 'at', or '@'.
             cleaned_institution = re.sub(r'.*?\bat\b|.*?@', '', substring, flags=re.IGNORECASE).strip()
@@ -83,29 +97,33 @@ def clean_institution_names(author_institution_tuple_list: List[Tuple[str]]) ->
             # a person's identity rather than affiliation.
             is_common_identity_string = re.search(
                 re.compile(
-                    r'\b(director|manager|chair|engineer|programmer|scientist|professor|lecturer|phd|student|ph\.d|department of)\b',
+                    r'\b(director|manager|chair|engineer|programmer|scientist|professor|lecturer|phd|ph\.d|postdoc|doctor|student|department of)\b',
                     re.IGNORECASE),
                 substring)
             if not is_common_identity_string:
                 cleaned_author_institution_tuple_list.append((author_name, cleaned_institution))
     return cleaned_author_institution_tuple_list
 
-def institution_text_to_geocode(author_institution_tuple_list: List[Tuple[str]], num_processes: int = 32) -> List[Tuple[str]]:
+def institution_text_to_geocode(author_institution_tuple_list: List[Tuple[str]], max_attempts: int = 3) -> List[Tuple[str]]:
     '''
     Step 4: Convert institutions in plain text to Geocode.
     '''
-    if num_processes > 1 and isinstance(num_processes, int):
-        with Pool(processes=num_processes) as pool:
-            coordinates = list(tqdm(pool.imap(__text_to_geocode, author_institution_tuple_list),
-                                    desc='Finding all geographic coordinates...',
-                                    total=len(author_institution_tuple_list)))
-    else:
-        coordinates = []
-        for author_institution_tuple in tqdm(author_institution_tuple_list,
-                                             desc='Finding all geographic coordinates...',
-                                             total=len(author_institution_tuple_list)):
-            coordinates.append(__text_to_geocode(author_institution_tuple))
-
+    coordinates = []
+    # NOTE: According to the Nomatim Usage Policy (https://operations.osmfoundation.org/policies/nominatim/),
+    # we are explicitly asked not to submit bulk requests on multiple threads.
+    # Therefore, we will keep it to a loop instead of multiprocessing.
+    geolocator = Nominatim(user_agent='citation_mapper')
+    for author_institution_tuple in tqdm(author_institution_tuple_list,
+                                         desc='Finding geographic coordinates from %d citing institutions' % len(author_institution_tuple_list),
+                                         total=len(author_institution_tuple_list)):
+        for _ in range(max_attempts):
+            try:
+                author_name, institution_name = author_institution_tuple
+                geo_location = geolocator.geocode(institution_name)
+                if geo_location:
+                    coordinates.append((geo_location.latitude, geo_location.longitude, author_name, institution_name))
+            except:
+                continue
     coordinates = [item for item in coordinates if item is not None]  # Filter out empty coordinates.
     return coordinates
 
@@ -139,22 +157,38 @@ def __citing_author_ids_from_publication(cites_id: str):
 def __institutions_from_authors(author_id: str):
     time.sleep(random.uniform(1, 5))  # Random delay to reduce risk of being blocked.
     citing_author = scholarly.search_author_id(author_id)
-    citing_author = scholarly.fill(citing_author)
     if 'affiliation' in citing_author:
         return (citing_author['name'], citing_author['affiliation'])
     return []
 
-def __text_to_geocode(author_institution_tuple, max_attempts: int = 3):
-    geolocator = Nominatim(user_agent='citation_mapper')
-    for _ in range(max_attempts):
-        try:
-            author_name, institution_name = author_institution_tuple
-            geo_location = geolocator.geocode(institution_name)
-            if geo_location:
-                return (geo_location.latitude, geo_location.longitude, author_name, institution_name)
-        except:
-            pass
-    return None
+def __country_aware_comma_split(string_list: List[str]) -> List[str]:
+    comma_split_list = []
+
+    for part in string_list:
+        # Split the strings by comma.
+        # NOTE: The non-English comma is entered intentionally.
+        sub_parts = [sub_part.strip() for sub_part in re.split(r'[,，]', part)]
+        sub_parts_iter = iter(sub_parts)
+
+        # Merge the split strings if the latter component is a country name.
+        for sub_part in sub_parts_iter:
+            if __iscountry(sub_part):
+                continue  # Skip country names if they appear as the first sub_part.
+            next_part = next(sub_parts_iter, None)
+            if __iscountry(next_part):
+                comma_split_list.append(f"{sub_part}, {next_part}")
+            else:
+                comma_split_list.append(sub_part)
+                if next_part:
+                    comma_split_list.append(next_part)
+    return comma_split_list
+
+def __iscountry(string: str) -> bool:
+    try:
+        pycountry.countries.lookup(string)
+        return True
+    except LookupError:
+        return False
 
 def generate_citation_map(scholar_id: str,
                           output_path: str = 'citation_map.html',
@@ -201,20 +235,25 @@ def generate_citation_map(scholar_id: str,
                                                                  num_processes=num_processes)
     print('\nA total of %d citing institutions recorded.\n' % len(author_institution_tuple_list))
 
+    # Take unique tuples.
+    author_institution_tuple_list = list(set(author_institution_tuple_list))
+
     if print_citing_institutions:
         print('\nList of all citing authors and institutions before cleaning:\n')
-        for item in sorted(author_institution_tuple_list):
+        for item in sorted((author_institution_tuple_list)):
             print(item)
 
     cleaned_author_institution_tuple_list = clean_institution_names(author_institution_tuple_list)
 
+    # Take unique tuples.
+    cleaned_author_institution_tuple_list = list(set(cleaned_author_institution_tuple_list))
+
     if print_citing_institutions:
         print('\nList of all citing authors and institutions after cleaning:\n')
         for item in sorted(cleaned_author_institution_tuple_list):
             print(item)
 
-    coordinates = institution_text_to_geocode(author_institution_tuple_list + cleaned_author_institution_tuple_list,
-                                              num_processes=num_processes)
+    coordinates = institution_text_to_geocode(author_institution_tuple_list + cleaned_author_institution_tuple_list)
     print('\nConverted the institutions to %d Geocodes.' % len(coordinates))
 
     citation_map = create_map(coordinates, pin_colorful=pin_colorful)

{citation-map-3.7 → citation-map-3.9}/citation_map.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.1
 Name: citation-map
-Version: 3.7
+Version: 3.9
 Summary: A simple tool to generate your Google Scholar citation world map.
 Home-page: https://github.com/ChenLiu-1996/CitationMap
 Author: Chen Liu
@@ -43,10 +43,6 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Usage
 1. Install the package.
-    ```
-    pip install citation-map
-    ```
-    Remember to upgrade to the latest version if you installed an earlier version.
     ```
     pip install citation-map --upgrade
     ```
@@ -91,8 +87,23 @@ If you open it on a browser, you will see your own version of the following cita
         If true, print the list of citing institutions (affiliations of citing authors).
     ```
 
+## Limitations
+
+1. This tool is purely based on Google Scholar. As a result, you are expected to have underestimations due to reasons such as:
+    - Your Google Scholar profile is not up-to-date.
+    - Some papers citing you are not indexed by Google Scholar.
+    - Some authors citing you do not have Google Scholar profile.
+    - Some authors citing you do not report their affiliations.
+2. `geopy.geocoders` is used to convert the citing authors' affiliations to geographic coordinates. To facilitate the process, I used some simple rule-based natural language processing to clean up the affiliations. As a result, you are expected to have:
+    - Underestimation if correct affiliations are not found by `geopy.geocoders`.
+    - Underestimation if we experience communication error with `geopy.geocoders`.
+    - Overestimation if non-affiliation terms are incorrectly identified as locations by `geopy.geocoders`.
+
+    **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+
+
 ## Debug
-1. `scholarly._proxy_generator.MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
+1. `MaxTriesExceededException` or `[WARNING!] Blocked by CAPTCHA or robot check`
 
     - From my experience, both are good indicators that your IP address is blocked by Google Scholar due to excessive crawling (using the `scholarly` package).
     - One hot fix I found was to hop on a University VPN and run again. I typically experience this error after running the tool twice, and I need to disconnect and reconnect my VPN to "unblock" myself.
@@ -100,33 +111,49 @@ If you open it on a browser, you will see your own version of the following cita
 
 ## Changelog
 
-### Version 3.7
-I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
+<details>
+<summary>Version 3.9</summary>
+<br>
+In 3.9, I slightly improved the logic for affiliation extraction.
+
+In 3.8, I removed multiprocessing for `geopy.geocoders` as per their official documentation. Also I cleaned up some unnecessary `scholarly` calls which further helps us not get blacklisted by Google Scholar.
+
+In 3.7, I updated the logic for webscraping and avoided using `scholarly.citeby()` which is the biggest trigger of blacklisting from Google Scholar.
 
-**Now we should be able to handle users with more citations than before. I tested on a profile with 400 citations without running into any issue.**
+**Now we should be able to handle users with more citations than before. I tested on a profile with 1000 citations without running into any issue.**
+</details>
 
-### Version 3.0
-I realized a problem with how I used `geopy.geocoders`. A majority of the authors' self-entered affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
+<details>
+<summary>Version 3.0</summary>
+<br>
+I realized a problem with how I used `geopy.geocoders`. A majority of the authors' affiliations include details that are irrelevant to the affiliation itself. Therefore, they are not successfully found in the system and hence are not converted to geographic coordinates on the world map.
 
 For example, we would want the substring "Yale University" from the string "Assistant Professor at Yale University".
 
 I applied a simple fix with some rule-based natural language processing. This helps us identify many missing citing locations.
 
 **Please raise an issue or submit a pull request if you have some good idea to better process the affiliation string. Note that currently I am not considering any paid service or tools that pose extra burden on the users, such as GPT API.**
+</details>
 
-### Version 2.0
+<details>
+<summary>Version 2.0</summary>
+<br>
 I finally managed to **drastically speed up** the process using multiprocessing, in a way that avoids being blocked by Google Scholar.
 
 On my personal computer, processing my profile with 100 citations took 1 hour with version 1.0 while it's now taking 5 minutes with version 2.0.
 
 With that said, please be careful and do not run this tool frequently. I can easily get on Google Scholar's blacklist after a few runs.
+</details>
 
-### Version 1.0
+<details>
+<summary>Version 1.0</summary>
+<br>
 Very basic functionality.
 
 This script is a bit slow. On my personal computer, it takes half a minute to process each citation. If you have thousands of citations, it may or may not be a good idea to use this script.
 
 I tried to use multiprocessing, but unfortunately the excessive visits get me blocked by Google Scholar.
+</details>
 
 ## Dependencies
 Dependencies (`scholarly`, `geopy`, `folium`, `tqdm`) are already taken care of when you install via pip.

{citation-map-3.7 → citation-map-3.9}/setup.py

@@ -5,7 +5,7 @@ with open('README.md') as f:
 
 setup(
     name='citation-map',
-    version='3.7',
+    version='3.9',
     license='Apache 2.0',
     author='Chen Liu',
     author_email='chen.liu.cl2482@yale.edu',

{citation-map-3.7 → citation-map-3.9}/citation_map/scholarly_support.py

@@ -1,8 +1,8 @@
+import random
 import requests
+import time
 from bs4 import BeautifulSoup
 from typing import List
-import time
-import random
 
 
 def get_author_ids(paper_url: str) -> List[str]: