@studyportals/fawkes 8.7.2 → 9.0.0

package/README.md

@@ -1,176 +1,176 @@
-# fawkes
-
-This project is used to centralize indexability logic for our Search
-microservices and Sitemap Generator. The main purpose is to completely remove
-discrepancies between pages indexed by Search and page URLs stored in Sitemap.
-
-Link to documentation: https://studyportals.atlassian.net/wiki/x/BwAdvw
-
-## Base structure
-
-- organisations-seo (used by Organisation Search)
-- scholarships-seo (used by Scholarship Search)
-- sitemap-generator-seo (used by Sitemap Generator)
-- src
-  - common
-  - organisations
-  - scholarships
-  - sitemap-generator
-
-# Automatic Documentation System
-
-## Overview
-
-This system automatically generates and maintains documentation for Fawkes
-indexing rules across multiple projects. It creates a hierarchical structure of
-Confluence pages that document all indexing policies and rules, ensuring that
-the documentation is always up-to-date with the actual codebase.
-
-Link to documentation:
-[Fawkes Indexing Rules Documentation](https://studyportals.atlassian.net/wiki/spaces/T/pages/3494969354/Fawkes+Indexing+Rules+Documentation)
-
-## Features
-
-- **Dynamic Documentation**: Automatically extracts indexing rules and policies
-  directly from the codebase
-- **Multi-Page Structure**: Creates a main index page with separate pages for
-  each project
-- **Hierarchical Organization**: Structures content as Projects → Policies →
-  Rules
-- **Automatic Page Creation**: Intelligently creates or updates pages as needed
-- **Cross-Page Navigation**: Provides intuitive navigation between all pages
-
-## Architecture
-
-The system follows SOLID design principles to ensure maintainability and
-extensibility:
-
-- **Single Responsibility**: Each class has one specific responsibility
-- **Open/Closed**: Easily extendable without modifying existing code
-- **Liskov Substitution**: Interchangeable components through well-defined
-  interfaces
-- **Interface Segregation**: Clean, focused interfaces
-- **Dependency Inversion**: High-level modules depend on abstractions
-
-### Key Components
-
-1. **Content Builder**: Extracts project, policy, and rule data from the Fawkes
-   system
-2. **Policy Fetchers**: Project-specific components that fetch and format policy
-   data
-3. **Document Builder**: Generates structured HTML content for Confluence pages
-4. **Confluence Updater**: Handles creation and updating of Confluence pages
-5. **Token Retriever**: Securely retrieves API token for Confluence access
-
-## How It Works
-
-1. The system starts by collecting all project data using the `ContentBuilder`
-2. For each project, it extracts policies and rules using project-specific
-   fetchers
-3. The `DocumentBuilder` generates the content for the main index page and each
-   project page
-4. The `ConfluenceUpdater` creates or updates pages in Confluence as needed
-5. Each project page links back to the main index, and the main index links to
-   all project pages
-
-## Setup and Configuration
-
-### Environment Variables
-
-The system requires the following environment variables:
-
-```
-CONFLUENCE_EMAIL=your-email@example.com
-CONFLUENCE_API_TOKEN=your-api-token
-CONFLUENCE_BASE_URL=https://your-instance.atlassian.net
-CONFLUENCE_SPACE_KEY=YOUR_SPACE_KEY
-CONFLUENCE_MAIN_PAGE_TITLE=Fawkes Indexing Rules Documentation
-```
-
-> **Important Note on Credentials**: Currently, the system uses personal
-> credentials (email and API token) for Confluence access. This is a temporary
-> solution and should be replaced with a team or service account in the future
-> to avoid dependency on a specific individual's account.
-
-### Deployment and Triggering
-
-The system runs as an AWS Lambda function and is automatically triggered as part
-of the CI/CD pipeline. This ensures documentation is always updated whenever new
-code is deployed:
-
-```yaml
-# buildspec.yml (excerpt)
-post_build:
-  commands:
-    - |
-      if [ -z "$PR_ID" ]; then
-        LAMBDA_NAME="FawkesConfluenceUpdater-$STAGE"
-        echo "Invoking Lambda function $LAMBDA_NAME"
-        echo '{"source":"cicd-pipeline","timestamp":"'$(date -u +"%Y-%m-%dT%H:%M:%SZ")'"}' > payload.json
-        aws lambda invoke --function-name $LAMBDA_NAME --invocation-type Event --payload fileb://payload.json response.json || echo "Lambda invocation failed, but continuing"
-      fi
-```
-
-**Trigger Flow:**
-
-1. When code is pushed to the `main` branch, the CI/CD pipeline is triggered
-2. After successful deployment of a new Fawkes version, the post-build phase
-   executes
-3. The Lambda function is invoked with a simple payload containing the source
-   and timestamp
-4. The Lambda function authenticates with Confluence and executes the
-   documentation generation process
-5. This only happens for production deployments (not PR builds)
-
-This automated approach ensures documentation stays in sync with the actual
-codebase without manual intervention.
-
-## Scalability and Extension
-
-### Adding New Projects
-
-To add documentation for a new project:
-
-1. Create a new class that implements the `IPolicyFetcher` interface
-2. Implement the `getProjectName()` and `fetchPolicies()` methods
-3. Register the new fetcher in the `ContentBuilder` constructor
-
-Example:
-
-```typescript
-export class NewProjectPolicyFetcher implements IPolicyFetcher {
-  getProjectName(): string {
-    return 'New Project Name';
-  }
-
-  fetchPolicies(): IPolicy[] {
-    // Implement policy fetching logic
-    return [...policies];
-  }
-}
-
-// Then update ContentBuilder:
-constructor(fetchers?: IPolicyFetcher[]) {
-  this.policyFetchers = fetchers || [
-    // Existing fetchers
-    new NewProjectPolicyFetcher()
-  ];
-}
-```
-
-### Customizing Page Content
-
-The `DocumentBuilder` class contains methods for generating page content. To
-customize the format:
-
-1. Modify the `buildMainDocument()` method for changes to the main index page
-2. Modify the `buildProjectDocument()` method for changes to project pages
-3. Modify the `buildPolicySection()` and `buildRulesTable()` methods for changes
-   to policy and rule sections
-
-## Conclusion
-
-This documentation system ensures that Fawkes indexing rules are always
-well-documented and accessible to the team. By automatically generating
-documentation directly from the codebase, it eliminates the risk of
-documentation becoming outdated or inconsistent with the actual implementation.
+# fawkes
+
+This project is used to centralize indexability logic for our Search
+microservices and Sitemap Generator. The main purpose is to completely remove
+discrepancies between pages indexed by Search and page URLs stored in Sitemap.
+
+Link to documentation: https://studyportals.atlassian.net/wiki/x/BwAdvw
+
+## Base structure
+
+- organisations-seo (used by Organisation Search)
+- scholarships-seo (used by Scholarship Search)
+- sitemap-generator-seo (used by Sitemap Generator)
+- src
+  - common
+  - organisations
+  - scholarships
+  - sitemap-generator
+
+# Automatic Documentation System
+
+## Overview
+
+This system automatically generates and maintains documentation for Fawkes
+indexing rules across multiple projects. It creates a hierarchical structure of
+Confluence pages that document all indexing policies and rules, ensuring that
+the documentation is always up-to-date with the actual codebase.
+
+Link to documentation:
+[Fawkes Indexing Rules Documentation](https://studyportals.atlassian.net/wiki/spaces/T/pages/3494969354/Fawkes+Indexing+Rules+Documentation)
+
+## Features
+
+- **Dynamic Documentation**: Automatically extracts indexing rules and policies
+  directly from the codebase
+- **Multi-Page Structure**: Creates a main index page with separate pages for
+  each project
+- **Hierarchical Organization**: Structures content as Projects → Policies →
+  Rules
+- **Automatic Page Creation**: Intelligently creates or updates pages as needed
+- **Cross-Page Navigation**: Provides intuitive navigation between all pages
+
+## Architecture
+
+The system follows SOLID design principles to ensure maintainability and
+extensibility:
+
+- **Single Responsibility**: Each class has one specific responsibility
+- **Open/Closed**: Easily extendable without modifying existing code
+- **Liskov Substitution**: Interchangeable components through well-defined
+  interfaces
+- **Interface Segregation**: Clean, focused interfaces
+- **Dependency Inversion**: High-level modules depend on abstractions
+
+### Key Components
+
+1. **Content Builder**: Extracts project, policy, and rule data from the Fawkes
+   system
+2. **Policy Fetchers**: Project-specific components that fetch and format policy
+   data
+3. **Document Builder**: Generates structured HTML content for Confluence pages
+4. **Confluence Updater**: Handles creation and updating of Confluence pages
+5. **Token Retriever**: Securely retrieves API token for Confluence access
+
+## How It Works
+
+1. The system starts by collecting all project data using the `ContentBuilder`
+2. For each project, it extracts policies and rules using project-specific
+   fetchers
+3. The `DocumentBuilder` generates the content for the main index page and each
+   project page
+4. The `ConfluenceUpdater` creates or updates pages in Confluence as needed
+5. Each project page links back to the main index, and the main index links to
+   all project pages
+
+## Setup and Configuration
+
+### Environment Variables
+
+The system requires the following environment variables:
+
+```
+CONFLUENCE_EMAIL=your-email@example.com
+CONFLUENCE_API_TOKEN=your-api-token
+CONFLUENCE_BASE_URL=https://your-instance.atlassian.net
+CONFLUENCE_SPACE_KEY=YOUR_SPACE_KEY
+CONFLUENCE_MAIN_PAGE_TITLE=Fawkes Indexing Rules Documentation
+```
+
+> **Important Note on Credentials**: Currently, the system uses personal
+> credentials (email and API token) for Confluence access. This is a temporary
+> solution and should be replaced with a team or service account in the future
+> to avoid dependency on a specific individual's account.
+
+### Deployment and Triggering
+
+The system runs as an AWS Lambda function and is automatically triggered as part
+of the CI/CD pipeline. This ensures documentation is always updated whenever new
+code is deployed:
+
+```yaml
+# buildspec.yml (excerpt)
+post_build:
+  commands:
+    - |
+      if [ -z "$PR_ID" ]; then
+        LAMBDA_NAME="FawkesConfluenceUpdater-$STAGE"
+        echo "Invoking Lambda function $LAMBDA_NAME"
+        echo '{"source":"cicd-pipeline","timestamp":"'$(date -u +"%Y-%m-%dT%H:%M:%SZ")'"}' > payload.json
+        aws lambda invoke --function-name $LAMBDA_NAME --invocation-type Event --payload fileb://payload.json response.json || echo "Lambda invocation failed, but continuing"
+      fi
+```
+
+**Trigger Flow:**
+
+1. When code is pushed to the `main` branch, the CI/CD pipeline is triggered
+2. After successful deployment of a new Fawkes version, the post-build phase
+   executes
+3. The Lambda function is invoked with a simple payload containing the source
+   and timestamp
+4. The Lambda function authenticates with Confluence and executes the
+   documentation generation process
+5. This only happens for production deployments (not PR builds)
+
+This automated approach ensures documentation stays in sync with the actual
+codebase without manual intervention.
+
+## Scalability and Extension
+
+### Adding New Projects
+
+To add documentation for a new project:
+
+1. Create a new class that implements the `IPolicyFetcher` interface
+2. Implement the `getProjectName()` and `fetchPolicies()` methods
+3. Register the new fetcher in the `ContentBuilder` constructor
+
+Example:
+
+```typescript
+export class NewProjectPolicyFetcher implements IPolicyFetcher {
+  getProjectName(): string {
+    return 'New Project Name';
+  }
+
+  fetchPolicies(): IPolicy[] {
+    // Implement policy fetching logic
+    return [...policies];
+  }
+}
+
+// Then update ContentBuilder:
+constructor(fetchers?: IPolicyFetcher[]) {
+  this.policyFetchers = fetchers || [
+    // Existing fetchers
+    new NewProjectPolicyFetcher()
+  ];
+}
+```
+
+### Customizing Page Content
+
+The `DocumentBuilder` class contains methods for generating page content. To
+customize the format:
+
+1. Modify the `buildMainDocument()` method for changes to the main index page
+2. Modify the `buildProjectDocument()` method for changes to project pages
+3. Modify the `buildPolicySection()` and `buildRulesTable()` methods for changes
+   to policy and rule sections
+
+## Conclusion
+
+This documentation system ensures that Fawkes indexing rules are always
+well-documented and accessible to the team. By automatically generating
+documentation directly from the codebase, it eliminates the risk of
+documentation becoming outdated or inconsistent with the actual implementation.

package/dist/sitemap-generator-seo/index.d.ts

@@ -1,6 +1,5 @@
 export { IOrganisationsClient } from '../src/sitemap-generator/IOrganisationsClient';
 export { IOrganisation } from '../src/sitemap-generator/IOrganisation';
-export { IRankingApiClient } from '../src/sitemap-generator/IRankingApiClient';
 export { ISearchApiClient } from '../src/sitemap-generator/ISearchApiClient';
 export { ISitemapUrlGeneratorManager } from '../src/sitemap-generator/ISitemapUrlGeneratorManager';
 export { OrganisationsSitemapUrlGeneratorManager } from '../src/sitemap-generator/OrganisationsSitemapUrlGeneratorManager';
@@ -12,3 +11,4 @@ export { ISitemapUrlGenerator } from '../src/common/ISitemapUrlGenerator';
 export { FilterKeyValuesMap } from '../src/common/FilterKeyValuesMap';
 export { IPresenter } from '../src/common';
 export { IProgrammeSitemapUrlGenerator } from '../src/programmes/types/IProgrammeSitemapUrlGenerator';
+export { IRankingApiClient } from '../src/sitemap-generator/IRankingApiClient';

package/dist/src/common/FilterKeyToFilterTypeMap.d.ts

@@ -0,0 +1,2 @@
+import { FilterKey } from '@studyportals/search-filters/server-side';
+export declare const FILTER_KEY_TO_FILTER_TYPE_MAP: Map<FilterKey, FilterType>;

package/dist/src/common/FilterKeyToFilterTypeMap.js

@@ -0,0 +1,14 @@
+import { FilterKey } from '@studyportals/search-filters/server-side';
+import { FilterType } from '@studyportals/omnisearch-interfaces';
+export const FILTER_KEY_TO_FILTER_TYPE_MAP = new Map([
+    [FilterKey.COUNTRY, FilterType.COUNTRY],
+    [FilterKey.DISCIPLINES, FilterType.DISCIPLINES],
+    [FilterKey.CITY, FilterType.CITY],
+    [FilterKey.AREA, FilterType.AREA],
+    [FilterKey.ATTENDANCE, FilterType.DENSITIES],
+    [FilterKey.DELIVERY_METHOD, FilterType.ATTENDANCE],
+    [FilterKey.CAMPAIGN_TYPE, FilterType.CAMPAIGN_TYPE],
+    [FilterKey.DEGREE_TYPE, FilterType.DEGREE_TYPE],
+    [FilterKey.KEYWORD, FilterType.KEYWORD],
+    [FilterKey.CONTINENT, FilterType.CONTINENT],
+]);

package/dist/src/common/FilterTypeMap.d.ts

@@ -0,0 +1,2 @@
+import { FilterType } from '@studyportals/omnisearch-interfaces';
+export type FilterTypeMap = Map<FilterType, string[]>;

package/dist/src/common/FilterTypeMap.js

@@ -0,0 +1 @@
+export {};

package/dist/src/organisations/SearchIndexabilityManager.js

@@ -1,5 +1,5 @@
 import { DependencyTypes } from '../enums/DependencyTypes';
-import { Area, AreaAttendance, Attendance, Continent, Country, CountryAttendance, Unfiltered, RankedArea, RankedAreaDiscipline, RankedAttendance, RankedAttendanceDiscipline, RankedContinent, RankedContinentAttendance, RankedCountry, RankedCountryAttendance, RankedCountryDiscipline, RankedDiscipline, RankedUnfiltered, CountryCity, CountryAreaCity } from '../organisations/policies';
+import { Area, AreaAttendance, Attendance, Continent, Country, CountryAttendance, Unfiltered, RankedArea, RankedAttendance, RankedAttendanceDiscipline, RankedContinent, RankedContinentAttendance, RankedCountry, RankedCountryAttendance, RankedCountryDiscipline, RankedDiscipline, RankedUnfiltered, CountryCity, CountryAreaCity } from '../organisations/policies';
 export class SearchIndexabilityManager {
     policies;
     constructor(portalType, seoInfoBase, filterState, sortingState, applicationState) {
@@ -22,7 +22,6 @@ export class SearchIndexabilityManager {
             new CountryAttendance(dependencies),
             new Unfiltered(dependencies),
             new RankedArea(dependencies),
-            new RankedAreaDiscipline(dependencies),
             new RankedAttendance(dependencies),
             new RankedAttendanceDiscipline(dependencies),
             new RankedContinent(dependencies),

package/dist/src/organisations/policies/RankedOrganisationsSeoIndexabilityPolicy.js

@@ -9,7 +9,7 @@ export class RankedOrganisationsSeoIndexabilityPolicy extends OrganisationsSeoIn
         let rankedResultsCountRule;
         if (super.isSitemapUrlGeneratorDependencies()) {
             const dependencies = this.dependencies;
-            rankedResultsCountRule = new MinimumAmountOfRankedResultsRule(dependencies.rankingApiClient);
+            rankedResultsCountRule = new MinimumAmountOfRankedResultsRule(dependencies.searchApiClient);
         }
         else {
             rankedResultsCountRule = new MinimumAmountOfRankedResultsRule();

package/dist/src/organisations/policies/index.d.ts

@@ -8,7 +8,6 @@ export * from './our-picks/CountryAreaCity';
 export * from './our-picks/CountryAttendance';
 export * from './our-picks/Unfiltered';
 export * from './ranked/RankedArea';
-export * from './ranked/RankedAreaDiscipline';
 export * from './ranked/RankedAttendance';
 export * from './ranked/RankedAttendanceDiscipline';
 export * from './ranked/RankedContinent';

package/dist/src/organisations/policies/index.js

@@ -8,7 +8,6 @@ export * from './our-picks/CountryAreaCity';
 export * from './our-picks/CountryAttendance';
 export * from './our-picks/Unfiltered';
 export * from './ranked/RankedArea';
-export * from './ranked/RankedAreaDiscipline';
 export * from './ranked/RankedAttendance';
 export * from './ranked/RankedAttendanceDiscipline';
 export * from './ranked/RankedContinent';

package/dist/src/organisations/policies/our-picks/AreaAttendance.js

@@ -23,21 +23,23 @@ export class AreaAttendance extends OrganisationsSeoIndexabilityPolicy {
     async generateUrls() {
         const areaFragments = AreaPresenter.getInstance().getFragments();
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
-        const paths = [];
-        for (const area of areaFragments) {
-            for (const attendance of attendanceFragments) {
-                const filterKeyValues = new Map([
-                    [FilterKey.AREA, [area.id]],
-                    [FilterKey.COUNTRY, [area.countryId]],
-                    [FilterKey.DELIVERY_METHOD, [attendance.id]]
-                ]);
-                const result = await this.checkRulesForSitemap(filterKeyValues);
-                if (result) {
-                    paths.push(this.getPathWithSortingOption(`${attendance.path}/${area.path}`));
-                }
+        // Create array of promises for all combinations to parallelize API calls
+        const promises = areaFragments.flatMap(area => attendanceFragments.map(async (attendance) => {
+            const filterKeyValues = new Map([
+                [FilterKey.AREA, [area.id]],
+                [FilterKey.COUNTRY, [area.countryId]],
+                [FilterKey.DELIVERY_METHOD, [attendance.id]]
+            ]);
+            const result = await this.checkRulesForSitemap(filterKeyValues);
+            if (result) {
+                return this.getPathWithSortingOption(`${attendance.path}/${area.path}`);
             }
-        }
-        return paths;
+            return null;
+        }));
+        // Wait for all promises to resolve in parallel
+        const results = await Promise.all(promises);
+        // Filter out null values and return paths
+        return results.filter((path) => path !== null);
     }
     get filterCombination() {
         return FilterCombinations.AREA_ATTENDANCE;

package/dist/src/organisations/policies/our-picks/CountryAttendance.js

@@ -25,19 +25,21 @@ export class CountryAttendance extends OrganisationsSeoIndexabilityPolicy {
     async generateUrls() {
         const countryFragments = CountryPresenter.getInstance().getFragments();
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
-        const paths = [];
-        for (const country of countryFragments) {
-            for (const attendance of attendanceFragments) {
-                const filterKeyValues = new Map([
-                    [FilterKey.COUNTRY, [country.id]],
-                    [FilterKey.DELIVERY_METHOD, [attendance.id]]
-                ]);
-                const result = await this.checkRulesForSitemap(filterKeyValues);
-                if (result) {
-                    paths.push(this.getPathWithSortingOption(`${attendance.path}/${country.path}`));
-                }
+        // Create array of promises for all combinations to parallelize API calls
+        const promises = countryFragments.flatMap(country => attendanceFragments.map(async (attendance) => {
+            const filterKeyValues = new Map([
+                [FilterKey.COUNTRY, [country.id]],
+                [FilterKey.DELIVERY_METHOD, [attendance.id]]
+            ]);
+            const result = await this.checkRulesForSitemap(filterKeyValues);
+            if (result) {
+                return this.getPathWithSortingOption(`${attendance.path}/${country.path}`);
             }
-        }
-        return paths;
+            return null;
+        }));
+        // Wait for all promises to resolve in parallel
+        const results = await Promise.all(promises);
+        // Filter out null values and return paths
+        return results.filter((path) => path !== null);
     }
 }

package/dist/src/organisations/policies/ranked/RankedArea.js

@@ -21,7 +21,7 @@ export class RankedArea extends RankedOrganisationsSeoIndexabilityPolicy {
         for (const area of areaFragments) {
             const filterKeyValues = new Map([
                 [FilterKey.AREA, [area.id]],
-                [FilterKey.COUNTRY, [area.countryId]]
+                [FilterKey.COUNTRY, [area.countryId]],
             ]);
             const result = await this.checkRulesForSitemap(filterKeyValues);
             if (result) {

package/dist/src/organisations/policies/ranked/RankedAreaDiscipline.d.ts

@@ -4,6 +4,7 @@ import { SingleValueSelectedForFilterRule } from '../../../common/rules/SingleVa
 import { OnlyFiltersSelectedRule } from '../../../common/rules/OnlyFiltersSelectedRule';
 import { RankedOrganisationsSeoIndexabilityPolicy } from '../RankedOrganisationsSeoIndexabilityPolicy';
 import { IOrganisationsSeoDependencies } from '../../../organisations/types/IOrganisationsSeoDependencies';
+/** @deprecated Don't use this policy as it's been removed from indexability manager. */
 export declare class RankedAreaDiscipline extends RankedOrganisationsSeoIndexabilityPolicy {
     readonly name: string;
     readonly description: string;

package/dist/src/organisations/policies/ranked/RankedAreaDiscipline.js

@@ -6,6 +6,7 @@ import { OnlyFiltersSelectedRule } from '../../../common/rules/OnlyFiltersSelect
 import { AreaPresenter } from '../../../presenters/AreaPresenter';
 import { DisciplinePresenter } from '../../../presenters/DisciplinePresenter';
 import { RankedOrganisationsSeoIndexabilityPolicy } from '../RankedOrganisationsSeoIndexabilityPolicy';
+/** @deprecated Don't use this policy as it's been removed from indexability manager. */
 export class RankedAreaDiscipline extends RankedOrganisationsSeoIndexabilityPolicy {
     name = 'Ranked Area Discipline Policy';
     description = 'Controls indexing for ranking-sorted pages filtered by geographic areas, optimizing for region-specific content with quality-based result ordering.';

package/dist/src/organisations/policies/ranked/RankedAttendance.js

@@ -20,7 +20,9 @@ export class RankedAttendance extends RankedOrganisationsSeoIndexabilityPolicy {
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
         const paths = [];
         for (const attendance of attendanceFragments) {
-            const filterKeyValues = new Map([[FilterKey.DELIVERY_METHOD, [attendance.id]]]);
+            const filterKeyValues = new Map([
+                [FilterKey.DELIVERY_METHOD, [attendance.id]],
+            ]);
             const result = await this.checkRulesForSitemap(filterKeyValues);
             if (result) {
                 paths.push(this.getPathWithSortingOption(attendance.path));

package/dist/src/organisations/policies/ranked/RankedAttendanceDiscipline.js

@@ -25,11 +25,12 @@ export class RankedAttendanceDiscipline extends RankedOrganisationsSeoIndexabili
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
         const disciplineFragments = DisciplinePresenter.getInstance().getFragments();
         const paths = [];
+        // Process sequentially to respect API rate limits
         for (const attendance of attendanceFragments) {
             for (const discipline of disciplineFragments) {
                 const filterKeyValues = new Map([
                     [FilterKey.DELIVERY_METHOD, [attendance.id]],
-                    [FilterKey.DISCIPLINES, [discipline.id]]
+                    [FilterKey.DISCIPLINES, [discipline.id]],
                 ]);
                 const result = await this.checkRulesForSitemap(filterKeyValues);
                 if (result) {

package/dist/src/organisations/policies/ranked/RankedContinent.js

@@ -18,7 +18,9 @@ export class RankedContinent extends RankedOrganisationsSeoIndexabilityPolicy {
         const continentFragments = ContinentPresenter.getInstance().getFragments();
         const paths = [];
         for (const continent of continentFragments) {
-            const filterKeyValues = new Map([[FilterKey.CONTINENT, [continent.id]]]);
+            const filterKeyValues = new Map([
+                [FilterKey.CONTINENT, [continent.id]],
+            ]);
             const result = await this.checkRulesForSitemap(filterKeyValues);
             if (result) {
                 paths.push(this.getPathWithSortingOption(continent.path));

package/dist/src/organisations/policies/ranked/RankedContinentAttendance.js

@@ -23,20 +23,22 @@ export class RankedContinentAttendance extends RankedOrganisationsSeoIndexabilit
     async generateUrls() {
         const continentFragments = ContinentPresenter.getInstance().getFragments();
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
-        const paths = [];
-        for (const continent of continentFragments) {
-            for (const attendance of attendanceFragments) {
-                const filterKeyValues = new Map([
-                    [FilterKey.CONTINENT, [continent.id]],
-                    [FilterKey.DELIVERY_METHOD, [attendance.id]]
-                ]);
-                const result = await this.checkRulesForSitemap(filterKeyValues);
-                if (result) {
-                    paths.push(this.getPathWithSortingOption(`${attendance.path}/${continent.path}`));
-                }
+        // Create array of promises for all combinations to parallelize API calls
+        const promises = continentFragments.flatMap(continent => attendanceFragments.map(async (attendance) => {
+            const filterKeyValues = new Map([
+                [FilterKey.CONTINENT, [continent.id]],
+                [FilterKey.DELIVERY_METHOD, [attendance.id]],
+            ]);
+            const result = await this.checkRulesForSitemap(filterKeyValues);
+            if (result) {
+                return this.getPathWithSortingOption(`${attendance.path}/${continent.path}`);
             }
-        }
-        return paths;
+            return null;
+        }));
+        // Wait for all promises to resolve in parallel
+        const results = await Promise.all(promises);
+        // Filter out null values and return paths
+        return results.filter((path) => path !== null);
     }
     get filterCombination() {
         return FilterCombinations.RANKED_CONTINENT_ATTENDANCE;

package/dist/src/organisations/policies/ranked/RankedCountry.js

@@ -15,7 +15,9 @@ export class RankedCountry extends RankedOrganisationsSeoIndexabilityPolicy {
         const countryFragments = CountryPresenter.getInstance().getFragments();
         const paths = [];
         for (const country of countryFragments) {
-            const filterKeyValues = new Map([[FilterKey.COUNTRY, [country.id]]]);
+            const filterKeyValues = new Map([
+                [FilterKey.COUNTRY, [country.id]],
+            ]);
             const result = await this.checkRulesForSitemap(filterKeyValues);
             if (result) {
                 paths.push(this.getPathWithSortingOption(country.path));

package/dist/src/organisations/policies/ranked/RankedCountryAttendance.js

@@ -22,6 +22,7 @@ export class RankedCountryAttendance extends RankedOrganisationsSeoIndexabilityP
         const countryFragments = CountryPresenter.getInstance().getFragments();
         const attendanceFragments = AttendancePresenter.getInstance().getFragments();
         const paths = [];
+        // Process sequentially to respect API rate limits
         for (const country of countryFragments) {
             for (const attendance of attendanceFragments) {
                 const filterKeyValues = new Map([