better-ani-scraped 1.3.2 → 1.4.0

package/DOCUMENTATION.md

@@ -8,6 +8,7 @@ A set of utility functions for scraping anime data from multiple sources (only [
 - [Main class](#main-class)
 - [`AnimeScrapper("animesama")` methods](#animescrapperanimesama-methods)
 - [`AnimeScrapper("animepahe")` methods](#animescrapperanimepahe-methods)
+- [`AnimeScrapper("crunchyroll")` methods](#animescrappercrunchyroll-methods)
 - [Functions](#functions)
 
 ---
@@ -15,23 +16,23 @@ A set of utility functions for scraping anime data from multiple sources (only [
 ## Main class
 
 ### `AnimeScraper(source)`
-Creates a scrapper for the given source (only "animesama" and "animepahe" available at the moment).
+Creates a scrapper for the given source (only "animesama", "animepahe" and "crunchyroll" available at the moment).
 
 ---
 
 ## `AnimeScrapper("animesama")` methods
 
-- [searchAnime](#searchanimequery-limit--10)
-- [getSeasons](#getseasonsanimeurl-language--vostfr)
-- [getEmbed](#getembedanimeurl-hostpriority--sibnet-vidmoly)
-- [getAnimeInfo](#getanimeinfoanimeurl)
-- [getAvailableLanguages](#getavailablelanguagesseasonurl-wantedlanguages--vostfr-vf-va-vkr-vcn-vqc)
-- [getAllAnime](#getallanimeoutput--anime_listjson-get_seasons--false)
-- [getLatestEpisodes](#getlatestepisodeslanguagefilter--null)
-- [getRandomAnime](#getrandomanime)
-- [getEpisodeTitles](#getepisodetitlesanimeurl)
-
-### `searchAnime(query, limit = 10)`
+- [searchAnime](#animesamasearchanimequery-limit--10)
+- [getSeasons](#animesamagetseasonsanimeurl-language--vostfr)
+- [getEmbed](#animesamagetembedanimeurl-hostpriority--sibnet-vidmoly)
+- [getAnimeInfo](#animesamagetanimeinfoanimeurl)
+- [getAvailableLanguages](#animesamagetavailablelanguagesseasonurl-wantedlanguages--vostfr-vf-va-vkr-vcn-vqc)
+- [getAllAnime](#animesamagetallanimeoutput--anime_listjson-get_seasons--false)
+- [getLatestEpisodes](#animesamagetlatestepisodeslanguagefilter--null)
+- [getRandomAnime](#animesamagetrandomanime)
+- [getEpisodeTitles](#animesamagetepisodetitlesanimeurl-customChromiumPath)
+
+### `animesama.searchAnime(query, limit = 10)`
 Searches for anime titles that match the given query.
 
 - **Parameters:**
@@ -54,7 +55,7 @@ Searches for anime titles that match the given query.
 
 ---
 
-### `getSeasons(animeUrl, language = "vostfr")`
+### `animesama.getSeasons(animeUrl, language = "vostfr")`
 Fetches all available seasons of an anime in the specified language.
 
 - **Parameters:**
@@ -75,7 +76,7 @@ Fetches all available seasons of an anime in the specified language.
 
 ---
 
-### `getEmbed(animeUrl, hostPriority = ["sibnet", "vidmoly"])`
+### `animesama.getEmbed(animeUrl, hostPriority = ["sibnet", "vidmoly"])`
 Retrieves embed URLs for episodes, prioritizing by host.
 
 - **Parameters:**
@@ -91,7 +92,7 @@ Retrieves embed URLs for episodes, prioritizing by host.
   ```
 ---
 
-### `getAnimeInfo(animeUrl)`
+### `animesama.getAnimeInfo(animeUrl)`
 Extracts basic information from an anime page.
 
 - **Parameters:**
@@ -110,7 +111,7 @@ Extracts basic information from an anime page.
 
 ---
 
-### `getAvailableLanguages(seasonUrl, wantedLanguages = ["vostfr", "vf", "va", "vkr", "vcn", "vqc"])`
+### `animesama.getAvailableLanguages(seasonUrl, wantedLanguages = ["vostfr", "vf", "va", "vkr", "vcn", "vqc"])`
 Checks which languages are available for a given anime season (not recommended to use the default value of wantedLanguages, the more languages there is the more the function is long to run, only checks for languages you want).
 
 - **Parameters:**
@@ -130,7 +131,7 @@ Checks which languages are available for a given anime season (not recommended t
 
 ---
 
-### `getAllAnime(output = "anime_list.json", get_seasons = false)`
+### `animesama.getAllAnime(output = "anime_list.json", get_seasons = false)`
 Fetches the full anime catalog, optionally including season information.
 
 - **Parameters:**
@@ -141,7 +142,7 @@ Fetches the full anime catalog, optionally including season information.
 
 ---
 
-### `getLatestEpisodes(languageFilter = null)`
+### `animesama.getLatestEpisodes(languageFilter = null)`
 Scrapes the latest released episodes, optionally filtered by language.
 
 - **Parameters:**
@@ -160,7 +161,7 @@ Scrapes the latest released episodes, optionally filtered by language.
 
 ---
 
-### `getRandomAnime()`
+### `animesama.getRandomAnime()`
 Fetches a random anime from the catalogue.
 
 - **Returns:**  
@@ -177,11 +178,12 @@ Fetches a random anime from the catalogue.
 
 ---
 
-### `getEpisodeTitles(AnimeUrl)`
+### `animesama.getEpisodeTitles(AnimeUrl, customChromiumPath)`
 Fetches the names of all episodes in a season
 
 - **Parameters:**
   - `animeUrl` *(string)*: URL of the anime’s season/episode page.
+  - `animeUrl` *(string)*: Path of the Chromium folder
 - **Returns:**  
   An array of episode titles.
 
@@ -189,10 +191,10 @@ Fetches the names of all episodes in a season
 
 ## `AnimeScrapper("animepahe")` methods
 
-- [searchAnime](#searchanimequery)
+- [searchAnime](#animepahesearchanimequery)
 
 
-### `searchAnime(query)`
+### `animepahe.searchAnime(query)`
 Searches for anime titles that match the given query.
 
 - **Parameters:**
@@ -220,6 +222,52 @@ Searches for anime titles that match the given query.
 
 ---
 
+## `AnimeScrapper("crunchyroll")` methods
+
+- [searchAnime](#crunchyrollsearchanimequery-limit--10)
+- [getEpisodeInfo](#crunchyrollgetepisodeinfoanimeurl-seasontitle)
+
+
+### `crunchyroll.searchAnime(query, limit = 10)`
+Searches for anime titles that match the given query.
+
+- **Parameters:**
+  - `query` *(string)*: The search keyword.
+  - `limit` *(number)*: Maximum number of results to return (default: 10).
+- **Returns:**  
+  An array of anime objects:
+  ```js
+  [
+    {
+      title: string,
+      url: string,
+      cover: string
+    },
+    ...
+  ]
+  ```
+
+### `crunchyroll.getEpisodeInfo(animeUrl, seasonTitle)`
+Extracts information from all episodes of a season of an anime.
+
+- **Parameters:**
+  - `animeUrl` *(string)*: Anime page URL.
+  - `seasonTitle` *(string)*: Name of the season for which you want episode information. If null, returns episodes from season 1.
+- **Returns:**  
+  An array of episode objects:
+  ```js
+  [
+    {
+      title: string,
+      synopsis: string,
+      releaseDate: string,
+      cover: string
+    },
+    ...
+  ]
+  ```
+---
+
 ## Functions
 
 - [getVideoUrlFromEmbed](#getvideourlfromembedsource-embedurl)

package/examples/example_usage_05.js

@@ -0,0 +1,13 @@
+import { AnimeScraper } from "../index.js"; // REPLACE BY "from 'better-ani-scraped';"
+
+const main = async () => {
+    const scraper = new AnimeScraper('crunchyroll');
+    const search = await scraper.searchAnime("86");
+    console.log("Search Results:", search);
+    
+    const episodeInfo = await scraper.getEpisodeInfo(search[0].url, "S2")
+    console.log("Episode Info:", episodeInfo)
+  };
+  
+  main().catch(console.error);
+  

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "better-ani-scraped",
-  "version": "1.3.2",
+  "version": "1.4.0",
   "description": "Scrape anime data from different sources (only anime-sama.fr for the moment)",
   "main": "index.js",
   "scripts": {
@@ -17,10 +17,13 @@
   "license": "MIT",
   "type": "module",
   "dependencies": {
-    "ani-scraped": "^1.2.8",
+    "@ablanc/crunchyroll": "^2.4.0",
     "axios": "^1.8.4",
     "cheerio": "^1.0.0",
-    "playwright": "^1.52.0"
+    "playwright": "^1.52.0",
+    "puppeteer": "^24.7.2",
+    "puppeteer-extra": "^3.3.6",
+    "puppeteer-extra-plugin-stealth": "^2.11.2"
   },
   "repository": {
     "type": "git",

package/scrapers/animesama.js

@@ -1,10 +1,9 @@
 import axios from "axios";
 import * as cheerio from "cheerio";
 import fs from "fs";
-import puppeteer from'puppeteer';
 
 const BASE_URL = "https://anime-sama.fr";
-const CATALOGUE_URL = `${BASE_URL}/catalogue`;
+const CATALOGUE_URL = `${BASE_URL}/catalogue`; 
 
 function getHeaders(referer = BASE_URL) {
   return {

package/scrapers/crunchyroll.js

@@ -0,0 +1,89 @@
+import puppeteer from 'puppeteer-extra';
+import StealthPlugin from 'puppeteer-extra-plugin-stealth';
+puppeteer.use(StealthPlugin());
+
+const LANGUAGE = "fr";
+const CATALOGUE_URL = `https://www.crunchyroll.com/${LANGUAGE}`;
+
+export async function searchAnime(query, limit = 10) {
+    const url = `${CATALOGUE_URL}/search?q=${encodeURIComponent(query)}`;
+    const browser = await puppeteer.launch({ headless: true }); 
+    const page = await browser.newPage();
+    
+    await page.goto(url, { waitUntil: 'domcontentloaded' });
+    await page.waitForSelector('.series-results-cards-wrapper [data-t="search-series-card"]');
+    const results = await page.evaluate((limit) => {
+      const cards = document.querySelectorAll('.series-results-cards-wrapper [data-t="search-series-card"]');
+      const results = [];
+      
+      cards.forEach(card => {
+        if (results.length < limit) {
+          const title = card.querySelector('.search-show-card__title-link--7ilnY')?.innerText;
+          const url = card.querySelector('.search-show-card__title-link--7ilnY')?.href;
+          const cover = card.querySelector('.content-image__image--7tGlg').src?.replace(/cdn-cgi\/image\/[^\/]+(\/catalog\/.*)/, 'cdn-cgi/image/$1') || null;
+          
+          if (title && url && !results.some(result => result.url === url)) {
+            results.push({ title, url, cover });
+          }
+        }
+      });
+      return results;
+    }, limit);
+  
+    await browser.close();
+    return results;
+  }
+  
+
+
+export async function getEpisodeInfo(animeUrl, seasonTitle) {
+    const browser = await puppeteer.launch({ headless: true });
+    const page = await browser.newPage();
+    await page.goto(animeUrl, { waitUntil: 'domcontentloaded' });
+    try {
+        await page.waitForSelector('.erc-seasons-select .dropdown-trigger--P--FX', { timeout: 5000 });
+        await page.click('.erc-seasons-select .dropdown-trigger--P--FX');
+        await page.evaluate((seasonTitle) => {
+          const options = Array.from(document.querySelectorAll('.extended-option--Wk-jL'));
+          const target = options.find(opt => {
+            const label = opt.querySelector('.extended-option__text--MQWp1');
+            return label && label.textContent.includes(seasonTitle);
+          });
+          if (target) {
+            target.click();
+          } else {
+            console.warn('Saison non trouvée:', seasonTitle);
+          }
+        }, seasonTitle);
+    } catch {   }
+    
+    
+    try {
+      await page.waitForSelector('.show-more-button-boxed button', { timeout: 1000 }); 
+      await page.click('.show-more-button-boxed button');
+    } catch {   }
+  
+    await page.waitForSelector('div.card:not(.placeholder-card)', { timeout: 10000 });
+    const allCardInfo = await page.evaluate(() => {
+      const cards = document.querySelectorAll('div.card:not(.placeholder-card)');
+      const episodeInfo = [];
+  
+      cards.forEach(card => {
+        const title = card?.querySelector('.playable-card__title-link--96psl')?.textContent || null;
+        const synopsis = card?.querySelector('.playable-card-hover__description--4Lpe4')?.textContent || null;
+        const releaseDate = card?.querySelector('.playable-card-hover__release--3Xg35 .text--gq6o-')?.textContent || null;
+        const cover = card?.querySelector('img.progressive-image-loading__original--k-k-7')?.src?.replace(/cdn-cgi\/image\/[^\/]+(\/catalog\/.*)/, 'cdn-cgi/image/$1') || null;
+        episodeInfo.push({
+          title,
+          synopsis,
+          releaseDate,
+          cover,
+        });
+      });
+  
+      return episodeInfo;
+    });
+    await browser.close();
+    return allCardInfo; 
+  }
+  

package/scrapers/scrapers.js

@@ -1,5 +1,6 @@
 import * as animesama from "./animesama.js";
 import * as animepahe from "./animepahe.js";
+import * as crunchyroll from "./crunchyroll.js";
 
 export class AnimeScraper {
   constructor(source) {
@@ -7,8 +8,10 @@ export class AnimeScraper {
       this.source = animepahe;
     } else if (source === 'animesama') {
       this.source = animesama;
-    } else {
-      throw new Error('Invalid source. Choose either "animepahe" or "animesama".');
+    } else if (source === 'crunchyroll') {
+      this.source = crunchyroll;
+    }  else {
+      throw new Error('Invalid source. Choose either "animepahe", "crunchyroll" or "animesama".');
     }
   }
 
@@ -88,7 +91,15 @@ export class AnimeScraper {
     try {
       return await this.source.getEpisodeTitles(animeUrl, ...rest);
     } catch (error) {
-      console.error(`This scraper does not have the getRandomAnime function implemented or an error happened -> ${error}`);
+      console.error(`This scraper does not have the getEpisodeTitles function implemented or an error happened -> ${error}`);
+      return null;
+    }
+  }
+  async getEpisodeInfo(animeUrl, ...rest) {
+    try {
+      return await this.source.getEpisodeInfo(animeUrl, ...rest);
+    } catch (error) {
+      console.error(`This scraper does not have the getEpisodeInfo function implemented or an error happened -> ${error}`);
       return null;
     }
   }