rsshub 1.0.0-master.f7add90 → 1.0.0-master.f7aecbc

package/README.md

@@ -1,5 +1,5 @@
 <p align="center">
-<img src="https://docs.rsshub.app/logo.png" alt="RSSHub" width="100">
+<img src="https://docs.rsshub.app/img/logo.png" alt="RSSHub" width="100">
 </p>
 <h1 align="center">RSSHub</h1>
 
@@ -21,25 +21,19 @@ RSSHub delivers millions of contents aggregated from all kinds of sources, our v
 
 RSSHub can be used with browser extension [RSSHub Radar](https://github.com/DIYgod/RSSHub-Radar) and mobile auxiliary app [RSSBud](https://github.com/Cay-Zhang/RSSBud) (iOS) and [RSSAid](https://github.com/LeetaoGoooo/RSSAid) (Android)
 
-[English docs](https://docs.rsshub.app/en) | [Telegram Group](https://t.me/rsshub) | [Telegram Channel](https://t.me/awesomeRSSHub)
+[English docs](https://docs.rsshub.app) | [Telegram Group](https://t.me/rsshub) | [Telegram Channel](https://t.me/awesomeRSSHub)
 
----
-
-RSSHub 是一个开源、简单易用、易于扩展的 RSS 生成器，可以给任何奇奇怪怪的内容生成 RSS 订阅源。RSSHub 借助于开源社区的力量快速发展中，目前已适配数百家网站的上千项内容
-
-可以配合浏览器扩展 [RSSHub Radar](https://github.com/DIYgod/RSSHub-Radar) 和 移动端辅助 App [RSSBud](https://github.com/Cay-Zhang/RSSBud) (iOS) 与 [RSSAid](https://github.com/LeetaoGoooo/RSSAid) (Android) 食用
-
-[中文文档](https://docs.rsshub.app) | [Telegram 群](https://t.me/rsshub) | [Telegram 频道](https://t.me/awesomeRSSHub)
+[中文文档](https://docs.rsshub.app/zh/) | [Telegram 群](https://t.me/rsshub) | [Telegram 频道](https://t.me/awesomeRSSHub)
 
 ## Special Thanks
 
 ### Special Sponsors
 
 <p>
-<a href="https://rss3.io/" target="_blank"><img height="50px" src="https://i.imgur.com/vHtI4bz.png"></a>
+<a href="https://rss3.io" target="_blank"><img height="50px" src="https://i.imgur.com/lb1dDGK.png"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href="https://xlog.app/" target="_blank"><img height="50px" src="https://i.imgur.com/JuhHTKD.png"></a>
 </p>
 
-[![](https://opencollective.com/static/images/become_sponsor.svg)](https://docs.rsshub.app/en/support/)
+[![](https://opencollective.com/static/images/become_sponsor.svg)](https://docs.rsshub.app/support/)
 
 ### Contributors
 
@@ -49,34 +43,28 @@ Logo designer [sheldonrrr](https://dribbble.com/sheldonrrr)
 
 ### Backers
 
-<a href="https://www.cloudflare.com" target="_blank"><img height="50px" src="https://i.imgur.com/7Ph27Fq.png"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href="https://www.netlify.com" target="_blank"><img height="40px" src="https://i.imgur.com/cU01915.png"></a>
+<a href="https://www.cloudflare.com" target="_blank"><img height="50px" src="https://i.imgur.com/7Ph27Fq.png"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href="https://www.netlify.com" target="_blank"><img height="40px" src="https://i.imgur.com/cU01915.png"></a>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;<a href="https://1password.com" target="_blank"><img height="40px" src="https://i.imgur.com/a2XjflO.png"></a>
 
 ## Related Projects
 
--   [RSSHub Radar](https://github.com/DIYgod/RSSHub-Radar) | 一个可以帮助你快速发现和订阅当前网站 RSS 和 RSSHub 的浏览器扩展
--   [RSSBud](https://github.com/Cay-Zhang/RSSBud) ([TestFlight 公测](https://testflight.apple.com/join/rjCVzzHP)) | iOS 平台的 RSSHub Radar，专为移动生态优化
--   [RSSAid](https://github.com/LeetaoGoooo/RSSAid)  | 基于 Flutter 构建的 Android 平台的 RSSHub Radar
+-   [RSSHub Radar](https://github.com/DIYgod/RSSHub-Radar) | A browser extension that can help you quickly discover and subscribe to the RSS and RSSHub of current websites.
+-   [RSSBud](https://github.com/Cay-Zhang/RSSBud) ([TestFlight](https://testflight.apple.com/join/rjCVzzHP)) | RSSHub Radar for iOS platform, designed specifically for mobile ecosystem optimization.
+-   [RSSAid](https://github.com/LeetaoGoooo/RSSAid) | RSSHub Radar for Android platform built with Flutter.
 -   [DocSearch](https://github.com/Fatpandac/DocSearch) | Link RSSHub DocSearch into Raycast
 
 ## Join Us
 
 We welcome all pull requests. Suggestions and feedback are also welcomed [here](https://github.com/DIYgod/RSSHub/issues).
 
-Refer to [Join Us](https://docs.rsshub.app/en/joinus/quick-start.html)
-
-见 [参与我们](https://docs.rsshub.app/joinus/quick-start.html)
+Refer to [Join Us](https://docs.rsshub.app/joinus/quick-start)
 
 ## Deployment
 
-Refer to [Deployment](https://docs.rsshub.app/en/install/)
-
-见 [部署](https://docs.rsshub.app/install/)
+Refer to [Deployment](https://docs.rsshub.app/install/)
 
 ## Support RSSHub
 
-Refer to [Support RSSHub](https://docs.rsshub.app/en/support/)
-
-见 [支持 RSSHub](https://docs.rsshub.app/support/)
+Refer to [Support RSSHub](https://docs.rsshub.app/support/)
 
 RSSHub is open source and completely free under the MIT license. However, just like any other open source project, as the project grows, the hosting, development and maintenance requires funding support.
 
@@ -87,10 +75,10 @@ You can support RSSHub via donations.
 Recurring donors will be rewarded via express issue response, or even have your name displayed on our GitHub page and website.
 
 -   Become a Sponser on [GitHub](https://github.com/sponsors/DIYgod)
--   Become a Sponser on [Open Collective](https://opencollective.com/RSSHub)
 -   Become a Sponser on [Patreon](https://www.patreon.com/DIYgod)
+-   Become a Sponser on [Open Collective](https://opencollective.com/RSSHub)
 -   Become a Sponser on [爱发电](https://afdian.net/@diygod)
--   Contact us directly: i@diygod.me
+-   Contact us directly: <i@diygod.me>
 
 ### One-time Donation
 
@@ -105,4 +93,4 @@ We accept donations via the following ways:
 **RSSHub** © [DIYgod](https://github.com/DIYgod), Released under the [MIT](./LICENSE) License.<br>
 Authored and maintained by DIYgod with help from contributors ([list](https://github.com/DIYgod/RSSHub/contributors)).
 
-> Blog [@DIYgod](https://diygod.me) · GitHub [@DIYgod](https://github.com/DIYgod) · Twitter [@DIYgod](https://twitter.com/DIYgod) · Telegram Channel [@awesomeDIYgod](https://t.me/awesomeDIYgod)
+> Blog [@DIYgod](https://diygod.cc) · GitHub [@DIYgod](https://github.com/DIYgod) · Twitter [@DIYgod](https://twitter.com/DIYgod) · Telegram Channel [@awesomeDIYgod](https://t.me/awesomeDIYgod)

package/lib/app.js

@@ -13,6 +13,7 @@ const cache = require('./middleware/cache');
 const parameter = require('./middleware/parameter');
 const template = require('./middleware/template');
 const favicon = require('koa-favicon');
+const serve = require('koa-static');
 const debug = require('./middleware/debug');
 const accessControl = require('./middleware/access-control');
 const antiHotlink = require('./middleware/anti-hotlink');
@@ -36,7 +37,8 @@ const app = new Koa();
 app.proxy = true;
 
 // favicon
-app.use(favicon(__dirname + '/favicon.png'));
+app.use(favicon(__dirname + '/favicon.png', { maxAge: 31536000000 }));
+app.use(serve(__dirname + '/static', { maxage: 31536000000 }));
 
 // global error handing
 app.use(onerror);

package/lib/config.js

@@ -1,28 +1,33 @@
 require('dotenv').config();
 const randUserAgent = require('./utils/rand-user-agent');
+const got = require('got');
 let envs = process.env;
 let value;
 const TRUE_UA = 'RSSHub/1.0 (+http://github.com/DIYgod/RSSHub; like FeedFetcher-Google)';
 
 const calculateValue = () => {
     const bilibili_cookies = {};
-    const twitter_tokens = {};
     const email_config = {};
     const discuz_cookies = {};
+    const medium_cookies = {};
+    const discourse_config = {};
 
     for (const name in envs) {
         if (name.startsWith('BILIBILI_COOKIE_')) {
             const uid = name.slice(16);
             bilibili_cookies[uid] = envs[name];
-        } else if (name.startsWith('TWITTER_TOKEN_')) {
-            const id = name.slice(14);
-            twitter_tokens[id] = envs[name];
         } else if (name.startsWith('EMAIL_CONFIG_')) {
             const id = name.slice(13);
             email_config[id] = envs[name];
         } else if (name.startsWith('DISCUZ_COOKIE_')) {
             const cid = name.slice(14);
             discuz_cookies[cid] = envs[name];
+        } else if (name.startsWith('MEDIUM_COOKIE_')) {
+            const username = name.slice(14).toLowerCase();
+            medium_cookies[username] = envs[name];
+        } else if (name.startsWith('DISCOURSE_CONFIG_')) {
+            const id = name.slice('DISCOURSE_CONFIG_'.length);
+            discourse_config[id] = JSON.parse(envs[name]);
         }
     }
 
@@ -69,14 +74,16 @@ const calculateValue = () => {
             auth: envs.PROXY_AUTH,
             url_regex: envs.PROXY_URL_REGEX || '.*',
         },
+        proxyStrategy: envs.PROXY_STRATEGY || 'all', // all / on_retry
+        reverseProxyUrl: envs.REVERSE_PROXY_URL,
         // auth
         authentication: {
             name: envs.HTTP_BASIC_AUTH_NAME || 'usernam3',
             pass: envs.HTTP_BASIC_AUTH_PASS || 'passw0rd',
         },
         // access control
-        blacklist: envs.BLACKLIST && envs.BLACKLIST.split(','),
-        whitelist: envs.WHITELIST && envs.WHITELIST.split(','),
+        denylist: envs.DENYLIST && envs.DENYLIST.split(','),
+        allowlist: envs.ALLOWLIST && envs.ALLOWLIST.split(','),
         allowLocalhost: envs.ALLOW_LOCALHOST,
         accessKey: envs.ACCESS_KEY,
         // logging
@@ -84,6 +91,7 @@ const calculateValue = () => {
         debugInfo: envs.DEBUG_INFO || 'true',
         loggerLevel: envs.LOGGER_LEVEL || 'info',
         noLogfiles: envs.NO_LOGFILES,
+        showLoggerTimestamp: envs.SHOW_LOGGER_TIMESTAMP,
         sentry: {
             dsn: envs.SENTRY,
             routeTimeout: parseInt(envs.SENTRY_ROUTE_TIMEOUT) || 30000,
@@ -101,6 +109,14 @@ const calculateValue = () => {
         },
         suffix: envs.SUFFIX,
         titleLengthLimit: parseInt(envs.TITLE_LENGTH_LIMIT) || 150,
+        openai: {
+            apiKey: envs.OPENAI_API_KEY,
+            model: envs.OPENAI_MODEL || 'gpt-3.5-turbo-16k',
+            temperature: envs.OPENAI_TEMPERATURE || 0.2,
+            maxTokens: envs.OPENAI_MAX_TOKENS || null,
+            endpoint: envs.OPENAI_API_ENDPOINT || 'https://api.openai.com/v1',
+            prompt: envs.OPENAI_PROMPT || 'Please summarize the following article and reply with markdown format.',
+        },
 
         // Route-specific Configurations
         bilibili: {
@@ -130,6 +146,9 @@ const calculateValue = () => {
         discord: {
             authorization: envs.DISCORD_AUTHORIZATION,
         },
+        discourse: {
+            config: discourse_config,
+        },
         discuz: {
             cookies: discuz_cookies,
         },
@@ -194,7 +213,8 @@ const calculateValue = () => {
             cookie: envs.IG_COOKIE,
         },
         iwara: {
-            cookie: envs.IWARA_COOKIE,
+            username: envs.IWARA_USERNAME,
+            password: envs.IWARA_PASSWORD,
         },
         lastfm: {
             api_key: envs.LASTFM_API_KEY,
@@ -207,6 +227,10 @@ const calculateValue = () => {
             accessToken: envs.MASTODON_API_ACCESS_TOKEN,
             acctDomain: envs.MASTODON_API_ACCT_DOMAIN,
         },
+        medium: {
+            cookies: medium_cookies,
+            articleCookie: envs.MEDIUM_ARTICLE_COOKIE || '',
+        },
         miniflux: {
             instance: envs.MINIFLUX_INSTANCE || 'https://reader.miniflux.app',
             token: envs.MINIFLUX_TOKEN || '',
@@ -225,6 +249,9 @@ const calculateValue = () => {
             username: envs.NHENTAI_USERNAME,
             password: envs.NHENTAI_PASSWORD,
         },
+        notion: {
+            key: envs.NOTION_TOKEN,
+        },
         pianyuan: {
             cookie: envs.PIANYUAN_COOKIE,
         },
@@ -233,7 +260,7 @@ const calculateValue = () => {
         },
         pixiv: {
             refreshToken: envs.PIXIV_REFRESHTOKEN,
-            bypassCdn: envs.PIXIV_BYPASS_CDN !== '0' && envs.PIXIV_BYPASS_CDN !== 'false',
+            bypassCdn: envs.PIXIV_BYPASS_CDN && envs.PIXIV_BYPASS_CDN !== '0' && envs.PIXIV_BYPASS_CDN !== 'false',
             bypassCdnHostname: envs.PIXIV_BYPASS_HOSTNAME || 'public-api.secure.pixiv.net',
             bypassCdnDoh: envs.PIXIV_BYPASS_DOH || 'https://1.1.1.1/dns-query',
             imgProxy: envs.PIXIV_IMG_PROXY || 'https://i.pixiv.re',
@@ -244,6 +271,9 @@ const calculateValue = () => {
         saraba1st: {
             cookie: envs.SARABA1ST_COOKIE,
         },
+        sehuatang: {
+            cookie: envs.SEHUATANG_COOKIE,
+        },
         scboy: {
             token: envs.SCBOY_BBS_TOKEN,
         },
@@ -258,16 +288,17 @@ const calculateValue = () => {
         telegram: {
             token: envs.TELEGRAM_TOKEN,
         },
+        tophub: {
+            cookie: envs.TOPHUB_COOKIE,
+        },
         twitter: {
-            consumer_key: envs.TWITTER_CONSUMER_KEY,
-            consumer_secret: envs.TWITTER_CONSUMER_SECRET,
-            tokens: twitter_tokens,
-            authorization: envs.TWITTER_WEBAPI_AUTHORIZAION || 'Bearer AAAAAAAAAAAAAAAAAAAAAPYXBAAAAAAACLXUNDekMxqa8h%2F40K4moUkGsoc%3DTYfbDKbT3jJPCEVnMYqilB28NHfOPqkca3qaAxGfsyKCs0wRbw',
-            // reference: https://github.com/dangeredwolf/FixTweet/blob/f3082bbb0d69798687481a605f6760b2eb7558e0/src/constants.ts#L23-L25
+            oauthTokens: envs.TWITTER_OAUTH_TOKEN?.split(','),
+            oauthTokenSecrets: envs.TWITTER_OAUTH_TOKEN_SECRET?.split(','),
         },
         weibo: {
             app_key: envs.WEIBO_APP_KEY,
             app_secret: envs.WEIBO_APP_SECRET,
+            cookies: envs.WEIBO_COOKIES,
             redirect_url: envs.WEIBO_REDIRECT_URL,
         },
         wenku8: {
@@ -299,6 +330,21 @@ const calculateValue = () => {
 };
 calculateValue();
 
+if (envs.REMOTE_CONFIG) {
+    got.get(envs.REMOTE_CONFIG)
+        .then((response) => {
+            const data = JSON.parse(response.body);
+            if (data) {
+                envs = Object.assign(envs, data);
+                calculateValue();
+                require('@/utils/logger').info('Remote config loaded.');
+            }
+        })
+        .catch((error) => {
+            require('@/utils/logger').error('Remote config load failed.', error);
+        });
+}
+
 module.exports = {
     set: (env) => {
         envs = Object.assign(process.env, env);

package/lib/index.js

@@ -29,7 +29,7 @@ if (config.enableCluster && cluster.isMaster && process.env.NODE_ENV !== 'test'
     }
 
     logger.info('🎉 RSSHub start! Cheers!');
-    logger.info('💖 Can you help keep this open source project alive? Please sponsor 👉 https://docs.rsshub.app/en/support');
+    logger.info('💖 Can you help keep this open source project alive? Please sponsor 👉 https://docs.rsshub.app/support');
 
     module.exports = server;
 }

package/lib/maintainer.js

@@ -5,7 +5,7 @@ const { join } = require('path');
 // Presence Check
 for (const dir of fs.readdirSync(dirname)) {
     const dirPath = join(dirname, dir);
-    if (!fs.existsSync(join(dirPath, 'maintainer.js'))) {
+    if (fs.existsSync(join(dirPath, 'router.js')) && !fs.existsSync(join(dirPath, 'maintainer.js'))) {
         throw Error(`No maintainer.js in "${dirPath}".`);
     }
 }
@@ -37,7 +37,7 @@ for (const dir in maintainerPath) {
     }
 
     for (const key in routes) {
-        maintainers['/' + dir + key] = routes[key];
+        maintainers['/' + dir + (key.endsWith('/') ? key.substring(0, key.length - 1) : key)] = routes[key];
     }
 }
 
@@ -49,4 +49,9 @@ router.stack.forEach((e) => {
     }
 });
 
-module.exports = maintainers;
+module.exports = Object.keys(maintainers)
+    .sort()
+    .reduce((obj, path) => {
+        obj[path] = maintainers[path];
+        return obj;
+    }, {});

package/lib/middleware/access-control.js

@@ -15,7 +15,7 @@ module.exports = async (ctx, next) => {
     const accessKey = ctx.query.key;
     const accessCode = ctx.query.code;
 
-    const isControlled = config.accessKey || config.whitelist || config.blacklist;
+    const isControlled = config.accessKey || config.allowlist || config.denylist;
 
     const allowLocalhost = config.allowLocalhost && (await isLocalhost(ip));
 
@@ -38,14 +38,14 @@ module.exports = async (ctx, next) => {
             }
         }
 
-        if (config.whitelist) {
-            if (config.whitelist.find((white) => ip.includes(white) || requestPath.includes(white) || requestUA.includes(white))) {
+        if (config.allowlist) {
+            if (config.allowlist.find((item) => ip.includes(item) || requestPath.includes(item) || requestUA.includes(item))) {
                 return grant();
             }
         }
 
-        if (config.blacklist) {
-            if (!config.blacklist.find((black) => ip.includes(black) || requestPath.includes(black) || requestUA.includes(black))) {
+        if (config.denylist) {
+            if (!config.denylist.find((item) => ip.includes(item) || requestPath.includes(item) || requestUA.includes(item))) {
                 return grant();
             }
         }

package/lib/middleware/anti-hotlink.js

@@ -98,8 +98,8 @@ const validateTemplate = (template) => {
 module.exports = async (ctx, next) => {
     await next();
 
-    let image_hotlink_template = undefined;
-    let multimedia_hotlink_template = undefined;
+    let image_hotlink_template;
+    let multimedia_hotlink_template;
     const shouldWrapInIframe = ctx.query.wrap_multimedia_in_iframe === '1';
 
     // Read params if enabled

package/lib/middleware/cache/memory.js

@@ -1,9 +1,9 @@
-const Lru = require('lru-cache');
+const { LRUCache } = require('lru-cache');
 const config = require('@/config').value;
 
 const status = { available: false };
 
-const memoryCache = new Lru({
+const memoryCache = new LRUCache({
     ttl: config.cache.routeExpire * 1000,
     max: config.memory.max,
 });

package/lib/middleware/parameter.js

@@ -3,7 +3,11 @@ const cheerio = require('cheerio');
 const { simplecc } = require('simplecc-wasm');
 const got = require('@/utils/got');
 const config = require('@/config').value;
-const RE2 = require('re2');
+const { RE2JS } = require('re2js');
+const md = require('markdown-it')({
+    html: true,
+});
+const htmlToText = require('html-to-text');
 
 let mercury_parser;
 
@@ -23,21 +27,30 @@ const resolveRelativeLink = ($, elem, attr, baseUrl) => {
     }
 };
 
+const summarizeArticle = async (articleText) => {
+    const apiUrl = `${config.openai.endpoint}/chat/completions`;
+    const response = await got.post(apiUrl, {
+        json: {
+            model: config.openai.model,
+            max_tokens: config.openai.maxTokens,
+            messages: [
+                { role: 'system', content: config.openai.prompt },
+                { role: 'user', content: articleText },
+            ],
+            temperature: config.openai.temperature,
+        },
+        headers: {
+            Authorization: `Bearer ${config.openai.apiKey}`,
+        },
+    });
+
+    return response.data.choices[0].message.content;
+};
+
 module.exports = async (ctx, next) => {
     await next();
 
     if (!ctx.state.data && !ctx._matchedRoute) {
-        // Given that the official demo has a cache TTL of 2h, a "wrong path" page will be cached by CloudFlare for
-        // 200h (8.33d).
-        // What makes it worse is that the documentation contains status badges to detect the availability of routes,
-        // but the documentation is updated more timely than the official demo, so the every example path of every
-        // new route will probably have a "wrong path" page cached for at least 200h soon after accepted. That is to
-        // say, the example paths of a new route will probably be unavailable on the public demo in the first 200h
-        // after accepted.
-        // As a conclusion, the next 3 lines has been commented out. (exactly the same behavior as any internal error)
-        // ctx.set({
-        //     'Cache-Control': `public, max-age=${config.cache.routeExpire * 100}`,
-        // });
         throw Error('wrong path');
     }
 
@@ -147,50 +160,50 @@ module.exports = async (ctx, next) => {
                     });
                 }
             }
+
+            // handle category
+            if (item.category) {
+                // convert single string to array, and filter only string type category
+                Array.isArray(item.category) || (item.category = [item.category]);
+                item.category = item.category.filter((e) => typeof e === 'string');
+            }
             return item;
         };
 
         ctx.state.data.item = await Promise.all(ctx.state.data.item.map(handleItem));
 
         if (ctx.query) {
-            // limit
-            if (ctx.query.limit) {
-                ctx.state.data.item = ctx.state.data.item.slice(0, parseInt(ctx.query.limit));
-            }
-
             // filter
+            const engine = config.feature.filter_regex_engine;
             const makeRegex = (string) => {
+                if (!string) {
+                    return null;
+                }
                 // default: case_senstivie = true
-                const engine = config.feature.filter_regex_engine;
-                if (ctx.query.filter_case_sensitive === 'false') {
-                    switch (engine) {
-                        case 'regexp':
-                            return new RegExp(string, 'i');
-                        case 're2':
-                            return new RE2(string, 'i');
-                        default:
-                            throw Error(`Invalid Engine Value: ${engine}, please check your config.`);
-                    }
-                } else {
-                    switch (engine) {
-                        case 'regexp':
-                            return new RegExp(string);
-                        case 're2':
-                            return new RE2(string);
-                        default:
-                            throw Error(`Invalid Engine Value: ${engine}, please check your config.`);
-                    }
+                const insensitive = ctx.query.filter_case_sensitive === 'false';
+                switch (engine) {
+                    case 'regexp':
+                        return new RegExp(string, insensitive ? 'i' : '');
+                    case 're2':
+                        return RE2JS.compile(string, insensitive ? RE2JS.CASE_INSENSITIVE : 0);
+                    default:
+                        throw Error(`Invalid Engine Value: ${engine}, please check your config.`);
                 }
             };
 
             if (ctx.query.filter) {
+                const regex = makeRegex(ctx.query.filter);
+
                 ctx.state.data.item = ctx.state.data.item.filter((item) => {
                     const title = item.title || '';
                     const description = item.description || title;
                     const author = item.author || '';
-                    const category = item.category ? (Array.isArray(item.category) ? item.category : [item.category]) : [];
+                    const category = item.category || [];
                     const isFilter =
-                        title.match(makeRegex(ctx.query.filter)) || description.match(makeRegex(ctx.query.filter)) || author.match(makeRegex(ctx.query.filter)) || category.some((c) => c.match(makeRegex(ctx.query.filter)));
+                        engine === 're2'
+                            ? regex.matcher(title).find() || regex.matcher(description).find() || regex.matcher(author).find() || category.some((c) => regex.matcher(c).find())
+                            : title.match(regex) || description.match(regex) || author.match(regex) || category.some((c) => c.match(regex));
+
                     return isFilter;
                 });
             }
@@ -201,12 +214,19 @@ module.exports = async (ctx, next) => {
                     const title = item.title || '';
                     const description = item.description || title;
                     const author = item.author || '';
-                    const category = item.category ? (Array.isArray(item.category) ? item.category : [item.category]) : [];
+                    const category = item.category || [];
                     let isFilter = true;
-                    ctx.query.filter_title && (isFilter = title.match(makeRegex(ctx.query.filter_title)));
-                    ctx.query.filter_description && (isFilter = isFilter && description.match(makeRegex(ctx.query.filter_description)));
-                    ctx.query.filter_author && (isFilter = isFilter && author.match(makeRegex(ctx.query.filter_author)));
-                    ctx.query.filter_category && (isFilter = isFilter && category.some((c) => c.match(makeRegex(ctx.query.filter_category))));
+
+                    const titleRegex = makeRegex(ctx.query.filter_title);
+                    const descriptionRegex = makeRegex(ctx.query.filter_description);
+                    const authorRegex = makeRegex(ctx.query.filter_author);
+                    const categoryRegex = makeRegex(ctx.query.filter_category);
+
+                    ctx.query.filter_title && (isFilter = engine === 're2' ? titleRegex.matcher(title).find() : title.match(titleRegex));
+                    ctx.query.filter_description && (isFilter = isFilter && (engine === 're2' ? descriptionRegex.matcher(description).find() : description.match(descriptionRegex)));
+                    ctx.query.filter_author && (isFilter = isFilter && (engine === 're2' ? authorRegex.matcher(author).find() : author.match(authorRegex)));
+                    ctx.query.filter_category && (isFilter = isFilter && category.some((c) => (engine === 're2' ? categoryRegex.matcher(c).find() : c.match(categoryRegex))));
+
                     return isFilter;
                 });
             }
@@ -220,12 +240,19 @@ module.exports = async (ctx, next) => {
                     const title = item.title;
                     const description = item.description || title;
                     const author = item.author || '';
-                    const category = item.category ? (Array.isArray(item.category) ? item.category : [item.category]) : [];
+                    const category = item.category || [];
                     let isFilter = true;
-                    ctx.query.filterout_title && (isFilter = !title.match(makeRegex(ctx.query.filterout_title)));
-                    ctx.query.filterout_description && (isFilter = isFilter && !description.match(makeRegex(ctx.query.filterout_description)));
-                    ctx.query.filterout_author && (isFilter = isFilter && !author.match(makeRegex(ctx.query.filterout_author)));
-                    ctx.query.filterout_category && (isFilter = isFilter && !category.some((c) => c.match(makeRegex(ctx.query.filterout_category))));
+
+                    const titleRegex = makeRegex(ctx.query.filterout_title);
+                    const descriptionRegex = makeRegex(ctx.query.filterout_description);
+                    const authorRegex = makeRegex(ctx.query.filterout_author);
+                    const categoryRegex = makeRegex(ctx.query.filterout_category);
+
+                    ctx.query.filterout_title && (isFilter = engine === 're2' ? !titleRegex.matcher(title).find() : !title.match(titleRegex));
+                    ctx.query.filterout_description && (isFilter = isFilter && (engine === 're2' ? !descriptionRegex.matcher(description).find() : !description.match(descriptionRegex)));
+                    ctx.query.filterout_author && (isFilter = isFilter && (engine === 're2' ? !authorRegex.matcher(author).find() : !author.match(authorRegex)));
+                    ctx.query.filterout_category && (isFilter = isFilter && !category.some((c) => (engine === 're2' ? categoryRegex.matcher(c).find() : c.match(categoryRegex))));
+
                     return isFilter;
                 });
             }
@@ -243,6 +270,11 @@ module.exports = async (ctx, next) => {
                 });
             }
 
+            // limit
+            if (ctx.query.limit) {
+                ctx.state.data.item = ctx.state.data.item.slice(0, parseInt(ctx.query.limit));
+            }
+
             // telegram instant view
             if (ctx.query.tgiv) {
                 ctx.state.data.item.map((item) => {
@@ -278,6 +310,33 @@ module.exports = async (ctx, next) => {
                 await Promise.all(tasks);
             }
 
+            // openai
+            if (ctx.query.chatgpt && config.openai.apiKey) {
+                ctx.state.data.item = await Promise.all(
+                    ctx.state.data.item.map(async (item) => {
+                        if (item.description) {
+                            try {
+                                const summary = await ctx.cache.tryGet(`openai:${item.link}`, async () => {
+                                    const text = htmlToText.htmlToText(item.description);
+                                    if (text.length < 300) {
+                                        return '';
+                                    }
+                                    const summary_md = await summarizeArticle(text);
+                                    return md.render(summary_md);
+                                });
+                                // 将总结结果添加到文章数据中
+                                if (summary !== '') {
+                                    item.description = summary + '<hr/><br/>' + item.description;
+                                }
+                            } catch (e) {
+                                // when openai failed, return default description and not write cache
+                            }
+                        }
+                        return item;
+                    })
+                );
+            }
+
             // scihub
             if (ctx.query.scihub) {
                 ctx.state.data.item.map((item) => {
@@ -304,7 +363,7 @@ module.exports = async (ctx, next) => {
                         if (item.description) {
                             text = item.description.replace(/<\/?[^>]+(>|$)/g, '');
                         }
-                        if (text && text.length) {
+                        if (text?.length) {
                             if (text.length > ctx.query.brief) {
                                 item.description = `<p>${text.substring(0, ctx.query.brief)}…</p>`;
                             } else {
@@ -313,7 +372,7 @@ module.exports = async (ctx, next) => {
                         }
                     });
                 } else {
-                    throw Error(`Invalid parameter brief. Please check the doc https://docs.rsshub.app/parameter.html#shu-chu-jian-xun`);
+                    throw Error(`Invalid parameter brief. Please check the doc https://docs.rsshub.app/parameter#shu-chu-jian-xun`);
                 }
             }