qsu 0.4.5 → 0.5.3

package/README.md

@@ -76,25 +76,28 @@ Utility to help process array type data.
 | .setWithDefault | <li>defaultValue **{Any}**</li><li>arrayLength **{Number&#124;null}**</li> | Initialize an array with a default value of a specific length. | `setWithDefault('abc', 4) // ['abc', 'abc', 'abc', 'abc']`<br/>`setWithDefault(null, 3) // [null, null, null]` |
 | .unique | array **{Array}** | Remove duplicate values from array and two-dimensional array data. In the case of 2d arrays, json type data duplication is not removed. | `unique([1, 2, 2, 3]) // [1, 2, 3]`<br/>`unique([[1], [1], [2]) // [[1], [2]]` |
 | .setWithNumber | <li>start **{Number}**</li><li>end **{Number}**</li> | Creates and returns an Array in the order of start...end values. | `setWithNumber(1, 3) // [1, 2, 3]`<br/>`setWithNumber(0, 3) // [0, 1, 2, 3]` |
+| .average | <li>array **{Array}**</li> | Returns the average of all numeric values in an array. | `average([1, 5, 15, 50]) // 17.75` |
 
 ## qsu.string
 Utility to help process string type data.
 
-| Method | Params | Description | Example |
-| --- | --- | --- | --- |
-| .removeSpecialChar | string **{String}** | Returns after removing all special characters, including spaces. | `removeSpecialChar('Hello, World!') // 'HelloWorld'` |
-| .removeNewLine | string **{String}** | Removes \n, \r characters or replaces them with specified characters. | `removeNewLine('ab\ncd') // 'abcd'`<br/>`removeNewLine('ab\r\ncd', '-') // 'ab-cd'` |
-| .capitalizeFirst | string **{String}** | Converts the first letter of the entire string to uppercase and returns. | `capitalizeFirst('abcd') // 'Abcd'` |
-| .count | <li>string **{String}**</li><li>search **{String}**</li> | Returns the number of times the second String character is contained in the first String argument. | `count('abcabc', 'a') // 2` |
-| .shuffle | <li>string **{String}**</li> | Randomly shuffles the received string and returns it. | `shuffle('abcdefg') // 'bgafced'` |
-| .createRandom | <li>length **{Number}**</li> | Returns a random String containing numbers or uppercase and lowercase letters of the given length. The default return length is 12. | `createRandom(5) // 'CHy2M'` |
-| .hideRandom | <li>str **{String}**</li><li>hideLength **{Number}**</li><li>hideStr **{String}**</li> | Replaces strings at random locations with a specified number of characters (default 1) with characters (default *). | `hideRandom('hello', 2, '#') // '#el#o'` |
-| .truncate | <li>str **{String}**</li><li>length **{Number}**</li><li>ellipsis **{String&#124;null}**</li> | Truncates a long string to a specified length, optionally appending an ellipsis after the string. | `truncate('hello', 3) // 'hel'`<br/>`truncate('hello', 2, '...') // 'he...'` |
-| .encrypt | <li>str **{String}**</li><li>secret **{String}**</li><li>algorithm **{String&#124;null}**</li><li>ivSize **{Number&#124;null}**</li> | Encrypt with the algorithm of your choice (algorithm default: aes-256-cbc, ivSize default: 16) using a string and a secret (secret). | `encrypt('test', 'secret-key')` |
-| .decrypt | <li>str **{String}**</li><li>secret **{String}**</li><li>algorithm **{String&#124;null}**</li> | Decrypt with the specified algorithm (default: `aes-256-cbc`) using a string and a secret (secret). | `decrypt('61ba43b65fc...', 'secret-key') // 'test'` |
-| .md5 | <li>str **{String}**</li> | Converts String data to md5 hash value and returns it. | `md5('test') // '098f6bcd4621d373cade4e832627b4f6'` |
-| .sha1 | <li>str **{String}**</li> | Converts String data to sha1 hash value and returns it. | `sha1('test') // 'a94a8fe5ccb19ba61c4c0873d391e987982fbbd3'` |
-| .sha256 | <li>str **{String}**</li> | Converts String data to sha256 hash value and returns it. | `sha256('test') // '9f86d081884c7d659a2feaa0c55ad015a3bf4f1b2b0b822cd15d6c15b0f00a08'` |
+| Method | Params                                                                                                                               | Description | Example                                                                                |
+| --- |--------------------------------------------------------------------------------------------------------------------------------------| --- |----------------------------------------------------------------------------------------|
+| .removeSpecialChar | <li>string **{String}**</li><li>withoutSpace **{Boolean}**</li>                                                                      | Returns after removing all special characters, including spaces. | `removeSpecialChar('Hello, World!') // 'HelloWorld'`                                   |
+| .removeNewLine | string **{String}**                                                                                                                  | Removes \n, \r characters or replaces them with specified characters. | `removeNewLine('ab\ncd') // 'abcd'`<br/>`removeNewLine('ab\r\ncd', '-') // 'ab-cd'`    |
+| .capitalizeFirst | string **{String}**                                                                                                                  | Converts the first letter of the entire string to uppercase and returns. | `capitalizeFirst('abcd') // 'Abcd'`                                                    |
+| .capitalizeEachWords | <li>string **{String}**</li><li>naturally **{Boolean}**</li> | Converts every word with spaces to uppercase. If the naturally argument is true, only some special cases (such as prepositions) are kept lowercase. | `capitalizeEachWords('hello world') // 'Hello World'`                                  |
+| .count | <li>string **{String}**</li><li>search **{String}**</li>                                                                             | Returns the number of times the second String character is contained in the first String argument. | `count('abcabc', 'a') // 2`                                                            |
+| .shuffle | <li>string **{String}**</li>                                                                                                         | Randomly shuffles the received string and returns it. | `shuffle('abcdefg') // 'bgafced'`                                                      |
+| .createRandom | <li>length **{Number}**</li>                                                                                                         | Returns a random String containing numbers or uppercase and lowercase letters of the given length. The default return length is 12. | `createRandom(5) // 'CHy2M'`                                                           |
+| .hideRandom | <li>str **{String}**</li><li>hideLength **{Number}**</li><li>hideStr **{String}**</li>                                               | Replaces strings at random locations with a specified number of characters (default 1) with characters (default *). | `hideRandom('hello', 2, '#') // '#el#o'`                                               |
+| .truncate | <li>str **{String}**</li><li>length **{Number}**</li><li>ellipsis **{String&#124;null}**</li>                                        | Truncates a long string to a specified length, optionally appending an ellipsis after the string. | `truncate('hello', 3) // 'hel'`<br/>`truncate('hello', 2, '...') // 'he...'`           |
+| .encrypt | <li>str **{String}**</li><li>secret **{String}**</li><li>algorithm **{String&#124;null}**</li><li>ivSize **{Number&#124;null}**</li> | Encrypt with the algorithm of your choice (algorithm default: aes-256-cbc, ivSize default: 16) using a string and a secret (secret). | `encrypt('test', 'secret-key')`                                                        |
+| .decrypt | <li>str **{String}**</li><li>secret **{String}**</li><li>algorithm **{String&#124;null}**</li>                                       | Decrypt with the specified algorithm (default: `aes-256-cbc`) using a string and a secret (secret). | `decrypt('61ba43b65fc...', 'secret-key') // 'test'`                                    |
+| .md5 | <li>str **{String}**</li>                                                                                                            | Converts String data to md5 hash value and returns it. | `md5('test') // '098f6bcd4621d373cade4e832627b4f6'`                                    |
+| .sha1 | <li>str **{String}**</li>                                                                                                            | Converts String data to sha1 hash value and returns it. | `sha1('test') // 'a94a8fe5ccb19ba61c4c0873d391e987982fbbd3'`                           |
+| .sha256 | <li>str **{String}**</li>                                                                                                            | Converts String data to sha256 hash value and returns it. | `sha256('test') // '9f86d081884c7d659a2feaa0c55ad015a3bf4f1b2b0b822cd15d6c15b0f00a08'` |
+| .unique | <li>str **{String}**</li>                                                                                                            | Remove duplicate characters from a given string and output only one. | `unique('aaabbbcc') // 'abc'`                                                          |
 
 ## qsu.math
 Utility for arithmetic on numbers.
@@ -108,15 +111,15 @@ Utility for arithmetic on numbers.
 ## qsu.verify
 Utility for data inspection.
 
-| Method | Params | Description | Example |
-| --- | --- | --- | --- |
-| .empty | data **{Any}** | Returns true if the passed data is empty or has a length of 0. | `empty([]) // true`<br/>`empty('') // true`<br/>`empty('abc') // false` |
-| .isUrl | <li>url **{String}**</li><li>withProtocol **{Boolean&#124;null}**</li><li>strict **{Boolean&#124;null}**</li> | Returns true if the given data is in the correct URL format. If withProtocol is true, it is automatically appended to the URL when the protocol does not exist. If strict is true, URLs without commas (.) return false. | `isUrl('google.com') // false`<br/>`isUrl('google.com', true) // true`<br/>`isUrl('https://google.com') // true` |
-| .contains | <li>string **{String}**</li><li>searchData **{Array&#124;String}** | Returns true if the first string argument contains the second argument "string" or "one or more of the strings listed in the array". | `contains('abc', 'a') // true`<br/>`contains('abc', 'd') // false`<br/>`contains('abc', ['a', 'd']) // true` |
-| .is2dArray | array **{Array}** | Returns true if the given array is a two-dimensional array. | `is2dArray([1]) // false`<br/>`is2dArray([[1], [2]) // true` |
-| .between | <li>value **{Number}**</li><li>range **{[min, max]}</li><li>inclusive **{Boolean&#124;null}**</li>** | Returns true if the first argument is in the range of the second argument ([min, max]). To allow the minimum and maximum values to be in the range, pass true for the third argument. | `between(10, [10, 20]) // false`<br/>`between(10, [10, 20], true) // true` |
-| .length | <li>data **{Any}**</li> | Returns the length of any type of data. If the argument value is null or undefined, 0 is returned. | `length('12345') // 5`<br/>`length([1, 2, 3]]) // 3` |
-| .isBotAgent | <li>userAgent **{String}**</li> | Analyze the user agent value to determine if it's a bot for a search engine. Returns true if it's a bot. | `isBotAgent('Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)') // true` |
+| Method | Params                                                                                                          | Description                                                                                                                                                                                                              | Example |
+| --- |-----------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| --- |
+| .empty | data **{Any}**                                                                                                  | Returns true if the passed data is empty or has a length of 0.                                                                                                                                                           | `empty([]) // true`<br/>`empty('') // true`<br/>`empty('abc') // false` |
+| .isUrl | <li>url **{String}**</li><li>withProtocol **{Boolean&#124;null}**</li><li>strict **{Boolean&#124;null}**</li>   | Returns true if the given data is in the correct URL format. If withProtocol is true, it is automatically appended to the URL when the protocol does not exist. If strict is true, URLs without commas (.) return false. | `isUrl('google.com') // false`<br/>`isUrl('google.com', true) // true`<br/>`isUrl('https://google.com') // true` |
+| .contains | <li>string **{String}**</li><li>searchData **{Array&#124;String}**</li><li>exact **{Boolean}**</li> | Returns true if the first string argument contains the second argument "string" or "one or more of the strings listed in the array". If the exact value is true, it returns true only for an exact match. | `contains('abc', 'a') // true`<br/>`contains('abc', 'd') // false`<br/>`contains('abc', ['a', 'd']) // true` |
+| .is2dArray | array **{Array}**                                                                                               | Returns true if the given array is a two-dimensional array.                                                                                                                                                              | `is2dArray([1]) // false`<br/>`is2dArray([[1], [2]) // true` |
+| .between | <li>value **{Number}**</li><li>range **{[min, max]}</li><li>inclusive **{Boolean&#124;null}**</li>**            | Returns true if the first argument is in the range of the second argument ([min, max]). To allow the minimum and maximum values to be in the range, pass true for the third argument.                                    | `between(10, [10, 20]) // false`<br/>`between(10, [10, 20], true) // true` |
+| .length | <li>data **{Any}**</li>                                                                                         | Returns the length of any type of data. If the argument value is null or undefined, 0 is returned.                                                                                                                       | `length('12345') // 5`<br/>`length([1, 2, 3]]) // 3` |
+| .isBotAgent | <li>userAgent **{String}**</li>                                                                                 | Analyze the user agent value to determine if it's a bot for a search engine. Returns true if it's a bot.                                                                                                                 | `isBotAgent('Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)') // true` |
 
 ## qsu.format
 Utility that converts to Human-Readable String format.

package/array.js

@@ -33,9 +33,15 @@ const setWithNumber = (start, end) => {
   return Array.from({ length: (end - start) + 1 }, (_, i) => i + start);
 };
 
+const average = (arr) => {
+  if (!arr) return null;
+  return arr.reduce((p, c) => p + c, 0) / arr.length;
+};
+
 module.exports = {
   shuffle,
   setWithDefault,
   unique,
   setWithNumber,
+  average,
 };

package/date.js

@@ -13,7 +13,7 @@ const today = (dateType) => {
   if (dateType !== undefined && typeof dateType !== 'string') {
     return null;
   }
-  return moment().format(dateType ? dateType.toUpperCase() : 'YYYY-MM-DD');
+  return moment().format(dateType || 'YYYY-MM-DD');
 };
 
 const isRealDate = (d) => {

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "qsu",
-  "version": "0.4.5",
+  "version": "0.5.3",
   "description": "Quick and Simple Utility for javascript",
   "scripts": {
     "test": "npm run lint && mocha --require @babel/register --parallel test/*.spec.js",
@@ -18,13 +18,13 @@
     "url": "https://github.com/jooy2/qsu"
   },
   "devDependencies": {
-    "@babel/node": "^7.15.8",
-    "@babel/preset-env": "^7.15.8",
-    "@babel/register": "^7.15.3",
-    "eslint": "7.32.0",
-    "eslint-config-airbnb": "^18.2.1",
-    "eslint-plugin-import": "^2.24.2",
-    "mocha": "^9.1.2"
+    "@babel/node": "^7.16.8",
+    "@babel/preset-env": "^7.16.8",
+    "@babel/register": "^7.16.9",
+    "eslint": "^8.7.0",
+    "eslint-config-airbnb": "^19.0.4",
+    "eslint-plugin-import": "^2.25.4",
+    "mocha": "^9.1.4"
   },
   "dependencies": {
     "moment": "^2.29.1"

package/string.js

@@ -1,9 +1,10 @@
 const crypto = require('crypto');
 const { rand } = require('./math');
+const { contains } = require('./verify');
 
-const removeSpecialChar = (str) => {
+const removeSpecialChar = (str, withoutSpace) => {
   if (!str || typeof str !== 'string') return str;
-  return str.replace(/[^a-zA-Z가-힣ㄱ-ㅎㅏ-ㅣ0-9\u3040-\u30ff\u3400-\u4dbf\u4e00-\u9fff\uf900-\ufaff\uff66-\uff9f]/gi, '');
+  return str.replace(new RegExp(`[^a-zA-Z가-힣ㄱ-ㅎㅏ-ㅣ0-9\u3040-\u30ff\u3400-\u4dbf\u4e00-\u9fff\uf900-\ufaff\uff66-\uff9f${withoutSpace ? ' ' : ''}]`, 'gi'), '');
 };
 
 const removeNewLine = (str, replaceTo = '') => {
@@ -16,6 +17,20 @@ const capitalizeFirst = (str) => {
   return str.charAt(0).toUpperCase() + str.slice(1);
 };
 
+const capitalizeEachWords = (str, naturally) => {
+  if (!str || typeof str !== 'string' || str.length < 1) return null;
+  const splitStr = str.trim().toLowerCase().split(' ');
+  for (let i = 0, iLen = splitStr.length; i < iLen; i += 1) {
+    if (!naturally || !contains(splitStr[i], [
+      'in', 'on', 'the', 'at', 'and', 'or', 'of', 'for', 'to', 'that',
+      'a', 'by', 'it', 'is', 'as', 'are', 'were', 'was', 'nor', 'an',
+    ], true)) {
+      splitStr[i] = capitalizeFirst(splitStr[i]);
+    }
+  }
+  return capitalizeFirst(splitStr.join(' '));
+};
+
 const count = (str, search) => {
   if (!str || typeof str !== 'string' || !search || typeof search !== 'string') return 0;
   return (str.match(new RegExp(search, 'g')) || []).length;
@@ -27,10 +42,19 @@ const shuffle = (str) => {
 };
 
 const createRandom = (length = 12) => {
-  if (typeof length !== 'number') return null;
-  return Math.random().toString(36).substr(2, length).split('')
-    .map(c => (Math.random() < 0.5 ? c.toUpperCase() : c))
-    .join('');
+  if (typeof length !== 'number') {
+    return null;
+  }
+  let result = '';
+  let newChar;
+  const AVAIL_CHARACTERS = 'abcdefghijklmnopqrstuvwxyz0123456789';
+  const AVAIL_CHARACTERS_LENGTH = AVAIL_CHARACTERS.length;
+  for (let i = 0; i < length; i += 1) {
+    newChar = AVAIL_CHARACTERS.charAt(Math.floor(Math.random() * AVAIL_CHARACTERS_LENGTH));
+    newChar = Math.random() < 0.5 ? newChar.toUpperCase() : newChar;
+    result += newChar;
+  }
+  return result;
 };
 
 const hideRandom = (str, hideLength = 1, hideStr = '*') => {
@@ -95,10 +119,18 @@ const sha256 = (str) => {
   return crypto.createHash('sha256').update(str).digest('hex');
 };
 
+const unique = (str) => {
+  if (!str || typeof str !== 'string' || str.length < 1) {
+    throw new Error('string arguments required');
+  }
+  return String.prototype.concat(...new Set(str));
+};
+
 module.exports = {
   removeSpecialChar,
   removeNewLine,
   capitalizeFirst,
+  capitalizeEachWords,
   count,
   shuffle,
   createRandom,
@@ -109,4 +141,5 @@ module.exports = {
   md5,
   sha1,
   sha256,
+  unique,
 };

package/test/array.spec.js

@@ -32,4 +32,11 @@ describe('Array', () => {
     assert.deepStrictEqual(_.setWithNumber(1, 1), [1]);
     done();
   });
+
+  it('average', (done) => {
+    assert.deepStrictEqual(_.average([1, 3, 5, 7, 9]), 5);
+    assert.deepStrictEqual(_.average([1, 5, 15, 50]), 17.75);
+    assert.deepStrictEqual(_.average([5, -5]), 0);
+    done();
+  });
 });

package/test/string.spec.js

@@ -7,6 +7,7 @@ describe('String', () => {
     assert.strictEqual(_.removeSpecialChar('Hello, World!'), 'HelloWorld');
     assert.strictEqual(_.removeSpecialChar('12 34-56,78=90'), '1234567890');
     assert.strictEqual(_.removeSpecialChar('ABC가나다ㄱㄴㄷㅏㅑㅓ天地人'), 'ABC가나다ㄱㄴㄷㅏㅑㅓ天地人');
+    assert.strictEqual(_.removeSpecialChar('Hello World', true), 'Hello World');
     done();
   });
 
@@ -28,6 +29,13 @@ st`), 'test');
     done();
   });
 
+  it('capitalizeEachWords', (done) => {
+    assert.strictEqual(_.capitalizeEachWords('hello, world!'), 'Hello, World!');
+    assert.strictEqual(_.capitalizeEachWords('test'), 'Test');
+    assert.strictEqual(_.capitalizeEachWords('this is the test sentence.', true), 'This is the Test Sentence.');
+    done();
+  });
+
   it('count', (done) => {
     assert.strictEqual(_.count('hello', 'l'), 2);
     assert.strictEqual(_.count('abcdABCD', 'a'), 1);
@@ -90,4 +98,10 @@ st`), 'test');
     assert.strictEqual(_.sha256('qsu-md5'), '8c4cfec3ec79dc572958ea7f0e3cfd24b90d174969df9a4773b37b68498871ed');
     done();
   });
+
+  it('unique', (done) => {
+    assert.strictEqual(_.unique('ababcdcd'), 'abcd');
+    assert.strictEqual(_.unique('abc--11111'), 'abc-1');
+    done();
+  });
 });

package/test/verify.spec.js

@@ -35,6 +35,8 @@ describe('Verify', () => {
     assert.strictEqual(_.contains('12345', '10'), false);
     assert.strictEqual(_.contains('ABC', ['A', 'B', 'C']), true);
     assert.strictEqual(_.contains('ABC', ['D', 'E', 'F']), false);
+    assert.strictEqual(_.contains('ABC', ['AB', 'C'], true), false);
+    assert.strictEqual(_.contains('AB', ['AB', 'C', 'D'], true), true);
     done();
   });
 

package/verify.js

@@ -1,8 +1,6 @@
 const empty = (data) => {
   if (!data) return true;
   switch (typeof data) {
-    default:
-      return false;
     case 'string':
       return data.length < 1;
     case 'object':
@@ -10,6 +8,8 @@ const empty = (data) => {
         return data.length < 1;
       }
       return Object.keys(data).length < 1;
+    default:
+      return false;
   }
 };
 
@@ -25,12 +25,18 @@ const isUrl = (url, withProtocol = false, strict = false) => {
   return true;
 };
 
-const contains = (str, search) => {
+const contains = (str, search, exact) => {
   if (!str || !search || (typeof str !== 'string' && typeof str !== 'object')
       || (typeof str === 'object' && !Array.isArray(str))) return false;
   if (typeof search === 'string') return str.indexOf(search) !== -1;
   for (let i = 0, iLen = search.length; i < iLen; i += 1) {
-    if (str.indexOf(search[i]) !== -1) return true;
+    if (exact) {
+      if (str === search[i]) {
+        return true;
+      }
+    } else if (str.indexOf(search[i]) !== -1) {
+      return true;
+    }
   }
   return false;
 };
@@ -51,9 +57,6 @@ const between = (number, range, inclusive = false) => {
 const length = (data) => {
   if (!data || typeof data === 'undefined') return 0;
   switch (typeof data) {
-    default:
-    case 'string':
-      return data.length;
     case 'object':
       return Array.isArray(data) ? data.length : Object.keys(data).length;
     case 'number':
@@ -63,12 +66,15 @@ const length = (data) => {
       return data ? 4 : 5;
     case 'function':
       return length(data());
+    case 'string':
+    default:
+      return data.length;
   }
 };
 
 const isBotAgent = (userAgent) => {
   if (!userAgent || typeof userAgent !== 'string' || userAgent.length < 1) return false;
-  return new RegExp('(bot|naverbot|google|Googlebot|Googlebot-Mobile|Googlebot-Image|Google favicon|Mediapartners-Google|bingbot|slurp|java|wget|curl|Commons-HttpClient|Python-urllib|libwww|httpunit|nutch|phpcrawl|msnbot|jyxobot|FAST-WebCrawler|FAST Enterprise Crawler|biglotron|teoma|convera|seekbot|gigablast|exabot|ngbot|ia_archiver|GingerCrawler|webmon |httrack|webcrawler|grub.org|UsineNouvelleCrawler|antibot|netresearchserver|speedy|fluffy|bibnum.bnf|findlink|msrbot|panscient|yacybot|AISearchBot|IOI|ips-agent|tagoobot|MJ12bot|dotbot|woriobot|yanga|buzzbot|mlbot|yandexbot|purebot|Linguee Bot|Voyager|CyberPatrol|voilabot|baiduspider|citeseerxbot|spbot|twengabot|postrank|turnitinbot|scribdbot|page2rss|sitebot|linkdex|Adidxbot|blekkobot|ezooms|dotbot|Mail.RU_Bot|discobot|heritrix|findthatfile|europarchive.org|NerdByNature.Bot|sistrix crawler|ahrefsbot|Aboundex|domaincrawler|wbsearchbot|summify|ccbot|edisterbot|seznambot|ec2linkfinder|gslfbot|aihitbot|intelium_bot|facebookexternalhit|yeti|RetrevoPageAnalyzer|lb-spider|sogou|lssbot|careerbot|wotbox|wocbot|ichiro|DuckDuckBot|lssrocketcrawler|drupact|webcompanycrawler|acoonbot|openindexspider|gnam gnam spider|web-archive-net.com.bot|backlinkcrawler|coccoc|integromedb|content crawler spider|toplistbot|seokicks-robot|it2media-domain-crawler|ip-web-crawler.com|siteexplorer.info|elisabot|proximic|changedetection|blexbot|arabot|WeSEE:Search|niki-bot|CrystalSemanticsBot|rogerbot|360Spider|psbot|InterfaxScanBot|Lipperhey SEO Service|CC Metadata Scaper|g00g1e.net|GrapeshotCrawler|urlappendbot|brainobot|fr-crawler|binlar|SimpleCrawler|Livelapbot|Twitterbot|cXensebot|smtbot|bnf.fr_bot|A6-Indexer|ADmantX|Facebot|Twitterbot|OrangeBot|memorybot|AdvBot|MegaIndex|SemanticScholarBot|ltx71|nerdybot|xovibot|BUbiNG|Qwantify|archive.org_bot|Applebot|TweetmemeBot|crawler4j|findxbot|SemrushBot|yoozBot|lipperhey|y!j-asr|Domain Re-Animator Bot|AddThis)', 'i').test(userAgent);
+  return /bot|naverbot|google|Googlebot|Googlebot-Mobile|Googlebot-Image|Google favicon|Mediapartners-Google|bingbot|slurp|java|wget|curl|Commons-HttpClient|Python-urllib|libwww|httpunit|nutch|phpcrawl|msnbot|jyxobot|FAST-WebCrawler|FAST Enterprise Crawler|biglotron|teoma|convera|seekbot|gigablast|exabot|ngbot|ia_archiver|GingerCrawler|webmon |httrack|webcrawler|grub.org|UsineNouvelleCrawler|antibot|netresearchserver|speedy|fluffy|bibnum.bnf|findlink|msrbot|panscient|yacybot|AISearchBot|IOI|ips-agent|tagoobot|MJ12bot|dotbot|woriobot|yanga|buzzbot|mlbot|yandexbot|purebot|Linguee Bot|Voyager|CyberPatrol|voilabot|baiduspider|citeseerxbot|spbot|twengabot|postrank|turnitinbot|scribdbot|page2rss|sitebot|linkdex|Adidxbot|blekkobot|ezooms|dotbot|Mail.RU_Bot|discobot|heritrix|findthatfile|europarchive.org|NerdByNature.Bot|sistrix crawler|ahrefsbot|Aboundex|domaincrawler|wbsearchbot|summify|ccbot|edisterbot|seznambot|ec2linkfinder|gslfbot|aihitbot|intelium_bot|facebookexternalhit|yeti|RetrevoPageAnalyzer|lb-spider|sogou|lssbot|careerbot|wotbox|wocbot|ichiro|DuckDuckBot|lssrocketcrawler|drupact|webcompanycrawler|acoonbot|openindexspider|gnam gnam spider|web-archive-net.com.bot|backlinkcrawler|coccoc|integromedb|content crawler spider|toplistbot|seokicks-robot|it2media-domain-crawler|ip-web-crawler.com|siteexplorer.info|elisabot|proximic|changedetection|blexbot|arabot|WeSEE:Search|niki-bot|CrystalSemanticsBot|rogerbot|360Spider|psbot|InterfaxScanBot|Lipperhey SEO Service|CC Metadata Scaper|g00g1e.net|GrapeshotCrawler|urlappendbot|brainobot|fr-crawler|binlar|SimpleCrawler|Livelapbot|Twitterbot|cXensebot|smtbot|bnf.fr_bot|A6-Indexer|ADmantX|Facebot|Twitterbot|OrangeBot|memorybot|AdvBot|MegaIndex|SemanticScholarBot|ltx71|nerdybot|xovibot|BUbiNG|Qwantify|archive.org_bot|Applebot|TweetmemeBot|crawler4j|findxbot|SemrushBot|yoozBot|lipperhey|y!j-asr|Domain Re-Animator Bot|AddThis/i.test(userAgent);
 };
 
 module.exports = {