payload-ai 0.0.53 → 0.0.67

package/README.md

@@ -1,6 +1,6 @@
 # Payload AI
 
-Translate content to different languages using OpenAI's GPT.
+Translate content to different languages using [OpenAI's GPT](https://openai.com/).
 
 
 ### How to install the plugin
@@ -32,7 +32,7 @@ export const config = buildConfig({
 });
 ```
 
-### Collection translation
+### Collection translation 📦
 
 Add the `collections` where you want to enable the translation and the `fields`. It will translate each field (also nested fields) on every update of the default language.
 
@@ -41,15 +41,10 @@ plugins: [
   aiTranslatorPlugin({
     enabled: true,
     collections: {
-      examples: {
-        // prompts: [myCollectionPrompt]
+      examples: { // Name of the collection you want to add translations
         fields: [
-          'stringText', 
+          'stringText', // Keys of fields you want to translate (wil also translate nested fields)
           'richText',
-          {
-            "fieldWithCustomPrompt": 
-              {prompt: myPromptFunction}
-          }
         ],
       },
     },
@@ -57,21 +52,38 @@ plugins: [
 ],
 ```
 
-#### Use in hooks
 
-TODO: add documentation
-
-myCollectionPrompt = ({source}) => {
-
-  source()
+#### Custom prompts by Field
 
-  return 
-}
+Use `promptFunc` for each field to customize the prompt.
 
-#### Custom prompts by Field
+```jsx
+plugins: [
+  aiTranslatorPlugin({
+    enabled: true,
+    collections: {
+      examples: {
+          settings: {
+            model: 'gpt-4',
+            promptFunc: ({ messages, namespace }) => {
+              return [
+                {
+                  role: 'system',
+                  content:
+                    'Important: Add a smily face at the end of the message to make the AI more friendly. 😊',
+                },
+                ...messages,
+              ]
+            },
+          },
+        },
+    }
+  }
+]
+```
 
-Use the `prompt` function for each field to use a customized prompt. The function will allow you to use the following
 
+ The function will allow you to use the following
 
 - `req`: Request
 - `doc` Document in languages
@@ -87,9 +99,6 @@ Use the `prompt` function for each field to use a customized prompt. The functio
 - sourceField
 
 
-```jsx
-customPrompt = ({sourceField}) => `Translate ${sourceField} to ${targetLanguage}.`
-```
 
 ### Use with [payload-seo](https://payloadcms.com/docs/plugins/seo)
 
@@ -121,222 +130,69 @@ plugins: [
   }),
 ],
 ```
+#### Change model for string translation
 
-### Generate SEO
-
-
-### Planned features
-
-- generate image alt text from GPT
-- generate SEO Text
-- generate structured content
-- custom access control
-- custom overrides for translation
-- generate images based on input
-- generate Open Graph based on content
-
-Payload is built with a robust infrastructure intended to support Plugins with ease. This provides a simple, modular, and reusable way for developers to extend the core capabilities of Payload.
-
-To build your own Payload plugin, all you need is:
-
-* An understanding of the basic Payload concepts
-* And some JavaScript/Typescript experience
+To update the model you can change the collection settings in the same way as with other collections.
 
-
-
-
-
-### Initialization
-
-The initialization process goes in the following order:
-
-1. Incoming config is validated
-2. **Plugins execute**
-3. Default options are integrated
-4. Sanitization cleans and validates data
-5. Final config gets initialized
-
-## Building the Plugin
-
-When you build a plugin, you are purely building a feature for your project and then abstracting it outside of the project.
-
-### Template Files
-
-In the [payload-plugin-template](https://github.com/payloadcms/payload-plugin-template), you will see a common file structure that is used across all plugins:
-
-1. root folder
-2. /src folder
-3. /dev folder
-
-#### Root
-
-In the root folder, you will see various files that relate to the configuration of the plugin. We set up our environment in a similar manner in Payload core and across other projects, so hopefully these will look familiar:
-
-* **README**.md* - This contains instructions on how to use the template. When you are ready, update this to contain instructions on how to use your Plugin.
-* **package**.json* - Contains necessary scripts and dependencies. Overwrite the metadata in this file to describe your Plugin.
-* .**editorconfig** - Defines settings to maintain consistent coding styles.
-* .**eslintrc**.js - Eslint configuration for reporting on problematic patterns.
-* .**gitignore** - List specific untracked files to omit from Git.
-* .**prettierrc**.js - Configuration for Prettier code formatting.
-* **LICENSE** - As part of the open-source community, we ship all plugins with an MIT license but it is not required.
-* **tsconfig**.json - Configures the compiler options for TypeScript
-
-**IMPORTANT***: You will need to modify these files.
-
-#### Dev
-
-In the dev folder, you’ll find a basic payload project, created with `npx create-payload-app` and the blank template.
-
-The `samplePlugin` has already been installed to the `payload.config()` file in this project.
-
-```ts
+```jsx
 plugins: [
-  samplePlugin({
-    enabled: false,
-  })
-]
-```
-
-Later when you rename the plugin or add additional options, make sure to update them here.
-
-You may wish to add collections or expand the test project depending on the purpose of your plugin. Just make sure to keep this dev environment as simplified as possible - users should be able to install your plugin without additional configuration required.
-
-When you’re ready to start development, navigate into this folder with `cd dev`
-
-And then start the project with `yarn dev` and pull up [http://localhost:3000/](http://localhost:3000/) in your browser.
-
-#### Src
-
-Now that we have our environment setup and we have a dev project ready to - it’s time to build the plugin!
-
-**index.ts**
-
-First up, the `src/index.ts` file. It is best practice not to build the plugin directly in this file, instead we use this to export the plugin and types from separate files.
-
-**Plugin.ts**
-
-To reiterate, the essence of a payload plugin is simply to extend the payload config - and that is exactly what we are doing in this file.
-
-```ts
-export const samplePlugin =
-  (pluginOptions: PluginTypes) =>
-    (incomingConfig: Config): Config => {
-      let config = { ...incomingConfig }
-
-      // do something cool with the config here
-
-      return config
+  aiTranslatorPlugin({
+    enabled: true,
+    stringTranslation: {
+      enabled: true
     }
-
-```
-
-First, we receive the existing payload config along with any plugin options.
-
-Then we set the variable `config` to be equal to the existing config.
-
-From here, you can extend the config as you wish.
-
-Finally, you return the config and that is it!
-
-##### Spread Syntax
-
-Spread syntax (or the spread operator) is a feature in JavaScript that uses the dot notation **(...)** to spread elements from arrays, strings, or objects into various contexts.
-
-We are going to use spread syntax to allow us to add data to existing arrays without losing the existing data. It is crucial to spread the existing data correctly – else this can cause adverse behavior and conflicts with Payload config and other plugins.
-
-Let’s say you want to build a plugin that adds a new collection:
-
-```ts
-config.collections = [
-  ...(config.collections || []),
-  // Add additional collections here
-]
+    collections: {
+      translations: {
+        settings: {
+          model: 'gpt-4',
+        },
+      }
+    }
+  }),
+],
 ```
 
-First we spread the `config.collections` to ensure that we don’t lose the existing collections, then you can add any additional collections just as you would in a regular payload config.
+### Access control
 
-This same logic is applied to other properties like admin, hooks, globals:
+By default the plugin will use the [update](https://payloadcms.com/docs/access-control/collections#update) access control of the collection.
 
-```ts
-config.globals = [
-  ...(config.globals || []),
-  // Add additional globals here
-]
+To overwrite that behaviour you can add `access` to the collections configuration.
 
-config.hooks = {
-  ...(incomingConfig.hooks || {}),
-  // Add additional hooks here
-}
-```
 
-Some properties will be slightly different to extend, for instance the onInit property:
-
-```ts
-import { onInitExtension } from './onInitExtension' // example file
-
-config.onInit = async payload => {
-  if (incomingConfig.onInit) await incomingConfig.onInit(payload)
-  // Add additional onInit code by defining an onInitExtension function
-  onInitExtension(pluginOptions, payload)
-}
+```jsx
+plugins: [
+  aiTranslatorPlugin({
+    enabled: true,
+    stringTranslation: {
+      enabled: true
+    }
+    collections: {
+      examples: {
+        access: () => true,
+      }
+    }
+  }),
+],
 ```
 
-If you wish to add to the onInit, you must include the async/await. We don’t use spread syntax in this case, instead you must await the existing onInit before running additional functionality.
 
-In the template, we have stubbed out a basic `onInitExtension` file that you can use, if not needed feel free to delete it.
+### Planned features 🧭
 
-##### File Aliasing
+- generate image alt text from GPT
+- generate SEO Text
+- generate structured content
+- custom access control
+- custom overrides for translation
+- generate images based on input
+- generate Open Graph based on content
 
-If your plugin uses packages or dependencies that are not browser compatible (fs, stripe, nodemailer, etc), you will need to alias them using your bundler to prevent getting errors in build.
+#### Use in hooks
 
-You can read more about aliasing files with Webpack or Vite in the [excluding server modules](https://payloadcms.com/docs/admin/excluding-server-code#aliasing-server-only-modules) docs.
+TODO: add documentation
 
-##### Types.ts
+myCollectionPrompt = ({source}) => {
 
-If your plugin has options, you should define and provide types for these options in a separate file which gets exported from the main index.ts.
+  source()
 
-```ts
-export interface PluginTypes {
-  /**
-   * Enable or disable plugin
-   * @default false
-   */
-  enabled?: boolean
+  return 
 }
-```
-
-If possible, include JSDoc comments to describe the options and their types. This allows a developer to see details about the options in their editor.
-
-##### Testing
-
-Having a test suite for your plugin is essential to ensure quality and stability. Jest is a popular testing framework, widely used for testing JavaScript and particularly for applications built with React.
-
-Jest organizes tests into test suites and cases. We recommend creating individual tests based on the expected behavior of your plugin from start to finish.
-
-Writing tests with Jest is very straightforward and you can learn more about how it works in the [Jest documentation.](https://jestjs.io/)
-
-For this template, we stubbed out `plugin.spec.ts` in the `dev` folder where you can write your tests.
-
-```ts
-describe('Plugin tests', () => {
-  // Create tests to ensure expected behavior from the plugin
-  it('some condition that must be met', () => {
-   // Write your test logic here
-   expect(...)
-  })
-})
-```
-
-## Best practices
-
-With this tutorial and the `payload-plugin-template`, you should have everything you need to start building your own plugin.
-In addition to the setup, here are other best practices aim we follow:
-
-* **Providing an enable / disable option:** For a better user experience, provide a way to disable the plugin without uninstalling it. This is especially important if your plugin adds additional webpack aliases, this will allow you to still let the webpack run to prevent errors.
-* **Include tests in your GitHub CI workflow**: If you’ve configured tests for your package, integrate them into your workflow to run the tests each time you commit to the plugin repository. Learn more about [how to configure tests into your GitHub CI workflow.](https://docs.github.com/en/actions/automating-builds-and-tests/building-and-testing-nodejs)
-* **Publish your finished plugin to NPM**: The best way to share and allow others to use your plugin once it is complete is to publish an NPM package. This process is straightforward and well documented, find out more [creating and publishing a NPM package here.](https://docs.npmjs.com/creating-and-publishing-scoped-public-packages/).
-* **Add payload-plugin topic tag**: Apply the tag **payload-plugin **to your GitHub repository. This will boost the visibility of your plugin and ensure it gets listed with [existing payload plugins](https://github.com/topics/payload-plugin).
-* **Use [Semantic Versioning](https://semver.org/) (SemVar)** - With the SemVar system you release version numbers that reflect the nature of changes (major, minor, patch). Ensure all major versions reference their Payload compatibility.
-
-# Questions
-Please contact [Payload](mailto:dev@payloadcms.com) with any questions about using this plugin template.

package/dev/src/collections/Examples.ts

@@ -7,6 +7,9 @@ const Examples: CollectionConfig = {
   admin: {
     useAsTitle: 'title',
   },
+  access: {
+    update: () => false,
+  },
   fields: [
     {
       name: 'title',

package/dev/src/payload.config.ts

@@ -89,6 +89,23 @@ export default buildConfig({
         'examples-with-versions': {
           fields: ['title', 'longText', 'jsonContent'],
         },
+        translations: {
+          settings: {
+            model: 'gpt-4',
+            promptFunc: ({ messages, namespace }) => {
+              console.log('promptFunc', messages, namespace)
+
+              return [
+                {
+                  role: 'system',
+                  content:
+                    'Important: Add a smily face at the end of the message to make the AI more friendly. 😊',
+                },
+                ...messages,
+              ]
+            },
+          },
+        },
       },
     }),
     seo({

package/dev/src/server.ts

@@ -21,8 +21,6 @@ export const start = async (args?: Partial<InitOptions>) => {
     ...(args || {}),
   })
 
-  // Add your own express routes here
-
   app.listen(3000)
 }
 

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "payload-ai",
-  "version": "0.0.53",
+  "version": "0.0.67",
   "homepage:": "https://polyxo.de",
   "repository": "git@github.com:payloadcms/payload-plugin-template.git",
   "description": "Payload AI tools",
@@ -49,6 +49,7 @@
   },
   "dependencies": {
     "@faceless-ui/modal": "2.0.1",
+    "iso-639-1": "^3.1.2",
     "openai": "^4.24.1",
     "webpack": "^5.89.0"
   }

package/src/access/validateAccess.ts

@@ -0,0 +1,13 @@
+import type { Access } from 'payload/config'
+
+export const validateAccess = (req: any, res: any, pluginOptions: any) => {
+  const collectionOptions = pluginOptions.collections[req.collection.config.slug]
+
+  const accessControl = collectionOptions.access || req.collection.config.access.update
+  const access = accessControl({ req })
+
+  if (!access) {
+    res.status(403).send({ error: 'not allowed' })
+  }
+  return access
+}

package/src/aiTranslate.ts

@@ -4,10 +4,16 @@ import { deepCompareTranslateAndMerge } from './deepCompareAndMerge'
 
 const aiTranslateHook =
   (
-    { collectionOptions, collection }: { collectionOptions: any; collection: object },
+    {
+      collectionOptions,
+      collection,
+      pluginOptions,
+    }: { collectionOptions: any; collection: object; pluginOptions: any },
     fallback?: string,
   ): CollectionAfterChangeHook =>
   async ({ doc, req, previousDoc, context, collection }) => {
+    const settings = pluginOptions.collections?.[collection.slug]?.settings
+
     return await translateCollection({
       doc,
       req,
@@ -15,6 +21,7 @@ const aiTranslateHook =
       context,
       collection,
       collectionOptions,
+      settings,
     })
   }
 
@@ -30,22 +37,23 @@ export async function translateCollection({
   onlyMissing,
   codes,
   settings,
+  sourceLanguage,
 }: any) {
-  if (
-    context.triggerAfterChange === false ||
-    req.locale !== req.payload.config.localization.defaultLocale
-  )
-    return
+  const sourceLanguageI =
+    sourceLanguage || doc.sourceLanguage || req.payload.config.localization.defaultLocale
+
+  console.log('Translate', req.locale, sourceLanguageI)
+  if (context.triggerAfterChange === false || req.locale !== sourceLanguageI) return
 
   const localCodes: string[] = req.payload.config.localization.localeCodes
 
   const translationPromises = localCodes
     .filter(
       targetLanguage =>
-        targetLanguage !== req.payload.config.localization.defaultLocale &&
-        (!codes || codes.includes(targetLanguage)),
+        targetLanguage !== sourceLanguageI && (!codes || codes.includes(targetLanguage)),
     )
     .map(async (tL: string) => {
+      console.log('tL', tL, doc)
       const targetDoc = await req.payload.findByID({
         collection: collection.slug,
         id: doc.id,
@@ -63,8 +71,8 @@ export async function translateCollection({
         tL,
         previousDoc.id ? 'update' : 'create',
         onlyMissing,
-        req.payload.config.localization.defaultLocale,
-        settings,
+        sourceLanguageI,
+        { ...settings, namespace: doc?.namespace },
       )
 
       const { id, _status, updatedAt, createdAt, publishedDate, ...dataNew } =

package/src/components/Translator/index.tsx

@@ -61,17 +61,21 @@ export const Translator: React.FC = () => {
     }
     setIsLoading(true)
     try {
-      const response = await fetch(`/api/${documentInfo.collection.slug}/translate`, {
-        method: 'POST',
-        headers: {
-          'Content-Type': 'application/json',
+      const response = await fetch(
+        `/api/${documentInfo.collection.slug}/translate?locale=${locale.code}`,
+        {
+          method: 'POST',
+          headers: {
+            'Content-Type': 'application/json',
+          },
+          body: JSON.stringify({
+            id: documentInfo.id,
+            locale: locale.code,
+            codes,
+            settings,
+          }),
         },
-        body: JSON.stringify({
-          id: documentInfo.id,
-          codes,
-          settings,
-        }),
-      })
+      )
 
       const translatedValues = await response.json()
 
@@ -107,7 +111,12 @@ export const Translator: React.FC = () => {
       value: 'gpt-3.5-turbo-1106',
     },
     {
-      label: 'GPT-4',
+      label: 'GPT-4 Turbo (Preview)',
+      value: 'gpt-4-turbo-preview',
+    },
+
+    {
+      label: 'GPT-4 (most expensive)',
       value: 'gpt-4',
     },
   ]
@@ -133,6 +142,7 @@ export const Translator: React.FC = () => {
                 options={options}
               />
             </div>
+            <div>Translates from: {locale.code}</div>
             <div className={`${baseClass}__translation-buttons`}>
               <Button disabled={isLoading} onClick={() => translate({})}>
                 <span>Translate content to all languages</span>