@rmdes/indiekit-endpoint-posts 1.0.0-beta.27 → 1.0.0-beta.29

package/README.md

@@ -1,24 +1,38 @@
 # @rmdes/indiekit-endpoint-posts
 
-Post management endpoint for Indiekit. View posts published by your Micropub endpoint and publish new posts to it.
+Post management endpoint for Indiekit. View, create, edit, and delete posts published through your Micropub endpoint.
 
 ## Fork Notice
 
-This is a fork of `@indiekit/endpoint-posts` with a critical bug fix for the syndication form.
+This is a **fork** of `@indiekit/endpoint-posts` with three critical bug fixes:
 
-### Bug Fixed
+### 1. Syndication Form Bug Fix (CRITICAL)
 
-The syndicate form button was using `data.url` for the `source_url` value, but `data` is never defined in the template context (the controller sets `properties`, not `data`). This caused the wrong post to be syndicated when clicking the "Syndicate" button.
+The syndicate button was using `data.url` for the `source_url` value, but `data` is never defined in the template context. The controller passes `properties`, not `data`. This caused syndication to fail or syndicate the wrong post.
+
+**Fixed:** Changed `value: data.url` to `value: properties.url` in `includes/@indiekit-endpoint-posts-syndicate.njk`
 
 **PR submitted upstream:** https://github.com/getindiekit/indiekit/pull/828
 
+### 2. MongoDB Query Performance Fix
+
+The original `getPostProperties()` function queried the Micropub endpoint without any filter (`q=source`), fetching only the first 40 posts and searching through them client-side. **This made posts older than 40 items completely inaccessible**, causing 404 errors when trying to view or edit them.
+
+**Fixed:** Now queries the MongoDB database directly by `_id`, which is efficient and works regardless of how many posts exist.
+
+### 3. BSON Version Conflict Fix
+
+Using `ObjectId` from the MongoDB driver caused BSON version conflicts between Indiekit's MongoDB version and plugin dependencies, resulting in runtime errors.
+
+**Fixed:** Use aggregation pipeline with `$toString` to compare `_id` as string, avoiding the need to import `ObjectId`.
+
 ## Installation
 
 ```bash
 npm install @rmdes/indiekit-endpoint-posts
 ```
 
-### Using npm overrides (recommended)
+### Using npm Overrides (Recommended)
 
 Add to your `package.json`:
 
@@ -30,7 +44,36 @@ Add to your `package.json`:
 }
 ```
 
-This replaces the upstream package with this fork without changing your plugin configuration.
+This replaces the upstream package with this fork automatically, without changing your plugin configuration.
+
+## Usage
+
+```javascript
+import PostsEndpoint from "@rmdes/indiekit-endpoint-posts";
+
+export default {
+  plugins: [
+    new PostsEndpoint({
+      mountPath: "/posts",  // Optional, default: "/posts"
+    }),
+  ],
+};
+```
+
+## Features
+
+- **List posts** with cursor-based pagination
+- **View post details** with status badges and syndication info
+- **Create posts** with dynamic forms based on post type
+- **Edit posts** with all properties and advanced options
+- **Delete/undelete posts** with confirmation
+- **Syndicate posts** to configured targets via button
+- **Multi-language support** (14 languages)
+- **Draft mode** for unpublished posts
+- **Media uploads** (audio, photo, video)
+- **Scheduled publishing** with timezone support
+- **Multi-channel publishing** (if configured)
+- **Geographic coordinates** (ISO 6709 format)
 
 ## Options
 
@@ -38,6 +81,28 @@ This replaces the upstream package with this fork without changing your plugin c
 | :---------- | :------- | :-------------------------------------------------------------- |
 | `mountPath` | `string` | Path to management interface. _Optional_, defaults to `/posts`. |
 
+## Differences from Upstream
+
+1. **Syndicate form uses correct variable** (`properties.url` instead of `data.url`)
+2. **Posts are queried directly from MongoDB** (not via Micropub endpoint)
+3. **No BSON version dependency** (uses aggregation with string comparison)
+
+## Related Plugins
+
+- **`@rmdes/indiekit-endpoint-micropub`**: Posts are created/updated/deleted via Micropub
+- **`@rmdes/indiekit-endpoint-syndicate`**: Receives syndicate button POSTs
+- **Post type plugins**: Define fields and validation for each post type (note, article, etc.)
+
+## Documentation
+
+See [CLAUDE.md](./CLAUDE.md) for comprehensive technical reference, including:
+- Complete architecture overview
+- File-by-file documentation
+- Data flow diagrams
+- Configuration examples
+- Inter-plugin relationships
+- Known gotchas and workarounds
+
 ## License
 
-MIT - Original work by Paul Robert Lloyd, bug fix by Ricardo Mendes.
+MIT - Original work by Paul Robert Lloyd, bug fixes by Ricardo Mendes.

package/lib/controllers/posts.js

@@ -2,75 +2,105 @@ import path from "node:path";
 
 import { checkScope } from "@indiekit/endpoint-micropub/lib/scope.js";
 import { excerpt } from "@indiekit/util";
-import { mf2tojf2 } from "@paulrobertlloyd/mf2tojf2";
 
-import { endpoint } from "../endpoint.js";
 import { statusTypes } from "../status-types.js";
-import { getPostStatusBadges, getPostName, getPhotoUrl } from "../utils.js";
+import {
+  getPosts,
+  getPostTypeCounts,
+  getPostStatusBadges,
+  getPostName,
+  getPhotoUrl,
+} from "../utils.js";
 
 /**
- * List published posts
+ * Build query string fragment for preserving filters in pagination/links
+ * @param {object} params - Current filter state
+ * @returns {string} Query string fragment (e.g. "&type=note&sort=oldest")
+ */
+function buildFilterQuery({ type, status, search, sort }) {
+  const params = new URLSearchParams();
+  if (type && type !== "all") params.set("type", type);
+  if (status && status !== "published") params.set("status", status);
+  if (search) params.set("search", search);
+  if (sort && sort !== "newest") params.set("sort", sort);
+  const str = params.toString();
+  return str ? `&${str}` : "";
+}
+
+/**
+ * List posts with filtering, search, sort, and pagination
  * @type {import("express").RequestHandler}
  */
 export const postsController = async (request, response, next) => {
   try {
     const { application, publication } = request.app.locals;
-    const { access_token, scope } = request.session;
-    const { after, before, success } = request.query;
-    const limit = Number(request.query.limit) || 12;
-
-    const micropubUrl = new URL(application.micropubEndpoint);
-    micropubUrl.searchParams.append("q", "source");
-    micropubUrl.searchParams.append("limit", String(limit));
+    const { scope } = request.session;
 
-    if (after) {
-      micropubUrl.searchParams.append("after", String(after));
-    }
-
-    if (before) {
-      micropubUrl.searchParams.append("before", String(before));
-    }
+    // Extract filter/search/sort/pagination from query string
+    const postType = request.query.type || "all";
+    const status = request.query.status || "published";
+    const search = request.query.search || "";
+    const sort = request.query.sort || "newest";
+    const page = Number(request.query.page) || 0;
+    const limit = Number(request.query.limit) || 20;
+    const success = request.query.success;
 
-    const micropubResponse = await endpoint.get(micropubUrl.href, access_token);
+    // Build query options (only include non-default values)
+    const queryOptions = { page, limit, sort };
+    if (postType !== "all") queryOptions.postType = postType;
+    if (status !== "published") queryOptions.status = status;
+    if (search) queryOptions.search = search;
 
-    let posts;
-    if (micropubResponse?.items?.length > 0) {
-      const jf2 = mf2tojf2(micropubResponse);
-      const items = jf2.children || [jf2];
+    // Query MongoDB directly
+    const { items, total } = await getPosts(application, queryOptions);
+    const typeCounts = await getPostTypeCounts(application);
 
-      posts = items.map((item) => {
-        item.id = item.uid;
-        item.icon = item["post-type"];
-        item.locale = application.locale;
-        item.photo = getPhotoUrl(publication, item);
-        item.description = {
-          text:
-            item.summary ||
-            (item.content?.text &&
-              excerpt(item.content.text, 30, publication.locale)),
-        };
-        item.title = getPostName(publication, item);
-        item.url = path.join(request.baseUrl, request.path, item.uid);
-        item.badges = getPostStatusBadges(item, response);
+    // Map items to card format
+    const posts = items.map((postData) => {
+      const item = { ...postData.properties, uid: postData._id.toString() };
+      item.id = item.uid;
+      item.icon = item["post-type"];
+      item.locale = application.locale;
+      item.photo = getPhotoUrl(publication, item);
+      item.description = {
+        text:
+          item.summary ||
+          (item.content?.text &&
+            excerpt(item.content.text, 30, publication.locale)),
+      };
+      item.title = getPostName(publication, item);
+      item.url = path.join(request.baseUrl, request.path, item.uid);
+      item.badges = getPostStatusBadges(item, response);
+      return item;
+    });
 
-        return item;
-      });
-    }
+    // Build filter query string for pagination links
+    const filterQuery = buildFilterQuery({
+      type: postType,
+      status,
+      search,
+      sort,
+    });
 
+    // Offset-based pagination
+    const totalPages = Math.ceil(total / limit);
     const cursor = {};
-
-    if (micropubResponse?.paging?.after) {
-      cursor.next = {
-        href: `?after=${micropubResponse.paging.after}`,
-      };
+    if (page < totalPages - 1) {
+      cursor.next = { href: `?page=${page + 1}${filterQuery}` };
     }
-
-    if (micropubResponse?.paging?.before) {
-      cursor.previous = {
-        href: `?before=${micropubResponse.paging.before}`,
-      };
+    if (page > 0) {
+      cursor.previous = { href: `?page=${page - 1}${filterQuery}` };
     }
 
+    // Available post types from publication config with counts
+    const postTypes = Object.entries(publication.postTypes).map(
+      ([id, config]) => ({
+        id,
+        name: config.name,
+        count: typeCounts.find((t) => t._id === id)?.count || 0,
+      }),
+    );
+
     response.render("posts", {
       title: response.locals.__("posts.posts.title"),
       actions: [
@@ -84,8 +114,9 @@ export const postsController = async (request, response, next) => {
       ],
       cursor,
       posts,
-      limit,
-      count: micropubResponse._count,
+      total,
+      filters: { postType, status, search, sort },
+      postTypes,
       parentUrl: request.baseUrl + request.path,
       statusTypes,
       success,

package/lib/utils.js

@@ -3,7 +3,6 @@ import { Buffer } from "node:buffer";
 import { sanitise, ISO_6709_RE } from "@indiekit/util";
 import { mf2tojf2 } from "@paulrobertlloyd/mf2tojf2";
 import formatcoords from "formatcoords";
-import { ObjectId } from "mongodb";
 
 import { endpoint } from "./endpoint.js";
 import { statusTypes } from "./status-types.js";
@@ -160,10 +159,19 @@ export const getPostProperties = async (uid, application) => {
       return false;
     }
 
-    // Query directly by MongoDB _id
-    const postData = await postsCollection.findOne({
-      _id: new ObjectId(uid),
-    });
+    // Query using aggregation to match _id as string (avoids BSON version issues)
+    const results = await postsCollection
+      .aggregate([
+        {
+          $match: {
+            $expr: { $eq: [{ $toString: "$_id" }, uid] },
+          },
+        },
+        { $limit: 1 },
+      ])
+      .toArray();
+
+    const postData = results[0];
 
     if (!postData?.properties) {
       return false;
@@ -181,6 +189,94 @@ export const getPostProperties = async (uid, application) => {
   }
 };
 
+/**
+ * Query posts collection with filters, search, sort, and pagination
+ * @param {object} application - Application config (has collections Map)
+ * @param {object} options - Query options
+ * @param {string} [options.postType] - Filter by post-type (e.g. "note", "article")
+ * @param {string} [options.status] - Filter by post-status ("published", "draft", "deleted")
+ * @param {string} [options.search] - Text search (regex on name/content.text)
+ * @param {string} [options.sort] - Sort direction ("newest" or "oldest")
+ * @param {number} [options.page] - Page number (0-indexed)
+ * @param {number} [options.limit] - Items per page
+ * @returns {Promise<{items: Array, total: number}>}
+ */
+export const getPosts = async (application, options = {}) => {
+  const { postType, status, search, sort = "newest", page = 0, limit = 20 } =
+    options;
+
+  const postsCollection = application?.collections?.get("posts");
+  if (!postsCollection) {
+    return { items: [], total: 0 };
+  }
+
+  // Build MongoDB filter
+  const filter = {};
+
+  if (postType) {
+    filter["properties.post-type"] = postType;
+  }
+
+  if (status === "draft") {
+    filter["properties.post-status"] = "draft";
+  } else if (status === "deleted") {
+    filter["properties.deleted"] = true;
+  } else if (status === "all") {
+    // No status filter — show everything
+  } else {
+    // Default: "published" — exclude drafts and deleted
+    filter["properties.post-status"] = { $ne: "draft" };
+    filter["properties.deleted"] = { $ne: true };
+  }
+
+  if (search) {
+    // Escape regex special characters in search term
+    const escaped = search.replace(/[.*+?^${}()|[\]\\]/g, "\\$&");
+    filter.$or = [
+      { "properties.name": { $regex: escaped, $options: "i" } },
+      { "properties.content.text": { $regex: escaped, $options: "i" } },
+    ];
+  }
+
+  const sortDirection = sort === "oldest" ? 1 : -1;
+
+  const [items, total] = await Promise.all([
+    postsCollection
+      .find(filter)
+      .sort({ "properties.published": sortDirection })
+      .skip(page * limit)
+      .limit(limit)
+      .toArray(),
+    postsCollection.countDocuments(filter),
+  ]);
+
+  return { items, total };
+};
+
+/**
+ * Get post counts grouped by post-type
+ * @param {object} application - Application config
+ * @returns {Promise<Array<{_id: string, count: number}>>}
+ */
+export const getPostTypeCounts = async (application) => {
+  const postsCollection = application?.collections?.get("posts");
+  if (!postsCollection) {
+    return [];
+  }
+
+  return postsCollection
+    .aggregate([
+      {
+        $group: {
+          _id: "$properties.post-type",
+          count: { $sum: 1 },
+        },
+      },
+      { $sort: { count: -1 } },
+    ])
+    .toArray();
+};
+
 /**
  * Get post URL from ID
  * @param {string} id - ID

package/locales/en.json

@@ -119,9 +119,24 @@
       "syndicate": "Syndicate post"
     },
     "posts": {
-      "title": "Published posts",
+      "title": "Posts",
       "none": "No posts"
     },
+    "filter": {
+      "type": "Type",
+      "status": "Status",
+      "all": "All",
+      "status_published": "Published",
+      "status_draft": "Drafts",
+      "status_deleted": "Deleted",
+      "status_all": "All",
+      "searchPlaceholder": "Search posts\u2026",
+      "searchButton": "Search",
+      "clear": "Clear",
+      "newest": "Newest",
+      "oldest": "Oldest",
+      "results": "posts"
+    },
     "title": "Posts"
   }
 }

package/package.json

@@ -1,6 +1,6 @@
 {
   "name": "@rmdes/indiekit-endpoint-posts",
-  "version": "1.0.0-beta.27",
+  "version": "1.0.0-beta.29",
   "description": "Post management endpoint for Indiekit with syndicate form fix. View posts published by your Micropub endpoint and publish new posts to it.",
   "keywords": [
     "indiekit",
@@ -47,8 +47,7 @@
     "@paulrobertlloyd/mf2tojf2": "^3.0.0",
     "express": "^5.0.0",
     "express-validator": "^7.0.0",
-    "formatcoords": "^1.1.3",
-    "mongodb": "^6.0.0"
+    "formatcoords": "^1.1.3"
   },
   "publishConfig": {
     "access": "public"

package/views/posts.njk

@@ -1,6 +1,119 @@
 {% extends "document.njk" %}
 
 {% block content %}
+  <style>
+    .posts-filter-row {
+      display: flex;
+      flex-wrap: wrap;
+      gap: var(--space-xs, 0.5rem);
+      align-items: center;
+      margin-block-end: var(--space-s, 0.75rem);
+    }
+    .posts-filter-label {
+      font: var(--font-body, 0.875rem/1.5 sans-serif);
+      color: var(--color-on-offset, #666);
+    }
+    .posts-filter-pills {
+      display: flex;
+      flex-wrap: wrap;
+      gap: 0.25rem;
+    }
+    .posts-filter-pills a {
+      text-decoration: none;
+      padding: 0.25rem 0.75rem;
+      border-radius: 1rem;
+      font-size: 0.875rem;
+      color: var(--color-on-offset, #666);
+      background: var(--color-offset, #f0f0f0);
+    }
+    .posts-filter-pills a.active {
+      background: var(--color-primary, #0066cc);
+      color: var(--color-on-primary, #fff);
+    }
+    .posts-filter-pills .count {
+      font-size: 0.75rem;
+      opacity: 0.7;
+    }
+    .posts-search {
+      display: flex;
+      gap: var(--space-xs, 0.5rem);
+      align-items: center;
+    }
+    .posts-search input[type="search"] {
+      padding: 0.25rem 0.5rem;
+      border: 1px solid var(--color-border, #ccc);
+      border-radius: var(--border-radius-small, 0.25rem);
+      font: inherit;
+    }
+    .posts-meta {
+      font-size: 0.875rem;
+      color: var(--color-on-offset, #666);
+      margin-block-end: var(--space-s, 0.75rem);
+    }
+  </style>
+
+  <div class="posts-filters">
+    {# Row 1: Post type pills #}
+    <div class="posts-filter-row">
+      <span class="posts-filter-label">{{ __("posts.filter.type") }}:</span>
+      <div class="posts-filter-pills">
+        <a href="?status={{ filters.status }}{% if filters.search %}&search={{ filters.search }}{% endif %}&sort={{ filters.sort }}"
+           class="{% if filters.postType == 'all' %}active{% endif %}">
+          {{ __("posts.filter.all") }}
+        </a>
+        {% for pt in postTypes %}
+          {% if pt.count > 0 %}
+          <a href="?type={{ pt.id }}&status={{ filters.status }}{% if filters.search %}&search={{ filters.search }}{% endif %}&sort={{ filters.sort }}"
+             class="{% if filters.postType == pt.id %}active{% endif %}">
+            {{ pt.name }} <span class="count">({{ pt.count }})</span>
+          </a>
+          {% endif %}
+        {% endfor %}
+      </div>
+    </div>
+
+    {# Row 2: Status pills #}
+    <div class="posts-filter-row">
+      <span class="posts-filter-label">{{ __("posts.filter.status") }}:</span>
+      <div class="posts-filter-pills">
+        {% for s in ["published", "draft", "deleted", "all"] %}
+          <a href="?{% if filters.postType != 'all' %}type={{ filters.postType }}&{% endif %}status={{ s }}{% if filters.search %}&search={{ filters.search }}{% endif %}&sort={{ filters.sort }}"
+             class="{% if filters.status == s %}active{% endif %}">
+            {{ __("posts.filter.status_" + s) }}
+          </a>
+        {% endfor %}
+      </div>
+    </div>
+
+    {# Row 3: Search + Sort #}
+    <div class="posts-filter-row" style="justify-content: space-between;">
+      <form class="posts-search" method="get" action="">
+        {% if filters.postType != "all" %}<input type="hidden" name="type" value="{{ filters.postType }}">{% endif %}
+        {% if filters.status != "published" %}<input type="hidden" name="status" value="{{ filters.status }}">{% endif %}
+        <input type="hidden" name="sort" value="{{ filters.sort }}">
+        <input type="search" name="search" value="{{ filters.search }}" placeholder="{{ __('posts.filter.searchPlaceholder') }}">
+        <button type="submit" class="button button--small">{{ __("posts.filter.searchButton") }}</button>
+        {% if filters.search %}
+          <a href="?{% if filters.postType != 'all' %}type={{ filters.postType }}&{% endif %}status={{ filters.status }}&sort={{ filters.sort }}">{{ __("posts.filter.clear") }}</a>
+        {% endif %}
+      </form>
+      <div class="posts-filter-pills">
+        <a href="?{% if filters.postType != 'all' %}type={{ filters.postType }}&{% endif %}status={{ filters.status }}{% if filters.search %}&search={{ filters.search }}{% endif %}&sort=newest"
+           class="{% if filters.sort == 'newest' %}active{% endif %}">{{ __("posts.filter.newest") }}</a>
+        <a href="?{% if filters.postType != 'all' %}type={{ filters.postType }}&{% endif %}status={{ filters.status }}{% if filters.search %}&search={{ filters.search }}{% endif %}&sort=oldest"
+           class="{% if filters.sort == 'oldest' %}active{% endif %}">{{ __("posts.filter.oldest") }}</a>
+      </div>
+    </div>
+  </div>
+
+  {# Results meta #}
+  {% if total %}
+  <div class="posts-meta">
+    <span>{{ total }} {{ __("posts.filter.results") }}{% if filters.search %} for "{{ filters.search }}"{% endif %}</span>
+  </div>
+  {% endif %}
+
+  {# Post grid #}
   {%- if posts.length > 0 %}
   {{ cardGrid({
     cardSize: "16rem",
@@ -10,4 +123,4 @@
   {%- else -%}
   {{ prose({ text: __("posts.posts.none") }) }}
   {%- endif %}
-{% endblock %}
+{% endblock %}