node-red-contrib-ccu 4.6.1 → 4.7.0

package/CHANGELOG.md

@@ -5,6 +5,70 @@ Notable changes to node-red-contrib-ccu. Format follows
 user-visible symptom and the cause, not the commit list (the release notes
 append commits automatically).
 
+## 4.7.0 (2026-10-27)
+
+### Added
+
+- **On openccu-lite the interfaces are reached through the system's lite-rpc**
+  (with [occulite-client](https://www.npmjs.com/package/occulite-client))
+  instead of XML-RPC/BIN-RPC clients and callback servers of this node's own -
+  the requests over the system's web port, the events from a stream the
+  connection opens, replayed after a break and re-read after a restart of the
+  system; one subscriber at the interface processes serves every program on
+  the system, and nothing registers with `init`. The credential is the
+  openccu-lite token of the connection node, or on the system itself
+  RedMatic's own token, which the system mints for it. A new setting
+  _openccu-lite interfaces_ in the connection node chooses: _auto_ (the
+  default; the CCU way on a CCU), _openccu-lite_ (lite-rpc only) or _CCU_ (the
+  direct connection with callbacks, on openccu-lite too). An existing
+  connection is moved to lite-rpc once, at its first start on openccu-lite,
+  and the log says so; a choice made in the node is never changed by a later
+  version. The value cache is filled from the system's state store at deploy,
+  so nodes with _cache_ get a value on openccu-lite as well. CUxD and CCU-Jack
+  keep their own connections. On a CCU, RaspberryMatic and OpenCCU nothing
+  changes.
+
+### Changed
+
+- **An interface process that is not up yet is tried every 3 s for the first
+  90 s, then every 15 s.** The 1, 2, 4, 8 s steps and the 15 s after them
+  missed hmipserver's ready moment on a booting system by up to 15 s (measured
+  on an openccu-lite Pi 4: hmipserver answers 50-55 s after the boot, the next
+  attempt came at 61 s). The same holds after a process went away. When one
+  interface appears, the others still waiting are tried at once, and the log
+  line that reports the connection says how long after the start (or after the
+  outage) it came. The metadata API's re-detection on openccu-lite follows the
+  same schedule.
+- **The port of each interface can be set in the connection node**, beside its
+  checkbox: blank is the CCU's port for the transport as before (2001/42001 and
+  so on, the 3xxxx ports on the CCU itself), a number replaces it - for a CCU
+  behind port forwarding, or a simulator on another port.
+- The test suite runs hm-simulator 1.4 on free ports, so it runs beside a CCU
+  or another suite, and drives the simulator's scenario API: devices paired
+  and removed while Node-RED runs, a ramp-time write, a service message, an
+  interface process that restarts and forgets its clients, TLS with basic
+  auth.
+- **On openccu-lite the metadata stream reports as `Metadata`, not as
+  "Interface ReGaHSS".** The system has no ReGaHSS; the connection borrowed
+  that slot for the stream's state, so the log said "Interface ReGaHSS
+  connected" at every start and reconnect, right next to "this box has no
+  ReGaHSS". The log now says "Metadata stream connected", the nodes' status
+  counts the stream under that name, and the editors' interface lists do not
+  offer it.
+
+## 4.6.2 (2026-10-23)
+
+### Fixed
+
+- **One event a few times a day was lost on the way from hmipserver, which
+  logged a `RpcIOException … Connection reset` for it.** hmipserver delivers
+  its events through a pooled HTTP keep-alive client whose idle timeout is
+  1200 s and sends the next event on a pooled connection without checking it;
+  the XML-RPC callback server closed an idle connection after Node's default
+  5 s, so at the idle boundary the event went out onto a socket this side was
+  closing. The callback server now keeps an idle connection open for 1300 s,
+  longer than the client pool does, so it is always the client that lets go.
+
 ## 4.6.1 (2026-10-22)
 
 ### Fixed
@@ -13,9 +77,8 @@ append commits automatically).
   maintenance channel's `STICKY_UNREACH`** went out as a `switch` with
   `device_class: problem`, a class only `binary_sensor` knows, and Home
   Assistant refused that component ("expected SwitchDeviceClass or one of
-  'outlet', 'switch'") while it created the device and its other entities
-  (B-39). `STICKY_UNREACH` is no longer announced at all - the maintainer's
-  decision: "UNREACH is enough" -, and a device class a platform does not
+  'outlet', 'switch'") while it created the device and its other entities. `STICKY_UNREACH` is no longer announced at all
+  (UNREACH covers it), and a device class a platform does not
   accept is dropped from any component before it goes out. A test now checks
   every component of every device the shipped paramsets know against Home
   Assistant's device classes per platform.
@@ -44,7 +107,7 @@ append commits automatically).
 ### Fixed
 
 - **Home Assistant showed every entity of a device as "unavailable" for
-  good** (B-38, reported by mail). The discovery configs name the device's
+  good** (reported by mail). The discovery configs name the device's
   `…:0/UNREACH` topic as its availability, and Home Assistant treats an
   entity as unavailable until that topic delivers a value. Only `ccu-mqtt`
   published UNREACH: when it changed, or once in its start-up burst of
@@ -64,8 +127,7 @@ append commits automatically).
 
 ### Fixed
 
-- **No HmIP-RF events for up to 10 minutes after hmipserver restarted**
-  (B-37). hmipserver keeps its subscribers over a restart: it calls
+- **No HmIP-RF events for up to 10 minutes after hmipserver restarted**. hmipserver keeps its subscribers over a restart: it calls
   `listDevices` and `newDevices` on them and answers their pings, but
   delivers no event to such a kept subscription until it is subscribed
   afresh. The liveness ping saw its PONG and was content, so the
@@ -80,7 +142,7 @@ append commits automatically).
 ### Fixed
 
 - **A burst of `getParamsetDescription Error: XML-RPC fault: Invalid device`
-  at the first start after an update** (B-36). A device deleted from the CCU
+  at the first start after an update**. A device deleted from the CCU
   while Node-RED was not running stayed in the cached device table
   (`ccu_<host>.json`) and in the values cache (`ccu_values_<host>.json`).
   At the start its paramset descriptions were queued from the cached table;
@@ -105,7 +167,7 @@ append commits automatically).
 ### Added
 
 - **TLS and authentication for every connection to a CCU on the network**
-  (task 5, #27). With _TLS/SSL_ on, all XML-RPC interfaces are reached over
+  (#27). With _TLS/SSL_ on, all XML-RPC interfaces are reached over
   the CCU's TLS ports (42000, 42001, 42010, 49292; CCU-Jack 2122), the ReGaHSS
   over 48181 and openccu-lite's metadata api over 443; with _Authentication_
   on, the username and password go out as HTTP basic auth on every call, the
@@ -126,7 +188,7 @@ append commits automatically).
   certificates_, the CCU's self-signed certificate is refused, as before.
 
 - **One topic template in every node that emits, the value node's input
-  takes the emitted shape** (task 6, #39 @psi-4ward). The `get value` node has a _Topic_
+  takes the emitted shape** (#39 @psi-4ward). The `get value` node has a _Topic_
   field now, the same `${…}` template as rpc-event, value, sysvar, program,
   rpc and script; empty (the default, and every existing flow) leaves
   `msg.topic` as it came in. The value node's input accepts a datapoint
@@ -140,7 +202,7 @@ append commits automatically).
   rpc-event, value and get value the placeholders.
 
 - **Help texts for every node in German and English, as locale files**
-  (task 7, #58). The help moved from inline blocks in the node files into
+  (#58). The help moved from inline blocks in the node files into
   `nodes/locales/de/` and `nodes/locales/en-US/`, the layout Node-RED
   documents for node help: the runtime serves one language's text per
   request through the same lookup as its own nodes (`de` and `de-DE` both
@@ -158,7 +220,7 @@ append commits automatically).
 ### Fixed
 
 - **Writing one party-mode datapoint of an HmIP thermostat reset the other
-  two** (task 2, #156 @ben-5555, #161 @lolli78). An HmIP eTRV/WTH takes
+  two** (#156 @ben-5555, #161 @lolli78). An HmIP eTRV/WTH takes
   `PARTY_TIME_START`, `PARTY_TIME_END` and `PARTY_SET_POINT_TEMPERATURE` only
   together: a `setValue` of one of them put the others back to
   `1999_11_30 00:00`, so party or holiday mode could not be set from the
@@ -170,7 +232,7 @@ append commits automatically).
   Date, an ISO string or epoch milliseconds; they are formatted for the device
   in local time. Any other datapoint of the channel is written as before. The
   older HM thermostats (`PARTY_MODE_SUBMIT`) are not covered.
-- **A callback call with an unknown interface id ended Node-RED** (B-32).
+- **A callback call with an unknown interface id ended Node-RED**.
   Anything on the system can connect to the connection's callback ports on
   the loopback; a `system.listMethods` without parameters, an `event` with an
   id that is not one of ours, or a `newDevices` list with a malformed entry
@@ -180,7 +242,7 @@ append commits automatically).
   `system.listMethods`) and logged at debug; a throw inside a handler is
   logged as an error and answered instead of ending the process.
 - **A metadata api detection that timed out at start left the connection in
-  ReGa mode for good** (B-28). On openccu-lite the connection asks
+  ReGa mode for good**. On openccu-lite the connection asks
   `GET /api/meta/v1/version` once at start; when that probe ran into its 5 s
   timeout - on a Raspberry Pi 3 Node-RED's own start blocks the event loop
   long enough for that at every start, on a busy system now and then - the
@@ -191,8 +253,7 @@ append commits automatically).
   the detection is repeated after 1, 2, 4, 8 s and then every 15 s (up to 20
   times, then the five-minute rule again), and the failing ReGa poll asks for
   a re-detection too. A CCU's 404 is still a conclusive "no".
-- **After an hmipserver restart HmIP-RF events stopped for up to ten minutes**
-  (B-29). hmipserver forgets its clients when it restarts and does not tell
+- **After an hmipserver restart HmIP-RF events stopped for up to ten minutes**. hmipserver forgets its clients when it restarts and does not tell
   them: the `init` had succeeded, nothing failed, and the events simply stopped
   until the 600 s silence timeout called `init` again. The connection now
   pings HmIP-RF after 30 s without an event and, when no event (the PONG)
@@ -203,7 +264,7 @@ append commits automatically).
   events are back well within a minute. An interface that never delivered an
   event since its `init` is not re-subscribed on a missing PONG alone.
 - **A queued write of the same set point was dropped after the actuator had
-  been operated by hand** (B-19, #151 @vigeland). The value node's _Queue_ compared the
+  been operated by hand** (#151 @vigeland). The value node's _Queue_ compared the
   new value with the value cache, and the cache of a control channel
   (HmIP-FROLL/BROLL `:4`, the status lives in `:3`) holds the echo of our own
   last write for good - a blind moved by hand reports no new set point there,
@@ -217,7 +278,7 @@ append commits automatically).
 ### Security
 
 - **The CCU password and the openccu-lite token were stored in plain text in
-  `flows.json`** and went out with every exported flow (B-31). Both are
+  `flows.json`** and went out with every exported flow. Both are
   Node-RED credentials now (`flows_cred.json`, encrypted, never exported).
   A flow written before this version still carries them as plain properties:
   the connection uses them once, moves them into the credentials and warns;
@@ -226,8 +287,7 @@ append commits automatically).
 
 ### Changed
 
-- **The device table follows the CCU, and can be re-read by hand** (task 9,
-  #146 @guny74, #181 @vore). A device or channel the CCU reports with another TYPE,
+- **The device table follows the CCU, and can be re-read by hand** (#146 @guny74, #181 @vore). A device or channel the CCU reports with another TYPE,
   VERSION or FIRMWARE than the cache holds replaces the cached entry, leaves
   its old type list and gets its datapoints fetched again - a channel whose
   type changed in place kept its old datapoints before, until the cache file
@@ -237,14 +297,14 @@ append commits automatically).
   reports what changed. The editor's channel pickers no longer empty the
   configured channel when the connection is still initialising: they show
   _loading device data_ and ask again.
-- **An interface without devices is watched too** (task 9, old B-11). The
+- **An interface without devices is watched too**. The
   ping watchdog returned early for an interface with no devices in the
   cache, so such an interface never pinged and never re-initialised after a
   CCU reboot. It pings now, and re-initialises after the ping timeout once
   it has ever delivered an event (a PONG counts) - a process that answers no
   ping at all is not asked to `init` every timeout.
 - **The `listDevices` answer to hmipserver lists the CCU's virtual remote
-  control (HmIP-RCV-1) again** (task 13). It was left out since CCU3 firmware
+  control (HmIP-RCV-1) again**. It was left out since CCU3 firmware
   3.43.15 (2019), whose hmipserver failed on an answer that held it; current
   hmipservers take it, and without it every `init` made hmipserver log a
   _handleIDMigration_ warning and send the whole virtual remote (52
@@ -262,8 +322,7 @@ append commits automatically).
   proxy ports (XML-RPC instead of BIN-RPC for BidCos) until the next restart.
   A loopback host on a system that has the CCU's interface list
   (`/etc/config/InterfacesList.xml`) is now taken as local as well.
-- **Waiting for an interface process that is still starting is no warning**
-  (task 12). Before the interface was ever connected, a refused connection
+- **Waiting for an interface process that is still starting is no warning**. Before the interface was ever connected, a refused connection
   is one info line (_"HmIP-RF not listening yet (connect ECONNREFUSED),
   waiting for it - retrying in 1 s"_); another transport error, or a refused
   connection after the interface had been connected, is still a warning, and
@@ -272,7 +331,7 @@ append commits automatically).
 ### Changed
 
 - **A failed `init` is retried after 1 s, 2 s, 4 s and 8 s, then every 15 s**
-  (task 12; was 2, 4, 8, 16 s, then every 30 s), the schedule of hm2mqtt.js and
+  (was 2, 4, 8, 16 s, then every 30 s), the schedule of hm2mqtt.js and
   the Homematic Manager.
 
 ## 4.4.4 (2026-09-17)
@@ -280,7 +339,7 @@ append commits automatically).
 ### Fixed
 
 - **An interface stayed without events for minutes, or for good, when its
-  process did not answer the first `init`** (task 11). A failed `init` at
+  process did not answer the first `init`**. A failed `init` at
   start (connection refused, timeout) was only retried by the ping
   supervision, which does nothing without cached devices and waits the ping
   timeout otherwise: 60 s, and 600 s for HmIP-RF. A Node-RED that starts
@@ -298,8 +357,7 @@ append commits automatically).
 
 ### Fixed
 
-- **Node-RED at 100 % CPU and unresponsive while ReGaHSS is unreachable**
-  (B-27). binrpc up to 4.2.0 armed a new reconnect timer for both the `error`
+- **Node-RED at 100 % CPU and unresponsive while ReGaHSS is unreachable**. binrpc up to 4.2.0 armed a new reconnect timer for both the `error`
   and the `close` event of every refused connect, so the number of attempts to
   the ReGaHSS port 31999 doubled every 2.5 s without bound: about 7,000 refused
   connects per second, 30,000 pending timers and 68 million connects in under
@@ -317,7 +375,7 @@ append commits automatically).
 ### Fixed
 
 - **`getRegaVariables Error: socket hang up` every few minutes on a CCU**
-  (B-18, [RedMatic #601](https://github.com/rdmtc/RedMatic/issues/601)
+  ([RedMatic #601](https://github.com/rdmtc/RedMatic/issues/601)
   follow-up). Since 4.3.0 a local install talks to ReGaHSS itself on port 8183. ReGaHSS answers HTTP/1.1 without `Connection: close` — and then
   closes the connection 0.4–7 ms after every response (measured on a
   CCU3 3.89.8, median 0.55 ms). `homematic-rega` 2.0 (since 4.0.0) sent
@@ -374,7 +432,7 @@ hang up` — became an **unhandled rejection**, which Node >= 15 turns
 
 ### Added
 
-- **Dynamic node configuration through `msg.config`** (roadmap B-2). Put
+- **Dynamic node configuration through `msg.config`**. Put
   an object in `msg.config` and its properties override that node's own
   configuration for that one message; the stored configuration is never
   modified, so the next message starts from the dialog settings again.
@@ -449,7 +507,6 @@ hang up` — became an **unhandled rejection**, which Node >= 15 turns
   `/etc/lighttpd/conf.d/proxy.conf` for a port number; on current
   firmware that file is a one-line include and the port markers live two
   levels down. It now looks for a listener on the direct port instead.
-  (Roadmap B-4)
 - Writing several system variables at once left all but the first
   invisible until the next scheduled ReGa poll (30 s by default): the
   immediate re-poll each write triggers was dropped while another poll
@@ -481,7 +538,7 @@ hang up` — became an **unhandled rejection**, which Node >= 15 turns
   presence, smoke, water), event (keys), lock (KeyMatic), sensor (energy,
   weather, maintenance) plus, optionally, disabled-by-default entities for
   every other datapoint. Unchecking a device removes it from Home
-  Assistant on the next deploy. (Roadmap B-16)
+  Assistant on the next deploy.
 - ccu-mqtt: the setValue topic accepts Home Assistant's command words —
   `OPEN`, `CLOSE`, `STOP`, `ON`, `OFF` on LEVEL and `AUTO-MODE`,
   `MANU-MODE`, `BOOST-MODE`, `COMFORT-MODE`, `LOWERING-MODE` on the

package/README.md

@@ -36,8 +36,22 @@ BINRPC/XMLRPC works unchanged. Device, channel, room and function names come fro
 ReGaHSS; the connection node detects this at start (`GET /api/meta/v1/version`), nothing has to be configured, and
 `msg.channelName`, `msg.rooms`, `msg.functions` and the room/function filters keep their shape.
 
-- Node-RED **on the system** (RedMatic from its addon catalogue): the system's own read-only token is used, nothing to do.
-- Node-RED **elsewhere**: an API token of the system goes into the connection node's **openccu-lite token** field.
+Since 4.7.0 the interface processes are reached through the system's **lite-rpc** as well, with
+[occulite-client](https://www.npmjs.com/package/occulite-client): the requests over the system's web port, the events
+from a stream the connection opens (replayed after a break, re-read after a restart of the system), one subscriber at
+the processes for every program on the system, no callback server and no `init` of this node's own; the value cache is
+filled from the system's state store at deploy. The connection node's **openccu-lite interfaces** setting chooses
+_auto_ (the default: lite-rpc on openccu-lite, the CCU way on a CCU), _openccu-lite_ (lite-rpc only) or _CCU_ (the
+direct connection with callbacks, on openccu-lite too); an existing connection is moved to lite-rpc once at its first
+start on openccu-lite, the log says so, and a choice made in the node is never changed by a later version. CUxD and
+CCU-Jack keep their own connections.
+
+- Node-RED **on the system** (RedMatic from its addon catalogue): lite-rpc with RedMatic's own token, which the system
+  mints for it from RedMatic's manifest (RedMatic 9.13 or later); the names come with the system's read-only token.
+  Nothing to configure. An older RedMatic has no such token and connects the CCU way, the log says so.
+- Node-RED **elsewhere**: an API token of the system goes into the connection node's **openccu-lite token** field -
+  for lite-rpc it needs the `rpc:*` scope of what the flow does (`rpc:read` for events and reads, `rpc:operate` for
+  `setValue`, `rpc:configure` for paramsets and links, `rpc:admin` for the rest; the rpc node may call anything).
 - **System variables, programs and HM-Script do not exist there.** The `ccu-sysvar`, `ccu-program`, `ccu-script` and
   `ccu-poll` nodes stay in the flows and answer every message with an error.
 

package/nodes/ccu-connection.html

@@ -13,6 +13,12 @@
             cuxdEnabled: {value: false},
             jackEnabled: {value: false},
             jackPort: {value: 2121},
+            regaPort: {value: ''},
+            bcrfPort: {value: ''},
+            bcwiPort: {value: ''},
+            iprfPort: {value: ''},
+            virtPort: {value: ''},
+            cuxdPort: {value: ''},
 
             regaPoll: {value: true},
             regaInterval: {value: 30},
@@ -31,6 +37,7 @@
             username: {value: ''},
 
             metaPort: {value: ''},
+            connectionType: {value: 'auto'},
 
             queueTimeout: {value: 5000, required: true},
             queuePause: {value: 250, required: true},
@@ -223,12 +230,18 @@
     <div class="form-row">
         <label for="node-input-rfdEnabled"><i class="icon-tag"></i> Interfaces</label>
         <div style="width: 70%; display: inline-block; vertical-align: text-top;">
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-regaEnabled"> ReGaHSS</label><br>
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-bcrfEnabled"> BidCos-RF</label><br>
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-bcwiEnabled"> BidCos-Wired</label><br>
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-iprfEnabled"> HmIP-RF</label><br>
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-virtEnabled"> VirtualDevices</label><br>
-            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-cuxdEnabled"> CUxD</label><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-regaEnabled"> ReGaHSS</label>
+            <input type="text" id="node-config-input-regaPort" class="ccu-port" style="width: 70px;" placeholder="8181"><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-bcrfEnabled"> BidCos-RF</label>
+            <input type="text" id="node-config-input-bcrfPort" class="ccu-port" style="width: 70px;" placeholder="2001"><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-bcwiEnabled"> BidCos-Wired</label>
+            <input type="text" id="node-config-input-bcwiPort" class="ccu-port" style="width: 70px;" placeholder="2000"><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-iprfEnabled"> HmIP-RF</label>
+            <input type="text" id="node-config-input-iprfPort" class="ccu-port" style="width: 70px;" placeholder="2010"><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-virtEnabled"> VirtualDevices</label>
+            <input type="text" id="node-config-input-virtPort" class="ccu-port" style="width: 70px;" placeholder="9292"><br>
+            <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-cuxdEnabled"> CUxD</label>
+            <input type="text" id="node-config-input-cuxdPort" class="ccu-port" style="width: 70px;" placeholder="8701"><br>
             <label class="ccu-checkbox"><input type="checkbox" id="node-config-input-jackEnabled"> CCU-Jack</label>
             <input type="text" id="node-config-input-jackPort" style="width: 70px;" placeholder="2121">
         </div>
@@ -300,10 +313,18 @@
         <label for="node-config-input-password"><i class="icon-tag"></i> Password</label>
         <input type="password" id="node-config-input-password">
     </div>
+    <div class="form-row">
+        <label for="node-config-input-connectionType"><i class="icon-tag"></i> openccu-lite interfaces</label>
+        <select id="node-config-input-connectionType" style="width: 70%;">
+            <option value="auto">auto: through the system's lite-rpc on openccu-lite (the default), the CCU way elsewhere</option>
+            <option value="openccu-lite">openccu-lite: lite-rpc only</option>
+            <option value="ccu">CCU: directly, with callbacks (XML-RPC/BIN-RPC) - on openccu-lite too</option>
+        </select>
+    </div>
     <div class="form-row">
         <label for="node-config-input-metaToken"><i class="icon-tag"></i> openccu-lite token</label>
         <input type="password" id="node-config-input-metaToken" placeholder="olt_...">
-        <small>Only for openccu-lite (a CCU ignores this). Leave empty when Node-RED runs on the box.</small>
+        <small>Only for openccu-lite (a CCU ignores this). Leave empty when Node-RED runs on the system itself (RedMatic).</small>
     </div>
     <div class="form-row">
         <label for="node-config-input-metaPort"><i class="icon-tag"></i> openccu-lite port</label>