PyFT8 3.6.6__tar.gz → 3.7.1__tar.gz

{pyft8-3.6.6 → pyft8-3.7.1}/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: PyFT8
-Version: 3.6.6
+Version: 3.7.1
 Summary: FT8 Decoding and Encoding in Python with test/loopback code
 Author-email: G1OJS <g1ojs@yahoo.com>
 License-Expression: GPL-3.0-or-later
@@ -23,7 +23,7 @@ Dynamic: license-file
 # PyFT8 [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/pyft8) [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=weekly&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads/wk)](https://pepy.tech/projects/pyft8) [PyPI link](https://pypi.org/project/PyFT8/)
 # All-Python FT8 Transceiver GUI / Command Line Modem
 
-This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is about 70% of that achieved by WSJT-x in NORM mode, but (tbc) slightly above ft8_lib. 
+This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is very close to that of WSJT-x 2.7.0 running in FAST mode. 
 
 PyFT8 is somewhat experimental, with a focus on demonstrating FT8 written in Python, but can be used as a standalone replacement for WSJT-x and other software.
 
@@ -116,6 +116,28 @@ The image below shows the number of decodes from PyFT8, WSJT-x V2.7.0 running in
 
 <img width="900" height="900" alt="live playback vs wsjtx_v2 7 0" src="https://github.com/user-attachments/assets/853e98b2-5b9b-4241-b5f3-181fe193642e" />
 
+## Decoding approach
+The approach to decoding, as at v3.7.0, is as follows.
+
+ - As audio arrives
+    - FFT to a spectrum 4 times per symbol duration & assemble a time-frequency grid with 2 bins per tone.
+    - Collect all audio samples for later full cycle FFT
+ - Search the time frequency grid for candidates based on Costas array sync score (using middle Costas block)
+ - Send candidates for decode using symbol & tone points drawn directly from the search grid to get early decodes using limited LDPC cycles.
+
+This often decodes around three quarters of the candidates decoded by WSJT-x, with the steps below getting most of the rest:
+
+ - For candidates that haven't decoded:
+     - FFT the full cycle audio, downsample to 200 samples per second & shift the signal to f = 0
+     - Explore fine time and frequency offsets to maximise the Costas sync score
+     - Check for bad candidates (count maxima of Costas tones)
+     - Extract the LLR & wait for decoder to pick up the candidate
+ - For candidates awaiting decode from above:
+     - Try more extensive LDPC
+     - Try several 'A Priori' masks and input to more LDPC attempts, recording the output LLR on failures
+     - Try Ordered Statistics Decoding on the base LLR
+     - Try Ordered Statistics Decoding on the LLRs output from the AP+LDPC runs above
+
 ## Limitations
 PyFT8 doesn't decode / encode *all* message types. The table below shows which are handled.
 

{pyft8-3.6.6 → pyft8-3.7.1}/PyFT8/gui.py

@@ -25,13 +25,12 @@ def add_my_axes(fig, pos):
     ax.set_facecolor(TEXT_BACKGROUND_COLOR)
     return ax
 
-MESSAGE_TYPES = {'generic':{'bg':'blue', 'fg':'white', 'alpha':0.5}, 'CQ':{'bg':'green', 'fg':'white', 'alpha':0.8},
-                 'from_me': {'bg':'yellow', 'fg':'black', 'alpha':0.95}, 'to_me':{'bg':'red', 'fg':'white', 'alpha':0.9}} 
+MESSAGE_TYPES = {'generic':{'bg':'blue', 'fg':'white', 'alpha':0.4}, 'CQ':{'bg':'green', 'fg':'white', 'alpha':0.7},
+                 'from_me': {'bg':'yellow', 'fg':'black', 'alpha':0.9}, 'to_me':{'bg':'red', 'fg':'white', 'alpha':0.9}} 
 class Msg_box:
-    def __init__(self, fig, ax, x, y, w, h, message):
+    def __init__(self, fig, ax, w, h):
         from matplotlib.patches import Rectangle
         self.fig, self.ax = fig, ax
-        message_type_params = MESSAGE_TYPES[message['message_type']]
         rect = Rectangle((0, 0), w, h, edgecolor='lime', lw=2)
         self.patch = self.ax.add_patch(rect)
         self.patch.set_visible(False)
@@ -39,7 +38,6 @@ class Msg_box:
         self.text_inst.set_visible(False)
         self.text_inst.set_fontfamily('monospace')
         self.artists = [self.patch, self.text_inst]
-        self.set_props(x, y, message)
 
     def set_props(self, x, y, message):
         self.xy = (x, y)
@@ -177,10 +175,10 @@ class Gui:
         self.cid = self.fig.canvas.mpl_connect('button_press_event', self._oncanvasclick)
 
     def main_loop(self):
-        last_ptr = 0
         self.plt.show(block = False)
-        target_update_time = 0.25
+        target_update_time = 0.15
         while True:
+            self.fig.canvas.flush_events() # for clicks
             tstart_wf_redraw = time_utils.time()
             self.image.set_data(self.waterfall_data['data'])
             if self.needs_redraw:
@@ -188,42 +186,29 @@ class Gui:
                 plt.pause(0.01)
             else:
                 self.ax_wf.draw_artist(self.image)
-                t = time_utils.time()
+                self.fig.canvas.flush_events() # for clicks
                 for mb in self.msg_boxes:
-                    mb.draw()
-                #print(f"Drew {len(self.msg_boxes)} in {time_utils.time() - t:6.2f}s")
-                self.fig.canvas.blit(self.ax_wf.bbox)
-                #self.fig.canvas.update()
+                    if mb.patch.get_visible():
+                        mb.draw()
+                    self.fig.canvas.flush_events() # for clicks
+                self.fig.canvas.blit(self.ax_wf.bbox) #self.fig.canvas.update()
                 self.fig.canvas.flush_events()
-                #print(f"Updated at {time_utils.cycle_time():6.2f}s")
                 tdelay = target_update_time - (time_utils.time() - tstart_wf_redraw)
-                #print(tdelay)
                 if tdelay > 0.01:
                     time_utils.sleep(tdelay)
 
-    def before_search(self, curr_cycle):
-        self._hide_msg_boxes(curr_cycle) # hide boxes overlapping new decodes
+    def before_search(self, curr_cycle): # would be better with a local trigger
+        #self._hide_msg_boxes(curr_cycle) # hide boxes overlapping new decodes
         self._hide_msg_boxes(curr_cycle = None) # hide all boxes
-        
-    def after_search(self, curr_cycle):
-        self._refresh_hearing()
-        self._refresh_band_buttons()
         self._refresh_home_panel()
-        #self._clear_msg_boxes(curr_cycle)
+        self._refresh_band_buttons()
+        self._refresh_hearing()
 
     def display_message(self, message):
+        mb = self._get_message_box()
         x = int(message['t0'] / self.waterfall_data['dt'] + message['their_tx_cycle'] * self.waterfall_data['pixels_per_cycle'])
         y = int(message['fHz'] / self.waterfall_data['df'])
-        mb = None
-        for mb1 in self.msg_boxes:
-            if not mb1.patch.get_visible():
-                mb1.set_props(x, y, message)
-                mb = mb1
-                break
-        if not mb:
-            mb = Msg_box(self.fig, self.ax_wf, x, y, self.waterfall_data['sig_w'], self.waterfall_data['sig_h'], message)
-            self.msg_boxes.append(mb)
-        #print(f"{len(self.msg_boxes)} message boxes")
+        mb.set_props(x, y, message)
 
     def update_message(self, display_text, update_dict):
         for mb in self.msg_boxes:
@@ -252,17 +237,35 @@ class Gui:
                                    color = row_text['color'])
         self.needs_redraw = True
 
+    def _get_message_box(self):
+        mb = None
+        for mb1 in self.msg_boxes:
+            if not mb1.patch.get_visible():
+                mb = mb1
+                break
+        if not mb:
+            mb = Msg_box(self.fig, self.ax_wf, self.waterfall_data['sig_w'], self.waterfall_data['sig_h'])
+            self.msg_boxes.append(mb)
+        return mb
+
     def _set_band(self, band):
         if band in self.configured_bands:
             self.band_info = {'current_band':band, 'fMHz':self.configured_bands[band], 'time_set':time_utils.time()}
             self.console_print(f"[PyFT8] Set band: {self.band_info['current_band']} {self.band_info['fMHz']}")
-            self._clear_msg_boxes()
+            for mb in self.msg_boxes:
+                mb.hide()
+                mb.remove()
+            self.msg_boxes = []
+            self._refresh_home_panel()
+            self._refresh_band_buttons()
+            self._refresh_hearing()
+            self.needs_redraw = True
 
     def _oncanvasclick(self, clickargs):
         if clickargs.inaxes is self.ax_wf:
             for mb in self.msg_boxes:
                 if mb.contains(clickargs.x, clickargs.y):
-                    self.console_print(f"[GUI] Clicked on message '{mb.message['msg_text']}'")
+                    self.console_print(f"[GUI] Clicked on message '{mb.message['msg_text']}")
                     self.qso_manager.on_click({'action':"MESSAGE_CLICK", 'message':mb.message})
                     return
         for bb in self.button_boxes:
@@ -271,7 +274,6 @@ class Gui:
                     self.needs_redraw = True
                     self._set_band(bb.id)
                     self.qso_manager.on_click({'action':"SET_BAND", 'fMHz':self.configured_bands[bb.id]})
-                    self.after_search(curr_cycle = None)
                 else:
                     action = ["CQ", "RPT_LAST", "TX_OFF"][['CQ', 'Repeat last', 'Tx off'].index(bb.id)]
                     self.qso_manager.on_click({'action':action})
@@ -281,19 +283,6 @@ class Gui:
         for mb in to_hide:
             mb.hide()
         self.needs_redraw = True
-
-    def _clear_msg_boxes(self, curr_cycle = None):
-        to_remove = [mb for mb in self.msg_boxes if (mb.cycle == curr_cycle) or (curr_cycle is None)]
-        self.msg_boxes = [mb for mb in self.msg_boxes if (mb.cycle != curr_cycle) and not (curr_cycle is None)]
-        for mb in to_remove:
-            mb.hide()
-            mb.remove()
-        self.needs_redraw = True
-
-    def _text_row(self, ax, x, y, text = '', color = 'white', **args):
-        art = ax.text(x, y, text, color = color)
-        art.set_fontfamily('monospace')
-        return art
    
     def _refresh_home_panel(self):
         current_band = self.band_info['current_band']

{pyft8-3.6.6 → pyft8-3.7.1}/PyFT8/message_broker.py

@@ -34,7 +34,7 @@ class Broker():
             self.on_decode(message_dict)
         m = message_dict
         screen_format = f"{cyclestart_string} {their_snr} {m['dt']:4.1f} {m['fHz']:4.0f} ~ {hail} {their_call} {grid_rpt}"
-        print(f"{screen_format:50s} decoded@ {m['decode_completed']:5.1f}s, dec = {m['decode_status']}")
+        print(f"{screen_format:50s} decoded@ {m['decode_completed'] %15:5.1f}s, dec = {m['decode_status']}")
         self.message_queue_non_time_critical.put(message_dict)
 
     def _process_message_ntc(self):
@@ -55,7 +55,6 @@ class Broker():
                             new_display_text = f"{m['display_text']} {hearing_me} {wb_text} {geo_text}"
                             self.gui.update_message( m['display_text'], {'hearing_me':hearing_me, 'wb_text':wb_text,
                                                         'geo_text':geo_text, 'display_text':new_display_text } )
-
                 if band_info:
                     if m['their_call'] != 'not':
                         if self.history:

{pyft8-3.6.6 → pyft8-3.7.1}/PyFT8/pyft8.py

@@ -11,7 +11,7 @@ from PyFT8.databases import ADIF
 from PyFT8.qso_manager import QSO_manager
 from PyFT8.message_broker import Broker
 
-VER = '3.6.6'
+VER = '3.7.1'
 PSKR_REFRESH_MINS = 20
 message_broker = None
 
@@ -136,7 +136,7 @@ def cli():
         qso_manager = QSO_manager(message_broker, rig_control, console_print)
         message_broker.gui.register_qso_manager(qso_manager)
         message_broker.rx.register_before_search(message_broker.gui.before_search)
-        message_broker.rx.register_after_search(message_broker.gui.after_search)
+        #message_broker.rx.register_after_search(message_broker.gui.after_search)
         message_broker.history.incorporate_log_data(qso_manager.adif_logging.cache)
         message_broker.history.start_collect_new()
 

{pyft8-3.6.6 → pyft8-3.7.1}/PyFT8/receiver.py

@@ -592,7 +592,7 @@ class Receiver():
                                         'msg_text':f"{hail} {their_call} {grid_rpt}",
                                         'their_snr':f"{c.snr:+03d}", 'their_tx_cycle':c.origin['odd_even'], 
                                         't0':c.origin['t0'], 'dt':c.origin['t0'] - 0.5, 'fHz':c.origin['f0'],
-                                        'decode_status':c.decode_status, 'decode_completed':time_utils.cycle_time()}
+                                        'decode_status':c.decode_status, 'decode_completed':time_utils.time()}
                         self.process_message(message_dict)
                 
             if len(to_decode):

{pyft8-3.6.6 → pyft8-3.7.1}/PyFT8.egg-info/PKG-INFO

@@ -1,6 +1,6 @@
 Metadata-Version: 2.4
 Name: PyFT8
-Version: 3.6.6
+Version: 3.7.1
 Summary: FT8 Decoding and Encoding in Python with test/loopback code
 Author-email: G1OJS <g1ojs@yahoo.com>
 License-Expression: GPL-3.0-or-later
@@ -23,7 +23,7 @@ Dynamic: license-file
 # PyFT8 [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/pyft8) [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=weekly&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads/wk)](https://pepy.tech/projects/pyft8) [PyPI link](https://pypi.org/project/PyFT8/)
 # All-Python FT8 Transceiver GUI / Command Line Modem
 
-This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is about 70% of that achieved by WSJT-x in NORM mode, but (tbc) slightly above ft8_lib. 
+This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is very close to that of WSJT-x 2.7.0 running in FAST mode. 
 
 PyFT8 is somewhat experimental, with a focus on demonstrating FT8 written in Python, but can be used as a standalone replacement for WSJT-x and other software.
 
@@ -116,6 +116,28 @@ The image below shows the number of decodes from PyFT8, WSJT-x V2.7.0 running in
 
 <img width="900" height="900" alt="live playback vs wsjtx_v2 7 0" src="https://github.com/user-attachments/assets/853e98b2-5b9b-4241-b5f3-181fe193642e" />
 
+## Decoding approach
+The approach to decoding, as at v3.7.0, is as follows.
+
+ - As audio arrives
+    - FFT to a spectrum 4 times per symbol duration & assemble a time-frequency grid with 2 bins per tone.
+    - Collect all audio samples for later full cycle FFT
+ - Search the time frequency grid for candidates based on Costas array sync score (using middle Costas block)
+ - Send candidates for decode using symbol & tone points drawn directly from the search grid to get early decodes using limited LDPC cycles.
+
+This often decodes around three quarters of the candidates decoded by WSJT-x, with the steps below getting most of the rest:
+
+ - For candidates that haven't decoded:
+     - FFT the full cycle audio, downsample to 200 samples per second & shift the signal to f = 0
+     - Explore fine time and frequency offsets to maximise the Costas sync score
+     - Check for bad candidates (count maxima of Costas tones)
+     - Extract the LLR & wait for decoder to pick up the candidate
+ - For candidates awaiting decode from above:
+     - Try more extensive LDPC
+     - Try several 'A Priori' masks and input to more LDPC attempts, recording the output LLR on failures
+     - Try Ordered Statistics Decoding on the base LLR
+     - Try Ordered Statistics Decoding on the LLRs output from the AP+LDPC runs above
+
 ## Limitations
 PyFT8 doesn't decode / encode *all* message types. The table below shows which are handled.
 

{pyft8-3.6.6 → pyft8-3.7.1}/README.md

@@ -1,7 +1,7 @@
 # PyFT8 [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=total&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads)](https://pepy.tech/projects/pyft8) [![PyPI Downloads](https://static.pepy.tech/personalized-badge/pyft8?period=weekly&units=INTERNATIONAL_SYSTEM&left_color=BLACK&right_color=GREEN&left_text=downloads/wk)](https://pepy.tech/projects/pyft8) [PyPI link](https://pypi.org/project/PyFT8/)
 # All-Python FT8 Transceiver GUI / Command Line Modem
 
-This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is about 70% of that achieved by WSJT-x in NORM mode, but (tbc) slightly above ft8_lib. 
+This repository contains the source code for PyFT8, an all-Python open source FT8 transceiver that you can run as a basic GUI or from the command line to receive and transmit. Decoding performance (number of decodes) is very close to that of WSJT-x 2.7.0 running in FAST mode. 
 
 PyFT8 is somewhat experimental, with a focus on demonstrating FT8 written in Python, but can be used as a standalone replacement for WSJT-x and other software.
 
@@ -94,6 +94,28 @@ The image below shows the number of decodes from PyFT8, WSJT-x V2.7.0 running in
 
 <img width="900" height="900" alt="live playback vs wsjtx_v2 7 0" src="https://github.com/user-attachments/assets/853e98b2-5b9b-4241-b5f3-181fe193642e" />
 
+## Decoding approach
+The approach to decoding, as at v3.7.0, is as follows.
+
+ - As audio arrives
+    - FFT to a spectrum 4 times per symbol duration & assemble a time-frequency grid with 2 bins per tone.
+    - Collect all audio samples for later full cycle FFT
+ - Search the time frequency grid for candidates based on Costas array sync score (using middle Costas block)
+ - Send candidates for decode using symbol & tone points drawn directly from the search grid to get early decodes using limited LDPC cycles.
+
+This often decodes around three quarters of the candidates decoded by WSJT-x, with the steps below getting most of the rest:
+
+ - For candidates that haven't decoded:
+     - FFT the full cycle audio, downsample to 200 samples per second & shift the signal to f = 0
+     - Explore fine time and frequency offsets to maximise the Costas sync score
+     - Check for bad candidates (count maxima of Costas tones)
+     - Extract the LLR & wait for decoder to pick up the candidate
+ - For candidates awaiting decode from above:
+     - Try more extensive LDPC
+     - Try several 'A Priori' masks and input to more LDPC attempts, recording the output LLR on failures
+     - Try Ordered Statistics Decoding on the base LLR
+     - Try Ordered Statistics Decoding on the LLRs output from the AP+LDPC runs above
+
 ## Limitations
 PyFT8 doesn't decode / encode *all* message types. The table below shows which are handled.
 

{pyft8-3.6.6 → pyft8-3.7.1}/pyproject.toml

@@ -1,6 +1,6 @@
 [project]
 name = "PyFT8"
-version = "3.6.6"
+version = "3.7.1"
 license = "GPL-3.0-or-later"
 
 authors = [