tenet-official 0.1.0__tar.gz

tenet_official-0.1.0/LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2019 Guocheng Qian @ SenseTime
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

tenet_official-0.1.0/PKG-INFO

@@ -0,0 +1,212 @@
+Metadata-Version: 2.4
+Name: tenet_official
+Version: 0.1.0
+Summary: TENet (ICCP'22) release metadata and resource helpers for pip users: paper, PixelShift200 dataset, model list, and pretrained-weight loading info.
+Author: Guocheng Qian
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/guochengqian/TENet
+Project-URL: Repository, https://github.com/guochengqian/TENet
+Project-URL: Paper, https://arxiv.org/abs/1905.02538
+Project-URL: Dataset, http://guochengqian.github.io/project/pixelshift200
+Keywords: demosaicing,denoising,super-resolution,ISP,raw,pytorch,TENet,PixelShift200
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Science/Research
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Scientific/Engineering :: Image Processing
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Provides-Extra: dev
+Requires-Dist: build>=1; extra == "dev"
+Requires-Dist: twine>=4; extra == "dev"
+Requires-Dist: pytest>=7; extra == "dev"
+Dynamic: license-file
+
+# TENet <a href="https://arxiv.org/abs/1905.02538" target="_blank">[ArXiv]</a> <a href="http://guochengqian.github.io/project/pixelshift200">[pixelshift200]</a> 
+
+### Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline
+By [Guocheng Qian*](https://guochengqian.github.io/), [Yuanhao Wang*](https://github.com/yuanhaowang1213), [Jinjin Gu](http://www.jasongt.com/), Chao Dong, Wolfgang Heidrich, Bernard Ghanem, [Jimmy S. Ren](http://www.jimmyren.com/)
+
+The original name of this project is: "Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution"
+
+
+
+## TENet
+
+We insert the proposed pipeline DN -> SR -> DM into an end-to-end network constructed by RRDB for the joint DN, DM and SR. We leverage the detachable branch to provide the middle stage supervision. 
+
+
+<p align="center">
+  <img height="300" src="misc/Network.png">
+</p>
+
+
+
+
+## PixelShift200 dataset
+
+We employ advanced pixel shift technology to perform a full color sampling of the image.
+Pixel shift technology takes four samples of the same image, and physically controls the camera sensor to move one pixel horizontally or vertically at each sampling to capture all color information at each pixel.
+The pixel shift technology ensures that the sampled images follow the distribution of natural images sampled by the camera, and the full information of the color is completely obtained.
+In this way, the collected images are artifacts-free, which leads to better training results for demosaicing related tasks.
+
+<p align="center">
+  <img height="200" src="misc/PixelShift.png">
+</p>  
+
+
+Download PixelShift200 and the original RAW files from [pxielshift200 website](http://guochengqian.github.io/project/pixelshift200) for using this [Google Drive Link](https://drive.google.com/drive/folders/1S1mt9D8IlpSAVm7RTjLheh1hTaltsV_f?usp=share_link)
+
+
+### Environment installation
+
+Clone this github repo and install the environment by:
+
+```bash
+git clone https://github.com/guochengqian/TENet
+cd TENet
+source install.sh
+conda activate tenet
+```
+
+
+
+### Data preparation
+
+1. synthetic data preparation [Optional]
+   Processing synthetic dataset if you are interested in synthetic benchmark.
+   1. Download ([DIV2K](https://drive.google.com/file/d/1vXPPr2hVaMewz2JA1lFfI5uHB4ENwRXQ/view?usp=sharing)) dataset
+
+   2. `mkdir data && cd data`
+
+   3. Link DIV2K data into ./data/DIV2K, e.g. `ln -s /data/lowlevel/DIV2K ./` 
+
+   4. Crop DIV2K
+      
+      ```bash
+      cd ../datasets
+      python crop_imgs.py # crop train images
+      python crop_imgs.py --src_dir ../data/DIV2K/DIV2K_val5_HR --save_dir ../data/DIV2K/DIV2K_val5_HR_sub # crop val5 images
+      ```
+
+2. PixelShift200 data preparation 
+   Processing PixelShift200 dataset if you are interested in PixelShift200 benchmark.
+   1. Download [Pixelshift200](http://guochengqian.com/pixelshift200). They are .mat format, having 4 channels (R, Gr, Gb, B). Unzip the .zip file and put all folders inside into one folder called pixelshift200. For example, put here `/data/lowlevel/pixelshift200`. 
+
+   2. `cd TENet && mkdir data && cd data`
+
+   3. Link PixelShift200 data into ./data/pixelshift200, e.g. `ln -s /data/lowlevel/pixelshift200 pixelshift200` 
+
+   4. Crop images into 512*512, and generate the text file that contains the location of each image:
+
+      ```bash
+      cd ../datasets
+      python crop_pixelshift200.py 
+      python generate_datalist_pixelshift.py 
+      ```
+
+
+## Training
+#### Train  joint  models
+
+* DN+SR->DM (our **TENet**)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type raw --out_type linrgb --model tenet --n_gpus 4 --block rrdb  --n_blocks 12
+  ```
+
+* DN+DM+SR [Optional] (baseline: end to end without pipeline)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model tenet --n_gpus 4 --block rrdb --n_blocks 12
+  ```
+
+  Note: 
+
+  1.  `--mid_type raw` is to activate the auxiliary mid stage supervision. Here we add `raw` as the supervision, therefore, the pipeline will be DN+SR->DM
+
+  2.  for training on a different dataset, like DIV2K, change `--dataset div2k` 
+   
+  3.  for training with Gaussian noise model, add `--noise_model g`
+
+  4.  for using a different building block, such as NLSA `--block nlsa`, or EAM `--block eam` , or RRG `--block rrg`, or DRLM `--block drlm` or RRDB `--block rrdb`
+
+  5.   [`wandb`](https://wandb.ai/) is used by default. Set `--no_wandb` to not using wandb 
+
+
+
+#### Train sequential models [Optional] (ablation study) 
+
+```bash
+# RawDN
+python train.py --in_type noisy_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RawSR
+python train.py --in_type lr_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# DM
+python train.py --in_type raw --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBDN
+python train.py --in_type noisy_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBSR
+python train.py --in_type lr_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+```
+
+
+### Train SOTA models [Optional]
+We also support training previous work. 
+
+* JDSR
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model jdsr --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block res --n_blocks 12 --channels 256
+  ```
+
+* JDnDmSR
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type lr_raw --out_type linrgb --model jdndmsr --scale 2 --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4 --n_blocks 2 --block rcab
+  ```
+
+
+## Testing
+
+```bash
+bash script_all_pipelines.sh 
+```
+This script supports evaluation on all benchmarking datasets as well as the real-shot images for all possible pipelines. Check this script for details 
+
+
+Note: for the real shot images testing, you have to:
+
+1.  save the real-shot image as a readable raw image (like in .RAW, .ARW, .DNG format).  For example,  we use Lightroom mobile version to shot images on iPhone and save the photo in .DNG format.
+2. Read the general metadata using RawPy and read the noise profiling metadata using [Jeffrey's Image Metadata Viewer](http://exif.regex.info/exif.cgi) or [metapicz](http://metapicz.com/). 
+
+
+
+## Result
+<p align="center">
+  <img width="800" src="misc/pipeline_result.png">
+</p>
+
+
+### Citation 
+
+Please cite the following paper if you feel TENet and PixelShift200 is useful to your research
+
+```
+@article{qian2019rethink,
+  title={Rethink the Pipeline of Demosaicking, Denoising, and Super-resolution},
+  author={Qian, Guocheng and Wang, Yuanhao and Gu, Jinjin and Dong, Chao and  Heidrich, Wolfgang and Ghanem, Bernard and Ren, Jimmy S},
+  journal={arXiv preprint arXiv:1905.02538},
+  year={2019}
+}
+```

tenet_official-0.1.0/README.md

@@ -0,0 +1,181 @@
+# TENet <a href="https://arxiv.org/abs/1905.02538" target="_blank">[ArXiv]</a> <a href="http://guochengqian.github.io/project/pixelshift200">[pixelshift200]</a> 
+
+### Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline
+By [Guocheng Qian*](https://guochengqian.github.io/), [Yuanhao Wang*](https://github.com/yuanhaowang1213), [Jinjin Gu](http://www.jasongt.com/), Chao Dong, Wolfgang Heidrich, Bernard Ghanem, [Jimmy S. Ren](http://www.jimmyren.com/)
+
+The original name of this project is: "Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution"
+
+
+
+## TENet
+
+We insert the proposed pipeline DN -> SR -> DM into an end-to-end network constructed by RRDB for the joint DN, DM and SR. We leverage the detachable branch to provide the middle stage supervision. 
+
+
+<p align="center">
+  <img height="300" src="misc/Network.png">
+</p>
+
+
+
+
+## PixelShift200 dataset
+
+We employ advanced pixel shift technology to perform a full color sampling of the image.
+Pixel shift technology takes four samples of the same image, and physically controls the camera sensor to move one pixel horizontally or vertically at each sampling to capture all color information at each pixel.
+The pixel shift technology ensures that the sampled images follow the distribution of natural images sampled by the camera, and the full information of the color is completely obtained.
+In this way, the collected images are artifacts-free, which leads to better training results for demosaicing related tasks.
+
+<p align="center">
+  <img height="200" src="misc/PixelShift.png">
+</p>  
+
+
+Download PixelShift200 and the original RAW files from [pxielshift200 website](http://guochengqian.github.io/project/pixelshift200) for using this [Google Drive Link](https://drive.google.com/drive/folders/1S1mt9D8IlpSAVm7RTjLheh1hTaltsV_f?usp=share_link)
+
+
+### Environment installation
+
+Clone this github repo and install the environment by:
+
+```bash
+git clone https://github.com/guochengqian/TENet
+cd TENet
+source install.sh
+conda activate tenet
+```
+
+
+
+### Data preparation
+
+1. synthetic data preparation [Optional]
+   Processing synthetic dataset if you are interested in synthetic benchmark.
+   1. Download ([DIV2K](https://drive.google.com/file/d/1vXPPr2hVaMewz2JA1lFfI5uHB4ENwRXQ/view?usp=sharing)) dataset
+
+   2. `mkdir data && cd data`
+
+   3. Link DIV2K data into ./data/DIV2K, e.g. `ln -s /data/lowlevel/DIV2K ./` 
+
+   4. Crop DIV2K
+      
+      ```bash
+      cd ../datasets
+      python crop_imgs.py # crop train images
+      python crop_imgs.py --src_dir ../data/DIV2K/DIV2K_val5_HR --save_dir ../data/DIV2K/DIV2K_val5_HR_sub # crop val5 images
+      ```
+
+2. PixelShift200 data preparation 
+   Processing PixelShift200 dataset if you are interested in PixelShift200 benchmark.
+   1. Download [Pixelshift200](http://guochengqian.com/pixelshift200). They are .mat format, having 4 channels (R, Gr, Gb, B). Unzip the .zip file and put all folders inside into one folder called pixelshift200. For example, put here `/data/lowlevel/pixelshift200`. 
+
+   2. `cd TENet && mkdir data && cd data`
+
+   3. Link PixelShift200 data into ./data/pixelshift200, e.g. `ln -s /data/lowlevel/pixelshift200 pixelshift200` 
+
+   4. Crop images into 512*512, and generate the text file that contains the location of each image:
+
+      ```bash
+      cd ../datasets
+      python crop_pixelshift200.py 
+      python generate_datalist_pixelshift.py 
+      ```
+
+
+## Training
+#### Train  joint  models
+
+* DN+SR->DM (our **TENet**)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type raw --out_type linrgb --model tenet --n_gpus 4 --block rrdb  --n_blocks 12
+  ```
+
+* DN+DM+SR [Optional] (baseline: end to end without pipeline)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model tenet --n_gpus 4 --block rrdb --n_blocks 12
+  ```
+
+  Note: 
+
+  1.  `--mid_type raw` is to activate the auxiliary mid stage supervision. Here we add `raw` as the supervision, therefore, the pipeline will be DN+SR->DM
+
+  2.  for training on a different dataset, like DIV2K, change `--dataset div2k` 
+   
+  3.  for training with Gaussian noise model, add `--noise_model g`
+
+  4.  for using a different building block, such as NLSA `--block nlsa`, or EAM `--block eam` , or RRG `--block rrg`, or DRLM `--block drlm` or RRDB `--block rrdb`
+
+  5.   [`wandb`](https://wandb.ai/) is used by default. Set `--no_wandb` to not using wandb 
+
+
+
+#### Train sequential models [Optional] (ablation study) 
+
+```bash
+# RawDN
+python train.py --in_type noisy_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RawSR
+python train.py --in_type lr_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# DM
+python train.py --in_type raw --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBDN
+python train.py --in_type noisy_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBSR
+python train.py --in_type lr_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+```
+
+
+### Train SOTA models [Optional]
+We also support training previous work. 
+
+* JDSR
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model jdsr --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block res --n_blocks 12 --channels 256
+  ```
+
+* JDnDmSR
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type lr_raw --out_type linrgb --model jdndmsr --scale 2 --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4 --n_blocks 2 --block rcab
+  ```
+
+
+## Testing
+
+```bash
+bash script_all_pipelines.sh 
+```
+This script supports evaluation on all benchmarking datasets as well as the real-shot images for all possible pipelines. Check this script for details 
+
+
+Note: for the real shot images testing, you have to:
+
+1.  save the real-shot image as a readable raw image (like in .RAW, .ARW, .DNG format).  For example,  we use Lightroom mobile version to shot images on iPhone and save the photo in .DNG format.
+2. Read the general metadata using RawPy and read the noise profiling metadata using [Jeffrey's Image Metadata Viewer](http://exif.regex.info/exif.cgi) or [metapicz](http://metapicz.com/). 
+
+
+
+## Result
+<p align="center">
+  <img width="800" src="misc/pipeline_result.png">
+</p>
+
+
+### Citation 
+
+Please cite the following paper if you feel TENet and PixelShift200 is useful to your research
+
+```
+@article{qian2019rethink,
+  title={Rethink the Pipeline of Demosaicking, Denoising, and Super-resolution},
+  author={Qian, Guocheng and Wang, Yuanhao and Gu, Jinjin and Dong, Chao and  Heidrich, Wolfgang and Ghanem, Bernard and Ren, Jimmy S},
+  journal={arXiv preprint arXiv:1905.02538},
+  year={2019}
+}
+```

tenet_official-0.1.0/pyproject.toml

@@ -0,0 +1,43 @@
+[build-system]
+requires = ["setuptools>=68", "wheel"]
+build-backend = "setuptools.build_meta"
+
+[project]
+name = "tenet_official"
+version = "0.1.0"
+description = "TENet (ICCP'22) release metadata and resource helpers for pip users: paper, PixelShift200 dataset, model list, and pretrained-weight loading info."
+readme = "README.md"
+requires-python = ">=3.8"
+license = "MIT"
+authors = [{ name = "Guocheng Qian" }]
+keywords = ["demosaicing", "denoising", "super-resolution", "ISP", "raw", "pytorch", "TENet", "PixelShift200"]
+classifiers = [
+  "Development Status :: 3 - Alpha",
+  "Intended Audience :: Science/Research",
+  "Programming Language :: Python :: 3",
+  "Programming Language :: Python :: 3 :: Only",
+  "Programming Language :: Python :: 3.8",
+  "Programming Language :: Python :: 3.9",
+  "Programming Language :: Python :: 3.10",
+  "Programming Language :: Python :: 3.11",
+  "Programming Language :: Python :: 3.12",
+  "Topic :: Scientific/Engineering :: Artificial Intelligence",
+  "Topic :: Scientific/Engineering :: Image Processing",
+]
+dependencies = []
+
+[project.optional-dependencies]
+dev = ["build>=1", "twine>=4", "pytest>=7"]
+
+[project.urls]
+Homepage = "https://github.com/guochengqian/TENet"
+Repository = "https://github.com/guochengqian/TENet"
+Paper = "https://arxiv.org/abs/1905.02538"
+Dataset = "http://guochengqian.github.io/project/pixelshift200"
+
+[project.scripts]
+tenet-info = "tenet_official.cli:main"
+
+[tool.setuptools]
+packages = ["tenet_official"]
+zip-safe = false

tenet_official-0.1.0/setup.cfg

@@ -0,0 +1,4 @@
+[egg_info]
+tag_build = 
+tag_date = 0
+

tenet_official-0.1.0/tenet_official/__init__.py

@@ -0,0 +1,30 @@
+"""TENet release helper package.
+
+TENet (ICCP'22) — *Rethinking Learning-based Demosaicing, Denoising, and
+Super-Resolution Pipeline*. The research training/evaluation code lives in the
+TENet repository. This small package provides stable metadata, resource links,
+and helpers for pip-installed users (paper, PixelShift200 dataset, pretrained
+weights, and the model list).
+"""
+
+from .info import (
+    ARXIV_URL,
+    PIXELSHIFT200,
+    PROJECT_PAGE,
+    REPOSITORY,
+    MODELS,
+    RESOURCES,
+    resources,
+)
+
+__all__ = [
+    "ARXIV_URL",
+    "PIXELSHIFT200",
+    "PROJECT_PAGE",
+    "REPOSITORY",
+    "MODELS",
+    "RESOURCES",
+    "resources",
+]
+
+__version__ = "0.1.0"

tenet_official-0.1.0/tenet_official/cli.py

@@ -0,0 +1,51 @@
+"""Command-line helper for the tenet_official package.
+
+Prints TENet resource links (paper, code, PixelShift200 dataset) so pip users
+can quickly find where to get the code, data, and how weights are loaded.
+"""
+
+from __future__ import annotations
+
+import argparse
+
+from . import __version__
+from .info import MODELS, RESOURCES, REPOSITORY
+
+
+def build_parser() -> argparse.ArgumentParser:
+    parser = argparse.ArgumentParser(
+        description="TENet resource/info helper (paper, code, PixelShift200 dataset)."
+    )
+    parser.add_argument("--models", action="store_true", help="List available model variants and exit.")
+    parser.add_argument("--version", action="store_true", help="Print version and exit.")
+    return parser
+
+
+def main(argv: list[str] | None = None) -> int:
+    parser = build_parser()
+    args = parser.parse_args(argv)
+
+    if args.version:
+        print(__version__)
+        return 0
+
+    if args.models:
+        print("TENet model variants (model/<name>.py, built as model.<name>.Net(args)):")
+        for name in MODELS:
+            print(f"  - {name}")
+        return 0
+
+    print(f"TENet (tenet_official {__version__})")
+    print("Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline\n")
+    for res in RESOURCES.values():
+        print(f"  {res.key:14s} {res.url}\n  {'':14s} {res.description}")
+    print(
+        "\nTraining/evaluation uses a source checkout — see "
+        f"{REPOSITORY} (`source install.sh`).\n"
+        "Pretrained weights are passed via `--pretrain /path/to/checkpoint.pth`."
+    )
+    return 0
+
+
+if __name__ == "__main__":  # pragma: no cover
+    raise SystemExit(main())

tenet_official-0.1.0/tenet_official/info.py

@@ -0,0 +1,65 @@
+"""Stable metadata and resource links for TENet.
+
+TENet is a research codebase (training/evaluation scripts), not a library, so
+this package intentionally ships metadata + resource pointers rather than
+importable model code. Use a source checkout of the repository to train/evaluate.
+"""
+
+from __future__ import annotations
+
+from dataclasses import dataclass, field
+from typing import Dict, List
+
+ARXIV_URL = "https://arxiv.org/abs/1905.02538"
+PROJECT_PAGE = "http://guochengqian.github.io/project/pixelshift200"
+REPOSITORY = "https://github.com/guochengqian/TENet"
+
+
+@dataclass(frozen=True)
+class Resource:
+    """A named external resource with a URL and short description."""
+
+    key: str
+    url: str
+    description: str
+
+
+# PixelShift200 dataset. The .mat files are 4-channel (R, Gr, Gb, B) full-color
+# captures produced by pixel-shift photography; original RAW (.ARW) files are
+# also provided. See the project page for details.
+PIXELSHIFT200: Dict[str, str] = {
+    "project_page": PROJECT_PAGE,
+    "google_drive": "https://drive.google.com/drive/folders/1S1mt9D8IlpSAVm7RTjLheh1hTaltsV_f?usp=share_link",
+}
+
+
+# TENet model variants available in the `model/` package of the repository
+# (built via `importlib.import_module("model.<name>").Net(args)`).
+MODELS: List[str] = [
+    "tenet",
+    "tenetv0",
+    "tenetv2",
+    "tenetv3",
+    "jdndmsr",
+    "jdndmsr_e2e",
+    "jdsr",
+    "resnet",
+]
+
+
+RESOURCES: Dict[str, Resource] = {
+    "paper": Resource("paper", ARXIV_URL, "TENet paper (arXiv:1905.02538, ICCP'22)"),
+    "code": Resource("code", REPOSITORY, "Training/evaluation source code"),
+    "project": Resource("project", PROJECT_PAGE, "PixelShift200 project page"),
+    "pixelshift200": Resource(
+        "pixelshift200",
+        PIXELSHIFT200["google_drive"],
+        "PixelShift200 dataset + original RAW files (Google Drive)",
+    ),
+}
+
+
+def resources() -> Dict[str, Resource]:
+    """Return the known TENet resources keyed by short name."""
+
+    return dict(RESOURCES)

tenet_official-0.1.0/tenet_official.egg-info/PKG-INFO

@@ -0,0 +1,212 @@
+Metadata-Version: 2.4
+Name: tenet_official
+Version: 0.1.0
+Summary: TENet (ICCP'22) release metadata and resource helpers for pip users: paper, PixelShift200 dataset, model list, and pretrained-weight loading info.
+Author: Guocheng Qian
+License-Expression: MIT
+Project-URL: Homepage, https://github.com/guochengqian/TENet
+Project-URL: Repository, https://github.com/guochengqian/TENet
+Project-URL: Paper, https://arxiv.org/abs/1905.02538
+Project-URL: Dataset, http://guochengqian.github.io/project/pixelshift200
+Keywords: demosaicing,denoising,super-resolution,ISP,raw,pytorch,TENet,PixelShift200
+Classifier: Development Status :: 3 - Alpha
+Classifier: Intended Audience :: Science/Research
+Classifier: Programming Language :: Python :: 3
+Classifier: Programming Language :: Python :: 3 :: Only
+Classifier: Programming Language :: Python :: 3.8
+Classifier: Programming Language :: Python :: 3.9
+Classifier: Programming Language :: Python :: 3.10
+Classifier: Programming Language :: Python :: 3.11
+Classifier: Programming Language :: Python :: 3.12
+Classifier: Topic :: Scientific/Engineering :: Artificial Intelligence
+Classifier: Topic :: Scientific/Engineering :: Image Processing
+Requires-Python: >=3.8
+Description-Content-Type: text/markdown
+License-File: LICENSE
+Provides-Extra: dev
+Requires-Dist: build>=1; extra == "dev"
+Requires-Dist: twine>=4; extra == "dev"
+Requires-Dist: pytest>=7; extra == "dev"
+Dynamic: license-file
+
+# TENet <a href="https://arxiv.org/abs/1905.02538" target="_blank">[ArXiv]</a> <a href="http://guochengqian.github.io/project/pixelshift200">[pixelshift200]</a> 
+
+### Rethinking Learning-based Demosaicing, Denoising, and Super-Resolution Pipeline
+By [Guocheng Qian*](https://guochengqian.github.io/), [Yuanhao Wang*](https://github.com/yuanhaowang1213), [Jinjin Gu](http://www.jasongt.com/), Chao Dong, Wolfgang Heidrich, Bernard Ghanem, [Jimmy S. Ren](http://www.jimmyren.com/)
+
+The original name of this project is: "Trinity of Pixel Enhancement: a Joint Solution for Demosaicking, Denoising and Super-Resolution"
+
+
+
+## TENet
+
+We insert the proposed pipeline DN -> SR -> DM into an end-to-end network constructed by RRDB for the joint DN, DM and SR. We leverage the detachable branch to provide the middle stage supervision. 
+
+
+<p align="center">
+  <img height="300" src="misc/Network.png">
+</p>
+
+
+
+
+## PixelShift200 dataset
+
+We employ advanced pixel shift technology to perform a full color sampling of the image.
+Pixel shift technology takes four samples of the same image, and physically controls the camera sensor to move one pixel horizontally or vertically at each sampling to capture all color information at each pixel.
+The pixel shift technology ensures that the sampled images follow the distribution of natural images sampled by the camera, and the full information of the color is completely obtained.
+In this way, the collected images are artifacts-free, which leads to better training results for demosaicing related tasks.
+
+<p align="center">
+  <img height="200" src="misc/PixelShift.png">
+</p>  
+
+
+Download PixelShift200 and the original RAW files from [pxielshift200 website](http://guochengqian.github.io/project/pixelshift200) for using this [Google Drive Link](https://drive.google.com/drive/folders/1S1mt9D8IlpSAVm7RTjLheh1hTaltsV_f?usp=share_link)
+
+
+### Environment installation
+
+Clone this github repo and install the environment by:
+
+```bash
+git clone https://github.com/guochengqian/TENet
+cd TENet
+source install.sh
+conda activate tenet
+```
+
+
+
+### Data preparation
+
+1. synthetic data preparation [Optional]
+   Processing synthetic dataset if you are interested in synthetic benchmark.
+   1. Download ([DIV2K](https://drive.google.com/file/d/1vXPPr2hVaMewz2JA1lFfI5uHB4ENwRXQ/view?usp=sharing)) dataset
+
+   2. `mkdir data && cd data`
+
+   3. Link DIV2K data into ./data/DIV2K, e.g. `ln -s /data/lowlevel/DIV2K ./` 
+
+   4. Crop DIV2K
+      
+      ```bash
+      cd ../datasets
+      python crop_imgs.py # crop train images
+      python crop_imgs.py --src_dir ../data/DIV2K/DIV2K_val5_HR --save_dir ../data/DIV2K/DIV2K_val5_HR_sub # crop val5 images
+      ```
+
+2. PixelShift200 data preparation 
+   Processing PixelShift200 dataset if you are interested in PixelShift200 benchmark.
+   1. Download [Pixelshift200](http://guochengqian.com/pixelshift200). They are .mat format, having 4 channels (R, Gr, Gb, B). Unzip the .zip file and put all folders inside into one folder called pixelshift200. For example, put here `/data/lowlevel/pixelshift200`. 
+
+   2. `cd TENet && mkdir data && cd data`
+
+   3. Link PixelShift200 data into ./data/pixelshift200, e.g. `ln -s /data/lowlevel/pixelshift200 pixelshift200` 
+
+   4. Crop images into 512*512, and generate the text file that contains the location of each image:
+
+      ```bash
+      cd ../datasets
+      python crop_pixelshift200.py 
+      python generate_datalist_pixelshift.py 
+      ```
+
+
+## Training
+#### Train  joint  models
+
+* DN+SR->DM (our **TENet**)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type raw --out_type linrgb --model tenet --n_gpus 4 --block rrdb  --n_blocks 12
+  ```
+
+* DN+DM+SR [Optional] (baseline: end to end without pipeline)
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model tenet --n_gpus 4 --block rrdb --n_blocks 12
+  ```
+
+  Note: 
+
+  1.  `--mid_type raw` is to activate the auxiliary mid stage supervision. Here we add `raw` as the supervision, therefore, the pipeline will be DN+SR->DM
+
+  2.  for training on a different dataset, like DIV2K, change `--dataset div2k` 
+   
+  3.  for training with Gaussian noise model, add `--noise_model g`
+
+  4.  for using a different building block, such as NLSA `--block nlsa`, or EAM `--block eam` , or RRG `--block rrg`, or DRLM `--block drlm` or RRDB `--block rrdb`
+
+  5.   [`wandb`](https://wandb.ai/) is used by default. Set `--no_wandb` to not using wandb 
+
+
+
+#### Train sequential models [Optional] (ablation study) 
+
+```bash
+# RawDN
+python train.py --in_type noisy_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RawSR
+python train.py --in_type lr_raw --out_type raw --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# DM
+python train.py --in_type raw --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBDN
+python train.py --in_type noisy_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+
+# RGBSR
+python train.py --in_type lr_linrgb --out_type linrgb --model resnet --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block rrdb --n_blocks 12
+```
+
+
+### Train SOTA models [Optional]
+We also support training previous work. 
+
+* JDSR
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type None --out_type linrgb --model jdsr --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4  --use_wandb --block res --n_blocks 12 --channels 256
+  ```
+
+* JDnDmSR
+
+  ```bash
+  python train.py --in_type noisy_lr_raw --mid_type lr_raw --out_type linrgb --model jdndmsr --scale 2 --train_list datasets/train_pixelshift.txt --val_list datasets/val_pixelshift.txt --n_gpus 4 --n_blocks 2 --block rcab
+  ```
+
+
+## Testing
+
+```bash
+bash script_all_pipelines.sh 
+```
+This script supports evaluation on all benchmarking datasets as well as the real-shot images for all possible pipelines. Check this script for details 
+
+
+Note: for the real shot images testing, you have to:
+
+1.  save the real-shot image as a readable raw image (like in .RAW, .ARW, .DNG format).  For example,  we use Lightroom mobile version to shot images on iPhone and save the photo in .DNG format.
+2. Read the general metadata using RawPy and read the noise profiling metadata using [Jeffrey's Image Metadata Viewer](http://exif.regex.info/exif.cgi) or [metapicz](http://metapicz.com/). 
+
+
+
+## Result
+<p align="center">
+  <img width="800" src="misc/pipeline_result.png">
+</p>
+
+
+### Citation 
+
+Please cite the following paper if you feel TENet and PixelShift200 is useful to your research
+
+```
+@article{qian2019rethink,
+  title={Rethink the Pipeline of Demosaicking, Denoising, and Super-resolution},
+  author={Qian, Guocheng and Wang, Yuanhao and Gu, Jinjin and Dong, Chao and  Heidrich, Wolfgang and Ghanem, Bernard and Ren, Jimmy S},
+  journal={arXiv preprint arXiv:1905.02538},
+  year={2019}
+}
+```

tenet_official-0.1.0/tenet_official.egg-info/SOURCES.txt

@@ -0,0 +1,13 @@
+LICENSE
+README.md
+pyproject.toml
+tenet_official/__init__.py
+tenet_official/cli.py
+tenet_official/info.py
+tenet_official.egg-info/PKG-INFO
+tenet_official.egg-info/SOURCES.txt
+tenet_official.egg-info/dependency_links.txt
+tenet_official.egg-info/entry_points.txt
+tenet_official.egg-info/not-zip-safe
+tenet_official.egg-info/requires.txt
+tenet_official.egg-info/top_level.txt

tenet_official-0.1.0/tenet_official.egg-info/dependency_links.txt

@@ -0,0 +1 @@
+

tenet_official-0.1.0/tenet_official.egg-info/entry_points.txt

@@ -0,0 +1,2 @@
+[console_scripts]
+tenet-info = tenet_official.cli:main

tenet_official-0.1.0/tenet_official.egg-info/not-zip-safe

@@ -0,0 +1 @@
+

tenet_official-0.1.0/tenet_official.egg-info/requires.txt

@@ -0,0 +1,5 @@
+
+[dev]
+build>=1
+twine>=4
+pytest>=7

tenet_official-0.1.0/tenet_official.egg-info/top_level.txt

@@ -0,0 +1 @@
+tenet_official