mulmocast 1.1.4 → 1.1.6

package/scripts/test/test_order.json

@@ -0,0 +1,69 @@
+{
+  "$mulmocast": { "version": "1.1" },
+  "lang": "en",
+  "beats": [
+    {
+      "text": "The number 1 stands alone—independent, bold, and often lonely. In stories, the lone hero begins their journey without companions, carving their path through courage. Think of Neo in The Matrix, 'The One', chosen to awaken humanity. Or the number 1 in binary—on or off, light or dark. It reminds us that every great movement starts with a single step, a single decision. Just one person can spark a revolution or change history. As Lao Tzu said, 'The journey of a thousand miles begins with one step.'",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 1", "# one"]
+      }
+    },
+    {
+      "text": "Two is the number of connection. In myth, it's often the number of lovers, twins, or duels. Adam and Eve, Sun and Moon, Sherlock and Watson. It's the smallest number that introduces the concept of 'the other'. In quantum physics, entangled particles influence each other instantly, no matter the distance. In life, two minds can spark ideas one alone could never imagine. 'It takes two to tango' is more than a dance—it's a truth about collaboration and tension, the dance of opposites that moves the world forward.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 2", "# two"]
+      }
+    },
+    {
+      "text": "Three is the storyteller’s favorite. Three acts, three trials, three wishes—our minds love the rhythm. In fairy tales, the youngest of three siblings often prevails, defying expectations. Christianity has the Holy Trinity. In time, we speak of past, present, and future. Philosophers speak of thesis, antithesis, and synthesis. There’s something satisfying about the triangle: it’s stable, dynamic, and complete. As the saying goes, 'Third time’s the charm.' It’s as if the universe speaks in triplets, offering clarity where one or two might falter.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 3", "# three"]
+      }
+    },
+    {
+      "text": "Four is a number of structure. We see it in the four cardinal directions—north, south, east, and west—framing our understanding of space. Ancient elements often came in fours: earth, water, air, and fire. In East Asia, four can be ominous, sounding like 'death' in some languages. Yet in many traditions, four symbolizes balance. A chair stands on four legs. The year cycles through four seasons. Jung described four functions of consciousness—thinking, feeling, sensing, and intuiting. It’s a square, solid and grounding.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 4", "# four"]
+      }
+    },
+    {
+      "text": "「5」は、私たちが世界に触れる方法です。片手に5本の指、片足に5本の足指を持ち、私たちは世界を探り、築き、動きます。私たちは、視覚・聴覚・嗅覚・味覚・触覚という5つの感覚を通じて人生を体験します。日本の哲学では「五大」として、地・水・火・風・空の5つの要素が存在します。西洋では、五芒星（ペンタグラム）がバランスや守護の象徴として用いられてきました。それは両手両足を広げた人の姿にも見えます。\n「5」という数字は、私たち人間の経験そのもの――好奇心、感覚、そして意味を求めて生きる姿を映し出しています。",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 5", "# five"]
+      }
+    },
+    {
+      "text": "Six is often seen as a number of harmony and order. In geometry, the hexagon is one of the most efficient and natural forms—think honeycombs or snowflakes. In Christianity, God created the world in six days. In music, a sixth interval is sweet and stable. In chemistry, carbon has six protons—this one element is the foundation of all life. In dice, six is the highest you can roll, often bringing fortune. And in ancient numerology, six represented responsibility and care—it's the number of the caregiver and the homebuilder.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 6", "# six"]
+      }
+    },
+    {
+      "text": "Seven is a number shrouded in mystery. There are seven colors in the rainbow, seven days in a week, seven continents, and seven wonders of the ancient world. In literature, it's often a sacred or magical number—Harry Potter had seven horcruxes, Snow White had seven dwarves. In many religions, seven is divine: the seventh heaven, the seven chakras, the seven deadly sins. Mathematically, it’s a prime—indivisible, unique. It’s said that humans can best remember seven things at once. Something about it just feels… complete.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 7", "# seven"]
+      }
+    },
+    {
+      "text": "Eight is a number of abundance and eternity. Turned on its side, it becomes the infinity symbol. In Chinese culture, 8 is extremely lucky, sounding like wealth or fortune. The Olympics in Beijing began on 8/8/08 at 8:08:08 PM for this reason. In Buddhism, the Eightfold Path outlines the steps toward enlightenment. Spiders have eight legs—symbols of patience and precision. Even in music, an octave spans eight notes. It’s the number of cycles, rebirths, and limitless potential—forever looping like a serpent eating its tail.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 8", "# eight"]
+      }
+    },
+    {
+      "text": "Nine signals the end of a cycle. In pregnancy, it marks the final month before birth. In Norse mythology, there are nine worlds. In Dante’s Inferno, nine circles define Hell. Cats are said to have nine lives—resilient and mysterious. In Japanese culture, the number can be unlucky, associated with suffering. But it’s also powerful: the last single-digit number, composed of three threes. In mathematics, multiplying nine always returns to itself—18 becomes 1+8=9. It's the threshold, the peak before transformation begins again.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 9", "# nine"]
+      }
+    }
+  ]
+}

package/scripts/test/test_order_portrait.json

@@ -0,0 +1,73 @@
+{
+  "$mulmocast": { "version": "1.1" },
+  "lang": "en",
+  "canvasSize": {
+    "width": 720,
+    "height": 1280
+  },
+  "beats": [
+    {
+      "text": "The number 1 stands alone—independent, bold, and often lonely. In stories, the lone hero begins their journey without companions, carving their path through courage. Think of Neo in The Matrix, 'The One', chosen to awaken humanity. Or the number 1 in binary—on or off, light or dark. It reminds us that every great movement starts with a single step, a single decision. Just one person can spark a revolution or change history. As Lao Tzu said, 'The journey of a thousand miles begins with one step.'",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 1", "# one"]
+      }
+    },
+    {
+      "text": "Two is the number of connection. In myth, it's often the number of lovers, twins, or duels. Adam and Eve, Sun and Moon, Sherlock and Watson. It's the smallest number that introduces the concept of 'the other'. In quantum physics, entangled particles influence each other instantly, no matter the distance. In life, two minds can spark ideas one alone could never imagine. 'It takes two to tango' is more than a dance—it's a truth about collaboration and tension, the dance of opposites that moves the world forward.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 2", "# two"]
+      }
+    },
+    {
+      "text": "Three is the storyteller’s favorite. Three acts, three trials, three wishes—our minds love the rhythm. In fairy tales, the youngest of three siblings often prevails, defying expectations. Christianity has the Holy Trinity. In time, we speak of past, present, and future. Philosophers speak of thesis, antithesis, and synthesis. There’s something satisfying about the triangle: it’s stable, dynamic, and complete. As the saying goes, 'Third time’s the charm.' It’s as if the universe speaks in triplets, offering clarity where one or two might falter.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 3", "# three"]
+      }
+    },
+    {
+      "text": "Four is a number of structure. We see it in the four cardinal directions—north, south, east, and west—framing our understanding of space. Ancient elements often came in fours: earth, water, air, and fire. In East Asia, four can be ominous, sounding like 'death' in some languages. Yet in many traditions, four symbolizes balance. A chair stands on four legs. The year cycles through four seasons. Jung described four functions of consciousness—thinking, feeling, sensing, and intuiting. It’s a square, solid and grounding.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 4", "# four"]
+      }
+    },
+    {
+      "text": "Five is how we touch the world. With five fingers on each hand and five toes on each foot, we explore, build, and move. We experience life through five senses: sight, hearing, smell, taste, and touch. In Japanese philosophy, 'Godai' outlines five elements: earth, water, fire, wind, and void. In the West, the pentagram has been used as a symbol of balance and protection. It’s also a human shape—arms and legs spread wide. The number five reflects our human experience: curious, sensory, and striving for meaning.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 5", "# five"]
+      }
+    },
+    {
+      "text": "Six is often seen as a number of harmony and order. In geometry, the hexagon is one of the most efficient and natural forms—think honeycombs or snowflakes. In Christianity, God created the world in six days. In music, a sixth interval is sweet and stable. In chemistry, carbon has six protons—this one element is the foundation of all life. In dice, six is the highest you can roll, often bringing fortune. And in ancient numerology, six represented responsibility and care—it's the number of the caregiver and the homebuilder.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 6", "# six"]
+      }
+    },
+    {
+      "text": "Seven is a number shrouded in mystery. There are seven colors in the rainbow, seven days in a week, seven continents, and seven wonders of the ancient world. In literature, it's often a sacred or magical number—Harry Potter had seven horcruxes, Snow White had seven dwarves. In many religions, seven is divine: the seventh heaven, the seven chakras, the seven deadly sins. Mathematically, it’s a prime—indivisible, unique. It’s said that humans can best remember seven things at once. Something about it just feels… complete.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 7", "# seven"]
+      }
+    },
+    {
+      "text": "Eight is a number of abundance and eternity. Turned on its side, it becomes the infinity symbol. In Chinese culture, 8 is extremely lucky, sounding like wealth or fortune. The Olympics in Beijing began on 8/8/08 at 8:08:08 PM for this reason. In Buddhism, the Eightfold Path outlines the steps toward enlightenment. Spiders have eight legs—symbols of patience and precision. Even in music, an octave spans eight notes. It’s the number of cycles, rebirths, and limitless potential—forever looping like a serpent eating its tail.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 8", "# eight"]
+      }
+    },
+    {
+      "text": "Nine signals the end of a cycle. In pregnancy, it marks the final month before birth. In Norse mythology, there are nine worlds. In Dante’s Inferno, nine circles define Hell. Cats are said to have nine lives—resilient and mysterious. In Japanese culture, the number can be unlucky, associated with suffering. But it’s also powerful: the last single-digit number, composed of three threes. In mathematics, multiplying nine always returns to itself—18 becomes 1+8=9. It's the threshold, the peak before transformation begins again.",
+      "image": {
+        "type": "markdown",
+        "markdown": ["# 9", "# nine"]
+      }
+    }
+  ]
+}

package/scripts/test/test_replicate.json

@@ -0,0 +1,145 @@
+{
+  "$mulmocast": { "version": "1.1" },
+  "movieParams": {
+    "provider": "replicate",
+    "model": "bytedance/seedance-1-lite"
+  },
+  "audioParams": {
+    "bgmVolume": 0
+  },
+  "captionParams": {
+    "lang": "en"
+  },
+  "lang": "en",
+  "beats": [
+    {
+      "text": "movie generations by various text-to-movie models",
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "PROMPT: a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses"
+        }
+      }
+    },
+    {
+      "id": "veo-2",
+      "text": "google/veo-2",
+      "duration": 5,
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "google/veo-2"
+      }
+    },
+    {
+      "id": "veo-3",
+      "text": "google/veo-3 with sound effect",
+      "duration": 8,
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "google/veo-3"
+      }
+    },
+    {
+      "id": "veo-3-fast with sound effect",
+      "text": "google/veo-3-fast",
+      "duration": 8,
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "google/veo-3-fast"
+      }
+    },
+    {
+      "id": "seedance-1-lite",
+      "text": "bytedance seedance-1-lite",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "duration": 5
+    },
+    {
+      "id": "seedance-1-lite-gpt4-image",
+      "text": "bytedance seedance-1-lite with gpt4-image",
+      "imagePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "duration": 5
+    },
+    {
+      "id": "seedance-1-lite-gpt4-image-no-movie-prompt",
+      "text": "bytedance seedance-1-lite with gpt4-image, no movie prompt",
+      "imagePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "moviePrompt": " ",
+      "duration": 5
+    },
+    {
+      "id": "seedance-1-pro",
+      "text": "bytedance/seedance-1-pro",
+      "duration": 5,
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "bytedance/seedance-1-pro"
+      }
+    },
+    {
+      "id": "video-01",
+      "text": "minimax/video-01",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "minimax/video-01"
+      }
+    },
+    {
+      "id": "kling-v1.6-pro",
+      "text": "kwaivgi/kling-v1.6-pro with gpt4-image",
+      "imagePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "kwaivgi/kling-v1.6-pro"
+      }
+    },
+    {
+      "id": "kling-v2.1",
+      "text": "kwaivgi/kling-v2.1 with gpt4-image",
+      "imagePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "kwaivgi/kling-v2.1"
+      }
+    },
+    {
+      "id": "hailuo-02",
+      "text": "minimax/hailuo-02",
+      "duration": 6,
+      "moviePrompt": "televised footage of a cat is doing an acrobatic dive into a swimming pool at the olympics, from a 10m high diving board, flips and spins",
+      "movieParams": {
+        "model": "minimax/hailuo-02"
+      }
+    },
+    {
+      "id": "hailuo-02-image",
+      "text": "minimax/hailuo-02 with ghibli-styleimage",
+      "duration": 6,
+      "imagePrompt": "a cat is doing an acrobatic dive into a swimming pool at the olympics, from a 10m high diving board, Ghibli style",
+      "moviePrompt": "televised footage of a cat is doing an acrobatic dive into a swimming pool at the olympics, from a 10m high diving board, flips and spins",
+      "movieParams": {
+        "model": "minimax/hailuo-02"
+      }
+    },
+    {
+      "id": "wan-2.2-i2v-480p-fast",
+      "text": "wan-video/wan-2.2-i2v-480p-fast",
+      "duration": 5,
+      "imagePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "wan-video/wan-2.2-i2v-480p-fast"
+      }
+    },
+    {
+      "id": "wan-2.2-t2v-480p-fast",
+      "text": "wan-video/wan-2.2-t2v-480p-fast",
+      "duration": 5,
+      "moviePrompt": "a woman is walking through a busy Tokyo street at night, she is wearing dark sunglasses",
+      "movieParams": {
+        "model": "wan-video/wan-2.2-t2v-480p-fast"
+      }
+    }
+  ]
+}

package/scripts/test/test_slideout_left_no_audio.json

@@ -0,0 +1,46 @@
+{
+  "$mulmocast": {
+    "version": "1.1"
+  },
+  "lang": "en",
+  "title": "Transition Test",
+  "movieParams": {
+    "transition": {
+      "type": "slideout_left",
+      "duration": 1.0
+    }
+  },
+  "beats": [
+    {
+      "speaker": "Presenter",
+      "text": "",
+      "image": {
+        "type": "image",
+        "source": {
+          "kind": "path",
+          "path": "../../assets/images/mulmocast_credit.png"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "duration": 3.0,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "3.0 second with no Audio"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "image": {
+        "type": "movie",
+        "source": {
+          "kind": "url",
+          "url": "https://github.com/receptron/mulmocast-media/raw/refs/heads/main/test/pingpong.mov"
+        }
+      }
+    }
+  ]
+}

package/scripts/test/test_sound_effect.json

@@ -0,0 +1,41 @@
+{
+  "$mulmocast": { "version": "1.1" },
+  "movieParams": {
+    "provider": "replicate",
+    "model": "bytedance/seedance-1-lite"
+  },
+  "audioParams": {
+    "bgmVolume": 0.01,
+    "suppressSpeech": true
+  },
+  "captionParams": {
+    "lang": "en"
+  },
+  "lang": "en",
+  "beats": [
+    {
+      "id": "horse_galloping",
+      "text": "A horse galloping",
+      "duration": 10,
+      "imagePrompt": "A wide view of a horse galloping fast in a large field",
+      "moviePrompt": "A horse galloping fast in a large field",
+      "soundEffectPrompt": "galloping"
+    },
+    {
+      "id": "cat_jumping_into_pool",
+      "text": "cat jumping into a swimming pool",
+      "duration": 10,
+      "imagePrompt": "A televised view of a cat is on a 10m high jumping board, preparing to jump into a swimming pool at the olympics",
+      "moviePrompt": "televised footage of a cat is doing an acrobatic dive into a swimming pool at the olympics, from a 10m high diving board, flips and spins",
+      "soundEffectPrompt": "sound of a cat jumping into a swimming pool"
+    },
+    {
+      "id": "ice cutting",
+      "text": "Cutting ice with a sharp knife",
+      "duration": 10,
+      "imagePrompt": "Close up of a sharp knife is ready to cut a slice out of a block ofice",
+      "moviePrompt": "Close up of a sharp knife is cutting a slice out of a block of ice",
+      "soundEffectPrompt": "cutting ice"
+    }
+  ]
+}

package/scripts/test/test_spillover.json

@@ -0,0 +1,117 @@
+{
+  "$mulmocast": {
+    "version": "1.1"
+  },
+  "lang": "en",
+  "title": "Spillover Test",
+  "beats": [
+    {
+      "text": "This beat has a long audio, which exceeds the beat duration.",
+      "duration": 2,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "1. Has Text. Duration = 2."
+        }
+      }
+    },
+    {
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "2. Default duration = 1. Expected spillover."
+        }
+      }
+    },
+    {
+      "text": "This beat has a really long audio, which clearly exceeds the beat duration.",
+      "duration": 1,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "3. Has Text. Duration = 1."
+        }
+      }
+    },
+    {
+      "duration": 2,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "4. Duration = 2. Expected spillover."
+        }
+      }
+    },
+    {
+      "duration": 1,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "5. Duration = 1, Expected spillover."
+        }
+      }
+    },
+    {
+      "text": "This beat has a really long audio, which is shared among three beats.",
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "6. Has Text. No duration."
+        }
+      }
+    },
+    {
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "7. No duration. Expected even-split spillover."
+        }
+      }
+    },
+    {
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "8. No duration. Expected even-split spillover."
+        }
+      }
+    },
+    {
+      "duration": 1.5,
+      "text": "This beat has a short audio.",
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "9. Has Text. No duration."
+        }
+      }
+    },
+    {
+      "duration": 1,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "10. No duration. Expected some spillover."
+        }
+      }
+    },
+    {
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "11. No duration. Expected no spillover."
+        }
+      }
+    },
+    {
+      "duration": 1,
+      "text": "This beat has a short audio.",
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "12. Has Text. No duration."
+        }
+      }
+    }
+  ]
+}

package/scripts/test/test_transition.json

@@ -0,0 +1,56 @@
+{
+  "$mulmocast": {
+    "version": "1.1"
+  },
+  "lang": "en",
+  "title": "Transition Test",
+  "movieParams": {
+    "transition": {
+      "type": "fade",
+      "duration": 1.0
+    }
+  },
+  "beats": [
+    {
+      "speaker": "Presenter",
+      "text": "This is a local image.",
+      "image": {
+        "type": "image",
+        "source": {
+          "kind": "path",
+          "path": "../../assets/images/mulmocast_credit.png"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "duration": 3.0,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "3.0 second with no Audio"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "image": {
+        "type": "movie",
+        "source": {
+          "kind": "url",
+          "url": "https://github.com/receptron/mulmocast-media/raw/refs/heads/main/test/pingpong.mov"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "text": "This is a text slide with audio.",
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "Text Slide with Audio"
+        }
+      }
+    }
+  ]
+}

package/scripts/test/test_transition_no_audio.json

@@ -0,0 +1,46 @@
+{
+  "$mulmocast": {
+    "version": "1.1"
+  },
+  "lang": "en",
+  "title": "Transition Test",
+  "movieParams": {
+    "transition": {
+      "type": "fade",
+      "duration": 1.0
+    }
+  },
+  "beats": [
+    {
+      "speaker": "Presenter",
+      "text": "",
+      "image": {
+        "type": "image",
+        "source": {
+          "kind": "path",
+          "path": "../../assets/images/mulmocast_credit.png"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "duration": 3.0,
+      "image": {
+        "type": "textSlide",
+        "slide": {
+          "title": "3.0 second with no Audio"
+        }
+      }
+    },
+    {
+      "speaker": "Presenter",
+      "image": {
+        "type": "movie",
+        "source": {
+          "kind": "url",
+          "url": "https://github.com/receptron/mulmocast-media/raw/refs/heads/main/test/pingpong.mov"
+        }
+      }
+    }
+  ]
+}