AI short-video and Reels workflows

Document type
Atlas
Updated
Reading time
14 min

Compare reference-video analysis, scripting, editing, Remotion and model generation across 10 AI short-video projects, with setup paths, A/B/C production routes, manual handoffs and cost limits.

Source
Document details

Operating boundaries for reference research, scripts, editing and generation tools, with three production combinations.

Included projects
10Original table order retained
Production routes
3Faceless videos, creators, products and drama

01Sources and verification

Scope

The original Gemini HTML lists 10 GitHub projects; their table order and A/B/C production scenarios are retained here. Capabilities, setup paths and limits follow corrections against official README, skill-file and code snapshots fetched on 2026-11-04. The original HTML is saved separately for comparison.

DeliverableContentsNext action
Research cards and scriptsSources, view counts, transcripts, opening structure and adapted scriptsCheck the original video and source data, then film your own footage
Prompts and storyboardsShots, timing, characters, sound effects and reference-image requirementsSend them to a configured model service or paste them manually into a generation interface
Executable programsLocal editing, Remotion, API calls or composition workflowsInstall dependencies, configure credentials and inspect the finished video

02Original order10 projects

Project catalog

Entry numbers follow the original report's order; they do not rank quality or popularity.

Rank 01/10

Melvynx/video-agent-skills

video-agent-skills

Creator scripts, reference styles and local editing

Provides skills including /outliers, /steal and /short-editing; the editing engine uses Node, Chrome, ffmpeg and whisper.cpp. Instagram/TikTok research depends on Treg, and some calls require payment; captions still need manual proofreading.

  • Research
  • Editing engine
  • MIT

Rank 02/10

raydenai/viral-video-creation

Viral Video Lab

Higgsfield CLI experiments and reference-video analysis

The standalone local lab includes rendering, batch variants, model comparisons and scoring records, with separate Mode B/C skill guides. Install the Higgsfield CLI and configure the service yourself. Scheduled publishing is outside the current lab's scope; no declared license was found.

  • Higgsfield
  • CLI
  • License unconfirmed

Rank 03/10

w-avw/instagram-viral-reels-research-claude-skill

Instagram Viral Reels Research

Reels filtering, transcripts and script research cards

Filters reference videos using the skill's view thresholds and account baselines, then extracts frames, transcribes and produces formulas and branded adaptations. Requires signed-in Chrome, OpenCLI, Agent-Reach, ffmpeg and faster-whisper; check source data and opening speech manually.

  • Instagram
  • Script research
  • MIT

Rank 04

JohnChow90/video-shotcraft

video-shotcraft

Shot recipes, Remotion examples and a motion-design workbench

Includes shot cards, TSX motion examples and product-video workflows, with motion graphics generated and rendered in code. This repository's README setup path points to Vincentwei1021/video-shotcraft; choose the source revision before adoption. Remotion has separate license terms.

  • Product motion
  • Remotion
  • Apache-2.0

Rank 05

rediumvex/ai-video-generator-claude

AI Video Generator — Claude Skill

Seedance directing prompts

10 prompt skills cover faceless content, openings, products and brand videos, producing text with timing, shots, lighting and sound effects. The README workflow is to paste the result into Higgsfield; installing the skills does not create a model account or automatically generate an MP4.

  • Prompts
  • Seedance
  • MIT

Rank 06

calesthio/generative-media-skills

Generative Media Skills

Cross-media production knowledge and checking tools

Covers model providers, short videos, sound, captions and delivery checks. Some skills include Python validation scripts; model guides and checking scripts have distinct purposes. Loading a guide does not configure a model API or complete a video-content review.

  • Production guides
  • Quality checks
  • MIT

Rank 07

worldwonderer/drama-skills

drama-skills

Drama documents, character assets and storyboards

The source currently redirects to zenstory-ai/drama-skills, providing workflows for scripts, assets, storyboards, video prompts, production and review. Character definitions and reference images support continuity checks; inspect the finished sequence shot by shot.

  • Short drama
  • Storyboards
  • MIT

Rank 08

vyralcontent/content-skills

Vyral Content skills

Guidance for openings, scripts and platform tests

Provides text skills such as viral-hooks and viral-instagram-reels for writing, checking and planning tests. Platform metrics and strategies are recommendations within the skills. The repository is not a paid video database and does not read account results or generate videos itself.

  • Scripts
  • Reels
  • MIT

Rank 09

harry0703/MoneyPrinterTurbo

MoneyPrinterTurbo

From a topic to voiceover, captions and video composition

Works through an Agent, WebUI, API or CLI; the official skill includes the mpt_agent.py execution helper. Prepare footage sources, voice, LLM and video services according to configuration. External generation may incur charges, and the finished video and captions need separate review.

  • Video composition
  • Agent CLI
  • MIT

Rank 10

HKUDS/ViMax

ViMax

Narrative planning and multi-shot generation framework

Combines narrative, reference images, video generation and assembly, with a TUI and Web UI. Configure LLM, image and video providers and API keys. Visual consistency is a generation and review objective, without a guarantee of identical character appearance.

  • Multi-shot
  • Generation framework
  • MIT

03Filtering and analysis

Reference-video research

Melvynx account baselines and style files

/outliers defaults to filtering outliers at 3 times a competitor account's own median views, or 2 times for your own account, excluding sponsored videos; it marks query windows with fewer than 10 videos as insufficient and does not rank them. Results go to video-agent/outliers/, with 5 adapted scripts generated by default in video-agent/scripts/. These research filters do not establish that a particular editing method caused view growth.

/steal examines cuts, layouts, captions, sound effects and volume in a reference video, then creates video-agent/styles/<name>/style.json and STYLE.md. Generate a test video with /short-editing <take> style <name>, compare it with the reference and decide whether to adopt the style. Styles must fit the engine's supported layouts; inputs should include videos you have rights to use, your own footage and visual elements to keep or exclude.

Instagram research skill thresholds

The general viral-outliers threshold is at least 700,000 views and at least 5 times the account's follower count. For accounts above 500,000 followers, the skill instead uses 5 times the account's own median views. These are the project's methods, not official Instagram recommendation rules.

Research cards should retain the source URL, retrieval time, view count and follower count, checked against the original video. The skill requires reviewing at least 6 frames, increasing to 10 to 12 for fast cuts, and verifying the opening transcript. A first line labeled [ 0.0s] does not by itself prove the speech has no missing words; listen to the original opening.

raydenai Mode B and Mode C

Mode B in the viral-video-creator skill describes frame extraction, OCR, Whisper, vision-model analysis and prompt assembly. Mode C describes variants that hold the subject fixed while changing the opening or other elements. Check which capabilities the program actually provides before running it; steps in the skill may require separately prepared tools.

The current lab/replicate.py extracts frames at 3 fps, sends at most 12 frames to Claude Vision and writes stories/replications/<source-id>/shotlist.yaml for review and revision. It does not implement OCR or Whisper transcription. Extract and verify opening speech and on-screen text separately when needed; sampled frames cannot establish the full script.

04Prompts, programs and models

Production and rendering boundaries

OptionDeliverableRequired handoff
Melvynx /short-editingLocally edited MP4, SRT and post textSupply your own raw footage and proofread names, numbers and caption timing
rediumvexPrompts with timing, camera moves, lighting and sound effectsPaste into Higgsfield manually, choose an available model, configure generation settings and download the result
video-shotcraftShot recipes and Remotion code/examplesChoose the source revision, supply product assets, install rendering dependencies and inspect the preview
generative-media-skillsProduction guides and some executable media checksRead each selected skill's prerequisites and pass actual media files to the checking scripts
MoneyPrinterTurboVoiceover, footage, captions and video compositionConfigure the LLM and asset providers, confirm generation costs and inspect the final output
drama-skills/ViMaxScripts, assets, storyboards and multi-shot generation workflowsMaintain character references and check every shot; convert input files between the two projects yourself

Melvynx's default edit removes pauses longer than 0.3 seconds, uses 1.15 times speed and targets -14 LUFS for voice. These are default style settings. Preview before adopting them when instructional steps, accents or music requirements differ.

05Operating preparation

Setup paths and first checks

Run these documented commands in your own production project after reading the corresponding skill, installer and dependency versions. This review did not execute these installation or generation steps.

Creator editing on a local machine

Install the skills in the project folder, then run /studio-setup in Claude Code. Required tools include Node 20+, Git and ffmpeg. Download/research workflows also require yt-dlp and Deno; initial setup prepares Chrome/Chromium and whisper.cpp.

bash
npx skills add Melvynx/video-agent-skills -a claude-code

Place recorded footage in video-agent/takes/ and run /short-editing. Inspect video-agent/edits/short-<slug>/output/short-<slug>.mp4 and the SRT; Instagram/TikTok research and automatic publishing require a separate Treg setup.

Instagram research cards

bash
git clone https://github.com/w-avw/instagram-viral-reels-research-claude-skill
mkdir -p .claude/skills
cp -r instagram-viral-reels-research-claude-skill/skills/viral-outliers .claude/skills/
agent-reach doctor --json
opencli doctor

Prepare Agent-Reach, OpenCLI, ffmpeg, faster-whisper and Chrome signed into Instagram and connected to the OpenCLI extension. Edit .claude/skills/viral-outliers/references/brand-profile.md in the installed copy with your topic, audience, tone and filming constraints. opencli doctor should show that the extension is connected.

After a research run, check that the Markdown cards include an accessible original video, the complete opening transcript and your adapted script. This skill is limited to reading; it does not follow, like or publish for you.

Higgsfield experiment lab

bash
git clone https://github.com/raydenai/viral-video-creation.git
cd viral-video-creation
python3 -m venv venv
./venv/bin/pip install -r requirements.txt
higgsfield account status
./venv/bin/python lab/render.py --prompt "slow cinematic push-in on a coffee mug, soft window light" --dry-run

Install the Higgsfield CLI separately and sign into your own account; visual analysis and pattern extraction also use an Anthropic API key, while reference analysis needs yt-dlp and ffmpeg/ffprobe. --dry-run checks price quotes and should not produce a paid video; before rendering, check the model, duration, quality and credits. Lab output goes to gallery/; scheduled publishing is outside the current scope.

Remotion template preview

bash
git clone https://github.com/JohnChow90/video-shotcraft.git
cd video-shotcraft/template
npm install
npx remotion render src/index.ts AiflPromo out/promo.mp4

These commands render the repository's included demo without substituting your product. The template is configured for 1920×1080 at 30 fps; adjust aspect ratio and layout for Reels instead of assuming a vertical or 60 fps default. Confirm the demo renders before replacing product assets and text according to the shot cards.

Seedance prompts

bash
git clone https://github.com/rediumvex/ai-video-generator-claude.git
mkdir -p .claude/skills
cp -r ai-video-generator-claude/skills/01-viral-hook .claude/skills/
cp -r ai-video-generator-claude/skills/05-faceless-channel .claude/skills/

These commands copy only the opening and faceless-content skills; restart Claude Code before using them. Supply the video duration, topic, product, aspect ratio and visual constraints, then check the output prompt's timing and asset requirements before handing it to Higgsfield manually. Test one segment first to check the shots and visual content.

MoneyPrinterTurbo Agent helper

Prepare uv and an Agent with terminal, file and long-running execution support. The official skill's helper is at docs/skill/mpt_agent.py; run from that directory:

bash
git clone https://github.com/harry0703/MoneyPrinterTurbo.git
cd MoneyPrinterTurbo/docs/skill
uv run --no-project --python 3.11 python mpt_agent.py --subject "Practical AI tools for daily work"

Read docs/skill/SKILL.md first; this entry point supports macOS and Windows and defaults to a Chinese vertical video, Pexels assets and Edge TTS. Supply missing credentials as indicated by the output; when a paid video provider requests cost confirmation, confirm before rerunning. Success output includes MPT_RESULT, VIDEO_FILE and TASK_DIR; open the MP4 to check captions, voiceover and whether the assets fit the topic.

06Faceless AI

Route A: Faceless AI video

The proposed combination is raydenai/viral-video-creation and rediumvex/ai-video-generator-claude, with MoneyPrinterTurbo added when needed. Hand off files or text at each step, checking formats on both sides first.

  1. Choose a reference video you have rights to use and record its opening, shot purposes, text and sound effects. When using rayden's analysis tools or Mode B guidance, inspect the actual artifacts and separately perform transcription and on-screen text checks not completed by the tools.

  2. Adapt the verified structure to your topic and use rediumvex to produce prompts. Retain timing and shot intent while replacing assets, dialogue and brand elements; generate in Higgsfield manually and select usable clips.

  3. For voiceover and captions, prepare readable assets and scripts for the selected MoneyPrinterTurbo workflow. Check how local assets are supplied before composing a short video; convert analysis JSON from other projects yourself.

07Creator & Talking Head

Route B: Creator and educational videos

The proposed combination is the Instagram research skill, Melvynx skills and vyralcontent/content-skills. Inputs include your brand information and recorded footage; outputs are a filmable script and an edited video.

  1. Organize references using either the Instagram research skill's thresholds or Melvynx /outliers account-median filter. Record the two thresholds separately with query times to avoid mixing figures from different datasets.

  2. Extract reusable narrative structures, then use viral-hooks and viral-instagram-reels to check openings, dialogue and the test plan. Sends Per Reach and Trial Reels are strategies discussed in the skills; available metrics and test entry points depend on the account interface.

  3. Film the adapted script yourself. If using /steal, check the style files and test video first, then process your raw footage with /short-editing; verify proper names, caption cuts and the CTA word by word.

08Product Promo & AI Drama

Route C: Product motion and AI drama

Use JohnChow90/video-shotcraft shot cards and its Remotion workflow for product motion, and worldwonderer/drama-skills for drama. Evaluate HKUDS/ViMax when an executable generation framework is needed. Produce and review the two deliverable types separately.

Product and SaaS demos

  1. Prepare actual product screens, the Logo, feature descriptions and video duration, then choose a presentation approach from the shot cards. Choose either the original list's JohnChow90 version or the Vincentwei1021 source linked by its README; avoid mixing revisions.

  2. Have the Agent build a Remotion project or adjust an example from the selected cards, then inspect aspect ratio, text and product operation. The original source also mentions remotion-dev/skills; it is not included among this report's 10 verified projects.

  3. Render an MP4 after the preview passes. Check UI text, buttons and cropping frame by frame, and confirm commercial use complies with the separate Remotion and asset licenses.

Narrative drama and character continuity

ViMax requires Python 3.12+ and uv; the README lists Linux/Windows environments. The Web UI also needs Node 18+. Create private configs/agent.local.yaml from configs/agent.example.yaml, then enter models, endpoints and credentials for the selected LLM, image and video services.

  1. In drama-skills, create the script, character/scene/prop assets and storyboards, specifying appearances and reference images to preserve. Check the relationship between keyframes and motion prompts before production.

  2. Create a separate project when using ViMax and organize the approved story, reference images and requirements into accepted inputs. Configure LLM, image and video providers and generate a small number of shots first; this report has not verified an automatic import interface between the two projects.

  3. Compare faces, clothing, props, spatial positions and dialogue in every shot. If appearance drifts, replace reference images, regenerate or cut the shot before assembly.

09Adoption conditions

Costs, permissions and checks

ItemLimitAction
Social dataSign-in state, region, data permissions and tool versions affect accessRun the source tools' diagnostics first; do not substitute a Caption for a transcript when the original video is unavailable
View thresholds3 times the median or 700,000 views/5 times followers are project methodsSave the calculation baseline and retrieval time separately; do not describe them as platform algorithm rules
Generation costsHiggsfield, LLM, image, video and voice services bill separatelyCheck quotes and credits first, limit duration and variant count per run, then expand batches
PromptsText guidance does not install models or create accounts automaticallyConfirm the actual CLI/API, authentication, compatible models and output-file location
Quality checksCaption, volume or file validation cannot establish story or character correctnessPerform tool checks and actual phone playback, reviewing the opening, captions and character details
Assets and licensesCode licenses do not cover music, fonts, likenesses or reference videosRetain usage terms; use only assets and voices you have rights to use
Original figuresThe original's star counts, growth periods and usage figures lack historical-data verificationDo not adopt rankings, guaranteed views or fixed-performance claims

The listed MIT projects, video-shotcraft's Apache-2.0 license and dependencies each have conditions. No license declaration was found in the reviewed raydenai/viral-video-creation snapshot. Public readability does not grant reuse rights; ask the maintainer before commercial adoption.

10First deliverable

Selection guidance

Your educational videos

Complete one local edit first

Start with Melvynx /studio-setup and /short-editing, confirm tools and caption quality, then add reference-video research. For Instagram data, separately check Treg or OpenCLI account and cost conditions.

Faceless AI visuals

Approve the analysis and one generated segment first

Follow Route A to save reference sources, analysis and prompts. Test one segment before planning voiceover and composition. Confirm each model and CLI connection before generation.

Product motion

Choose shot cards and product assets first

Select the video-shotcraft source revision, then make a short Remotion preview. Check features, text, the Logo and commercial licensing before expanding it into a complete publication video.

Serialized drama

Freeze character and storyboard data first

Organize scripts and assets with drama-skills. When ViMax is needed, configure its providers separately and hand over approved data. Review character continuity in a few shots before generating a full episode.

References