ELELEM-DIFFUSION(7)

Name

elelem-diffusion — Images from the agent, locally

Synopsis

git clone https://git.mokhan.ca/elelem/diffusion.git

Description

Adds image, video, and upscale tools backed by stable-diffusion.cpp, compiled into the elelem process and called through Fiddle.

Full documentation: elelem-diffusion.

Tools

image, video, upscale

Environment

ELELEM_SD_IMAGE_MODEL

Model file for the image tool, passed to stable-diffusion.cpp as model_path.

ELELEM_SD_VIDEO_MODEL

Diffusion model file for the video tool (a Wan2.1 or Wan2.2 model).

ELELEM_SD_VIDEO_VAE

VAE file for the video tool.

ELELEM_SD_VIDEO_T5XXL

T5-XXL text encoder file for the video tool.

ELELEM_SD_ESRGAN_MODEL

ESRGAN model file for the upscale tool.

Requirements

Ruby 4.0 or later. A C/C++ toolchain and CMake. OpenMP (libgomp) on Linux. Model files for each tool you want (Stable Diffusion, Wan video, ESRGAN).

Status

Lab: an experiment in how inference works. Read it to learn. Source only; not published to RubyGems. History: commits.

Bugs

Known issues: plugin:diffusion. Patches are welcome by email; see git-send-email.io.

See also

elelem(1), elelem-llama(7), elelem-ggml(7), documentation, source