Skip to content

jsonBackup/Latent-CLIP-Demo

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

2 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Supplementary Directory

This repository contains resources and code for utilizing Latent CLIP for zero-shot prediction and reward-based noise optimization.


πŸ“‹ Installation

To set up the environment, use the provided environment.yml file:

conda env create -f environment.yml
conda activate latentclipenv

πŸš€ Usage

The starting point for understanding and utilizing Latent CLIP is the Jupyter Notebook:

minimal_usage_latent_clip.ipynb

This notebook demonstrates:

  • Zero-shot prediction using Latent CLIP.
  • Reward-based noise optimization using Latent CLIP-based rewards .

πŸ“Œ Using the ComfyUI Workflow

The file workflow_sdxl_turbo.json is a workflow designed for use with ComfyUI.

Steps to use the workflow:

  1. Clone ComfyUI from GitHub:

    git clone https://github.com/comfyanonymous/ComfyUI.git
    cd ComfyUI
  2. Run ComfyUI:

    python main.py
  3. Load the Workflow:

    • In the ComfyUI interface, press Ctrl + O (or click "Load").
    • Select the file workflow_sdxl_turbo.json from the assets/ folder.
  4. For more information on ComfyUI, visit:
    ➑️ ComfyUI GitHub Repository


πŸ“‚ Directory Structure

supplementary/
β”‚
β”œβ”€β”€ assets/            # Additional resources
β”‚   └── workflow_sdxl_turbo.json  # ComfyUI workflow file (https://github.com/comfyanonymous/ComfyUI)
β”‚
β”œβ”€β”€ Latent_ReNO/       # Implementation for reward-based noise optimization
β”œβ”€β”€ environment.yml    # Conda environment setup file
β”œβ”€β”€ helper.py          # Utility functions for supporting the notebook
└── minimal_usage_latent_clip.ipynb  # Main notebook for starting with Latent CLIP

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •