Asking about SVDSolver #33

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

dreamyou070 opened this issue Jul 18, 2024 · 1 comment

dreamyou070 commented Jul 18, 2024

when you train LCM_svd, you set svd_solver like,

svd_solver = SVDSolver(args.N, noise_scheduler.config.sigma_min, noise_scheduler.config.sigma_max, 7,0.7, 1.6)

why you change training timestep to args.N (for example 40),
can I get advice about the SVDSolver ..?

Owner

G-U-N commented Jul 18, 2024

The SVD is built with EDM framework, which is a continuous diffusion format. Yet the consistency distillation requires us to set discrete timesteps for distillation. You might refer to https://github.com/luosiallen/latent-consistency-model/blob/main/LCM_Training_Script/consistency_distillation/train_lcm_distill_sd_wds.py if you are building things with DDPM framework.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment