Skip to content

Issues: pytorch/torchtune

v0.7.0 tracker
#2538 opened Mar 30, 2025 by joecummings
Open
Testing tracker
#1890 opened Oct 23, 2024 by felipemello1
Open
Beta
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

304 Open 718 Closed
304 Open 718 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

I'm experimenting unexpected loss values when running old recipes on the same datasets
#2746 opened May 17, 2025 by nouranali
Could you recommend evaluation benchmark for LLM instruction-tuning? (with alpaca or slimorca dataset)
#2740 opened May 16, 2025 by lifelongeeek
async GRPO discarding data and wandb not logging rewards
#2739 opened May 15, 2025 by salman-abdullah
2
Bidirectional truncation in Llama4. best practice Things we should be doing but aren't community help wanted We would love the community's help completing this issue
#2735 opened May 15, 2025 by krammnic
4
Feature request: support different input/output formats in the same recipe
#2732 opened May 14, 2025 by andrewor14
[RFC] Automatically download models as part of tune run discussion Start a discussion
#2731 opened May 14, 2025 by ebsmothers
Use LRScheduler.load_state_dict() best practice Things we should be doing but aren't community help wanted We would love the community's help completing this issue
#2730 opened May 13, 2025 by joecummings
2
Integrate Muon optimizer community help wanted We would love the community's help completing this issue enhancement New feature or request
#2725 opened May 13, 2025 by joecummings
Improve compile_model logging output community help wanted We would love the community's help completing this issue documentation Improvements or additions to documentation good first issue Good for newcomers
#2717 opened May 11, 2025 by joecummings
@Muhammad-Rebaal
2
Migrate typing to PEP 585 and PEP 604 best practice Things we should be doing but aren't
#2715 opened May 9, 2025 by joecummings
3
Drop Python 3.9 Support discussion Start a discussion
#2713 opened May 9, 2025 by joecummings
Activation offloading and Llama4
#2709 opened May 8, 2025 by ebsmothers
1
Integrate Hugging Face tokenizers with torchtune community help wanted We would love the community's help completing this issue high-priority
#2706 opened May 8, 2025 by ebsmothers
1
Open call for projects built with torchtune! 🚀 community help wanted We would love the community's help completing this issue
#2701 opened May 8, 2025 by joecummings
Log config to output only on rank zero best practice Things we should be doing but aren't community help wanted We would love the community's help completing this issue good first issue Good for newcomers
#2700 opened May 8, 2025 by joecummings
Add support for Qwen 2.5 VL 7B community help wanted We would love the community's help completing this issue enhancement New feature or request
#2699 opened May 8, 2025 by joecummings
4
Add a knowledge distillation full finetune distributed recipe community help wanted We would love the community's help completing this issue enhancement New feature or request
#2695 opened May 7, 2025 by joecummings
1
Fix Compile LinearCrossEntropyLoss
#2694 opened May 7, 2025 by pbontrager
@pbontrager
1
Optimize Distributed LinearCrossEntropyLoss
#2693 opened May 7, 2025 by pbontrager
[Feature Request] Add Liger CE Loss community help wanted We would love the community's help completing this issue
#2692 opened May 7, 2025 by pbontrager
1
2
Update ReadMe Optimization Flags community help wanted We would love the community's help completing this issue documentation Improvements or additions to documentation good first issue Good for newcomers
#2691 opened May 7, 2025 by pbontrager
1
Add LinearCrossEntropyLoss to EarlyExit recipe community help wanted We would love the community's help completing this issue
#2690 opened May 7, 2025 by pbontrager
Add LinearCrossEntropy to KD Recipes community help wanted We would love the community's help completing this issue
#2689 opened May 7, 2025 by pbontrager
Linear Loss Tracker
#2688 opened May 7, 2025 by pbontrager
Tracker: Tensor Parallel Issues and Compatibility
#2685 opened May 7, 2025 by nathan-az
ProTip! Exclude everything labeled bug with -label:bug.