Skip to content
GitLab
Explore
Sign in
Overview
Active
Stale
All
dependabot/pip/black-24.3.0
2ea9dc28
·
Bump black from 22.3.0 to 24.3.0
·
Mar 20, 2024
ngoyal_changes_for_pp_fp8_akadian_jie_fix
5baa10cb
·
Fix silenet errors when requires_grad=False in params_with_grad in FSDP
·
Mar 04, 2024
ngoyal_changes_for_pp_fp8_akadian
73df9be2
·
Added reshard hook for frozen params in backward
·
Feb 06, 2024
ngoyal_changes_for_pp_fp8
d0b506f7
·
added option for no PG validation for faster init (#1161)
·
Jan 24, 2024
ngoyal_temp_fp32_main_grad
30cd0211
·
fixed broken clipping (#1154)
·
Dec 06, 2023
ngoyal_main_grad_fix
476aa945
·
fixed broken clipping
·
Dec 06, 2023
jiecaoyu_temp_fp32_main_grad_fix
f79d5014
·
fix .grad=None issue when param is not sharded
·
Dec 05, 2023
keep_grads_fp32
768c5a84
·
changes to keep reduced grad in fp32
·
Dec 04, 2023
artk/fix_fsdp_for_8gpu_cases
2ff977dd
·
fix no shard case
·
Nov 28, 2023
pp_fp8_freezing
ed366c9c
·
v2
·
Nov 27, 2023
jiecaoyu_fp8allgather_debug
8bebf152
·
[Not for merge] FP8 allgather changes for debugging in fairscale
·
Nov 08, 2023
ngoyal_changes_for_pp_fp8_overlap
d7fe1136
·
Added `_run_all_post_backward_hooks`; removed stream sync if event sync
·
Oct 11, 2023
add_main_grad_before_fwd
8cf28fa7
·
guard main_grad None
·
Oct 09, 2023
ngoyal_changes_for_pp_fp8_awgu
7aa7e9ba
·
Cleared backward hooks to avoid accumulating over iterations
·
Oct 09, 2023
ngoyal_changes_for_pp_fp8_event_sync
6b0e61e3
·
Changed to use event sync only
·
Oct 03, 2023
ngoyal_changes_for_pp_fp8_fix_handle_grad_main
ad54660b
·
Add main_grad
·
Oct 02, 2023
ngoyal_changes_for_pp_fp8_fix_handle
45cd0385
·
split into wps fix P841842878 only and main_grad fix
·
Oct 01, 2023
ngoyal_changes_for_pp
8e5c4162
·
changes for pp
·
Sep 22, 2023
fix_missing_params_in_unconsolidated_models
b5455b9b
·
Fix missing params in unconsolidated models
·
Sep 19, 2023
ngoyal_added_zero2_shard_modelparams_multiple_gpus
0b77de40
·
added option to do backward AG over smaller set of gpus instead of full DDP
·
May 20, 2023
Prev
1
2
3
Next