Skip to content
GitLab
Explore
Sign in
Overview
Active
Stale
All
ngoyal_8bit_all_gather
ff63d55e
·
fix
·
Feb 14, 2023
fsdp_ptd
592c0b93
·
update PG
·
Sep 27, 2022
ngoyal_bf16_changes
ba38cf32
·
bf16 changes and attribute for cpu activations
·
Jun 28, 2022
fixing_memory_issues_with_keeping_overlap_may24
91132c7e
·
Merge branch 'fixing_memory_issues_with_keeping_overlap' into...
·
Jun 22, 2022
experts_lt_gpus_moe_reload_fix
2ec5c5e1
·
[fsdp][moe] reload checkpoint correctly for moe models with experts less than global world size
·
May 19, 2022
fixing_memory_issues_with_keeping_overlap
19155319
·
Get rid of warning
·
May 11, 2022
ngoyal_fix_for_multiple_backwards
40b9436f
·
dont remove post backward hooks for multiple backward fix
·
Feb 02, 2022
anj/fix-lint
d3417ceb
·
FullyShardedDataParallel: only return full state dict on rank 0 (#885)
·
Jan 06, 2022
prefetch_fsdp_params_multiple_modules
899fe0cd
·
added option to disable double prefetch
·
Dec 02, 2021
fsdp_added_dummy_collective_calls_for_benchmarking
e8a510a0
·
fix
·
Nov 24, 2021
prefetch_fsdp_params_simple
88200493
·
prefetch params of previous fsdp module
·
Nov 19, 2021
Prev
1
2
3
Next