• Compiler collectives

  • Aug 4 2024
  • Length: 17 mins
  • Podcast

Compiler collectives

Listen for free

View show details

  • Summary

  • Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
    Show More Show Less
Show More Show Less
activate_Holiday_promo_in_buybox_DT_T2
activate_samplebutton_t1

What listeners say about Compiler collectives

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.co.uk reviews

Amazon reviews
No Reviews are Available