• Order Matters : Sequence to Sequence for Sets

  • Nov 2 2024
  • Length: 12 mins
  • Podcast

Order Matters : Sequence to Sequence for Sets

Listen for free

View show details

  • Summary

  • This research paper examines the importance of data ordering in sequence-to-sequence (seq2seq) models, specifically for tasks involving sets as inputs or outputs. The authors demonstrate that, despite the flexibility of the chain rule in modelling joint probabilities, the order in which data is presented to the model can significantly affect performance. They propose two key contributions: an architecture called “Read-Process-and-Write” to handle input sets and a training algorithm that explores various output orderings during training to find the optimal one. Through a series of experiments on tasks such as sorting, language modelling, and parsing, the authors provide compelling evidence for the impact of ordering on the effectiveness of seq2seq models.

    Audio : (Spotify) https://open.spotify.com/episode/3DAkHJxQ204jYvG89dO7sm?si=jhugL6y5RSmwgqJxeTstWg

    Paper: https://arxiv.org/pdf/1511.06391
    Show More Show Less
Show More Show Less
activate_Holiday_promo_in_buybox_DT_T2

What listeners say about Order Matters : Sequence to Sequence for Sets

Average customer ratings

Reviews - Please select the tabs below to change the source of reviews.

Audible.co.uk reviews

Amazon reviews
No Reviews are Available