Fusion-in-Decoder
-
FiD (Fusion-in-Decoder)
Encodes each retrieved passage independently with T5, then fuses all passage representations in the decoder; more scalable than concatenating all passages as a single long input.
Encodes each retrieved passage independently with T5, then fuses all passage representations in the decoder; more scalable than concatenating all passages as a single long input.