CS224N Final Project (Michael Zhang, Alex Alvarado-Barahona)

Run python src/train.py for complete usage.
Run python src/chunkbigbird.py to run evaluation for K-Overlap.

• Load model and dataset
• Test model zero-shot
  • Get score
• Pretrain on MLM task
  • Get score
• Compile report
• (if time) Finetune model on downstream summarization task
  • Get score

• Pretrain on Manipulated Work Detection task
  • Finetune on downstream summarization task
  • Get score
• Pretrain on Masked First Character Prediction task
  • Finetune on downstream summarization task
  • Get score
• Compile Report