Resources
Sample papers one can present:
CV
OPT
- An Empirical Study of Example Forgetting During Deep Neural Network Learning
- GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Training
NLP
- Survey of large GPT-like models (Wu Dao, Jurassic-1, Megatron-Turing NLG, GPT-NeoX-20B etc.)