Courses

• Harvard CMSA (opens in a new tab)

Open-source

• Become An Open Source Master (opens in a new tab)

AI

• CS224U: Natural Language Understanding (opens in a new tab)

• Christopher Potts (opens in a new tab)

• Annual Meeting of the Association for Computational Linguistics (2024) (opens in a new tab)

• Stanford XCS224U: Natural Language Understanding I Spring 2023 (opens in a new tab)

Taught by professor Christopher Potts, this professional Stanford Online course draws on theoretical concepts from linguistics, natural language processing, and machine learning. Topics include domain adaptation for supervised sentiment, retrieval augmented in-context learning, advanced behavioral evolution, analysis methods, and NLP methods.

There will be special lectures on developing projects and presenting research results.

View more information about this course here: https://online.stanford.edu/courses/xcs224u-natural-language-understanding (opens in a new tab)

• Code for Stanford CS224u (opens in a new tab)

Natural Language Understanding

• Stanford XCS224U: NLU I Intro & Evolution of Natural Language Understanding, Pt. 1 I Spring 2023 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Course Overview, Part 2 I Spring 2023 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Homework 1 I Overview: Bake Off (opens in a new tab)

Contextual Word Representations

• Stanford XCS224U: NLU I Contextual Word Representations, Part 1: Guiding Ideas I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 2: Transformer I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 3: Positional Encoding I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 4: GPT I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 5: BERT I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 6: RoBERTa I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 7: ELECTRA I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 8: Seq2seq Architectures I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 9: Distillation I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Contextual Word Representations, Part 10: Wrap-up I Spring 2023 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Homework 2 I Spring 2023 (opens in a new tab)

Information Retrieval

• Stanford XCS224U: NLU I Information Retrieval, Part 1: Guiding Ideas I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Information Retrieval, Part 2: Classical IR I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Information Retrieval, Part 3: IR metrics I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Information Retrieval, Part 4: Neural IR I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Information Retrieval, Part 5: Datasets and Conclusion I Spring 2023 (opens in a new tab)

In-context Learning

• Stanford XCS224U: Natural Language Understanding I In-context Learning, Pt 1: Origins I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I In-context Learning, Part 2: Core Concepts I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I In-context Learning, Part 3: Current Moment I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I In-context Learning, Part 4: Techniques and Suggested Methods I Spring 2023 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Homework 3 I Spring 2023 (opens in a new tab)

Behavioral Evaluation of NLU Models

• Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 1: Overview I Spring 2023 (opens in a new tab)
• Stanford XCS224U I Behavioral Eval of NLU Models, Pt 2: Analytical Considerations I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 3: Compositionality I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 4: COGS and ReCOGS I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Pt 5: Adversarial Testing I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Behavioral Evaluation of NLU Models, Part 6: Adversarial NLI I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Behavioral Eval of NLU Models, Pt 7: DynaSent and Conclusion I Spring 2023 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Lit Review Overview I Spring 2023 (opens in a new tab)

Analysis Methods for NLU

• Stanford XCS224U: NLU I Analysis Methods for NLU, Part 1: Overview I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Analysis Methods for NLU, Part 2: Probing I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Analysis Methods for NLU, Part 3: Feature Attribution I Spring 2023 (opens in a new tab)
• Stanford XCS224U I Analysis NLU, Pt 4: Casual Abstraction & Interchange Intervention Training (IIT) (opens in a new tab)
• Stanford XCS224U: Analysis NLU, Part 5: Distributed Alignment Search (DAS) & Conclusion I Spring 23 (opens in a new tab)
• Stanford XCS224U: Natural Language Understanding I Experiment Protocol Overview I Spring 2023 (opens in a new tab)

NLP Methods and Metrics

• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 1: Overview I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 2: Classifier Metrics I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 3: Generation Metrics I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 4: Datasets I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 5: Data Organization I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I NLP Methods and Metrics, Part 6: Model Evaluation & Conclusion I Spring 2023 (opens in a new tab)

Presenting Your Research

• Stanford XCS224U: NLU I Presenting Your Research, Part 1: Your Papers I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Presenting Your Research, Part 2: Writing NLP Papers I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Presenting Your Research, Part 3: NLP Conference Submission I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Presenting Your Research, Part 4: Giving Talks I Spring 2023 (opens in a new tab)

Language Models and How to Build Them

• Stanford XCS224U: NLU I Fantastic Language Models and How to Build Them, Part 1 I Spring 2023 (opens in a new tab)
• Stanford XCS224U: NLU I Fantastic Language Models and How to Build Them, Part 2 I Spring 2023 (opens in a new tab)