← Open Source
Ryota-Kawamura

Generative-AI-with-LLMs

In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.

TutorialsLLM fundamentalsJupyter Notebook
Open on GitHub
Momentum
+0stars in 24 hours0.0%
647
Stars
446
Forks
+0
This week
1
Contributors
Created 2023-07-01 · Updated 2026-10-13 · #15548 today
Top developers

Ryota-Kawamura/Generative-AI-with-LLMs is ranked 15,548 with 647 stars.

Same-category comparison

Ryota-Kawamura/Generative-AI-with-LLMs is ranked 15,548 among these 8 peers; pyaf/load_forecasting is ranked 15,543.

Same-category comparison
NameRankMetrics
UKPLab/deeplearning4nlp-tutorial15,521
Language:
Python
Stars:
649
Forks:
268
Description:
Hands-on tutorial on deep learning with a special focus on Natural Language Processing (NLP).
d2l-ai/d2l-tvm15,524
Language:
Python
Stars:
649
Forks:
94
Description:
Dive into Deep Learning Compiler.
Azure/Security-Copilot15,531
Language:
PowerShell
Stars:
648
Forks:
279
Description:
Microsoft Security Copilot is a generative AI-powered security solution that helps increase the efficiency and capabilities of defenders to improve security outcomes at machine speed and scale, while remaining compliant to responsible AI principles.
pyaf/load_forecasting15,543
Language:
Jupyter Notebook
Stars:
648
Forks:
166
Description:
Forecasting electric power load of Delhi using ARIMA, RNN, LSTM, and GRU models.
dongjun-Lee/text-summarization-tensorflow15,555
Language:
Python
Stars:
647
Forks:
194
Description:
Tensorflow seq2seq Implementation of Text Summarization.
grok-ai/nn-template15,570
Language:
Python
Stars:
646
Forks:
66
Description:
Generic template to bootstrap your PyTorch project.
victor369basu/Real-time-stock-market-prediction15,592
Language:
JavaScript
Stars:
645
Forks:
119
Description:
In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.
pieces-app/documentation15,604
Language:
TypeScript
Stars:
644
Forks:
74
Description:
Official documentation for Pieces for Developers.
Key parameters and specifications
Key parameters and specifications
ParameterValue
LanguageJupyter Notebook
CategoryTutorials
SubcategoryLLM fundamentals
Stars647
Forks446
Contributors1
Created date2023-07-01
Updated date2026-10-13
Stars in 1 day0
Stars in 7 days0
Rank15,548
Previous rank15,358
Rank change-190
7-day stars rank15,047
Previous 7-day stars rank15,051
7-day stars rank change4
Total stars rank15,821
Previous total stars rank15,794
Total stars rank change-27
CountryJapan
README summary

Generative AI with LLMs In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications. By taking this course, you'll learn to: Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how

fine-tuning enables LLMs to be adapted to a variety of specific use cases Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners Developers who have a

good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology. Week 1 Generative AI use cases, project lifecycle, and model pre-training Learning Objectives Discuss model pre-training and the value of continued pre-training vs fine-tuning Define

the terms Generative AI, large language models, prompt, and describe the transformer architecture that powers LLMs Describe the steps in a typical LLM-based, generative AI model lifecycle and discuss the constraining factors that drive decisions at each step of model lifecycle Discuss computational challenges during model pre-training and determine how to efficiently reduce memory footprint Define the term scaling law and describe the laws that have been discovered for LLMs related to training dataset size, compute budget, inference

requirements, and other factors Lab 1 - Generative AI Use Case: Summarize Dialogue Week 1 quiz Week 2 Fine-tuning and evaluating large language models Learning Objectives Describe how fine-tuning with instructions using prompt datasets can improve performance on one or more tasks Define catastrophic forgetting and explain techniques that can be used to overcome it Define the term Parameter-efficient Fine Tuning (PEFT) Explain how PEFT decreases computational cost and overcomes catastrophic forgetting Explain how fine-tuning with instructions

using prompt datasets can increase LLM performance on one or more Lab 2 - Fine-tune a generative AI model for dialogue summarization Week 2 quiz Week 3 Reinforcement learning and LLM-powered applications Learning Objectives Describe how RLHF uses human feedback to improve the performance and alignment of large language models Explain how data gathered from human labelers is used to train a reward model for RLHF Define chain-of-thought prompting and describe how it can be used to

improve LLMs reasoning and planning abilities Discuss the challenges that LLMs face with knowledge cut-offs, and explain how information

Frequently asked questions

How many stars and forks are recorded?

Ryota-Kawamura/Generative-AI-with-LLMs has 647 stars and 446 forks.

What is the repository rank?

Ryota-Kawamura/Generative-AI-with-LLMs is ranked 15,548.

What language and category are recorded?

Ryota-Kawamura/Generative-AI-with-LLMs has 647 stars, uses Jupyter Notebook and belongs to Tutorials.

Which repository is closest in rank?

Ryota-Kawamura/Generative-AI-with-LLMs is compared with pyaf/load_forecasting, ranked 15,543 with 648 stars.

README

Generative AI with LLMs

In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.

By taking this course, you'll learn to:

  • Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment
  • Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how fine-tuning enables LLMs to be adapted to a variety of specific use cases
  • Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements
  • Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project
  • Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners

Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology.

Week 1

Generative AI use cases, project lifecycle, and model pre-training

Learning Objectives

  • Discuss model pre-training and the value of continued pre-training vs fine-tuning
  • Define the terms Generative AI, large language models, prompt, and describe the transformer architecture that powers LLMs
  • Describe the steps in a typical LLM-based, generative AI model lifecycle and discuss the constraining factors that drive decisions at each step of model lifecycle
  • Discuss computational challenges during model pre-training and determine how to efficiently reduce memory footprint
  • Define the term scaling law and describe the laws that have been discovered for LLMs related to training dataset size, compute budget, inference requirements, and other factors

Lab 1 - Generative AI Use Case: Summarize Dialogue

Week 1 quiz

Week 2

Fine-tuning and evaluating large language models

Learning Objectives

  • Describe how fine-tuning with instructions using prompt datasets can improve performance on one or more tasks
  • Define catastrophic forgetting and explain techniques that can be used to overcome it
  • Define the term Parameter-efficient Fine Tuning (PEFT)
  • Explain how PEFT decreases computational cost and overcomes catastrophic forgetting
  • Explain how fine-tuning with instructions using prompt datasets can increase LLM performance on one or more

Lab 2 - Fine-tune a generative AI model for dialogue summarization

Week 2 quiz

Week 3

Reinforcement learning and LLM-powered applications

Learning Objectives

  • Describe how RLHF uses human feedback to improve the performance and alignment of large language models
  • Explain how data gathered from human labelers is used to train a reward model for RLHF
  • Define chain-of-thought prompting and describe how it can be used to improve LLMs reasoning and planning abilities
  • Discuss the challenges that LLMs face with knowledge cut-offs, and explain how information retrieval and augmentation techniques can overcome these challenges

Lab 3 - Fine-tune FLAN-T5 with reinforcement learning to generate more-positive summaries

Week 3 Quiz

Nearby in the ranking
Similar items