← 开源
Ryota-Kawamura

Generative-AI-with-LLMs

In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.

TutorialsLLM fundamentalsJupyter Notebook
在 GitHub 打开
增长势头
+024 小时新增 Star0.0%
647
Star
446
Fork
+0
本周
1
贡献者
创建于 2023-07-01 · 更新于 2026-10-13 · 今日第 15548 名
主要开发者

Ryota-Kawamura/Generative-AI-with-LLMs 排名第 15,548,有 647 个星标。

同类别比较

Ryota-Kawamura/Generative-AI-with-LLMs 排名第 15,548,此处有 8 个同类条目;pyaf/load_forecasting 排名第 15,543。

同类别比较
名称排名指标
UKPLab/deeplearning4nlp-tutorial15,521
语言:
Python
星标数:
649
分叉数:
268
简介:
Hands-on tutorial on deep learning with a special focus on Natural Language Processing (NLP)
d2l-ai/d2l-tvm15,524
语言:
Python
星标数:
649
分叉数:
94
简介:
Dive into Deep Learning Compiler
Azure/Security-Copilot15,531
语言:
PowerShell
星标数:
648
分叉数:
279
简介:
Microsoft Security Copilot is a generative AI-powered security solution that helps increase the efficiency and capabilities of defenders to improve security outcomes at machine speed and scale, while remaining compliant to responsible AI principles
pyaf/load_forecasting15,543
语言:
Jupyter Notebook
星标数:
648
分叉数:
166
简介:
Forecasting electric power load of Delhi using ARIMA, RNN, LSTM, and GRU models
dongjun-Lee/text-summarization-tensorflow15,555
语言:
Python
星标数:
647
分叉数:
194
简介:
Tensorflow seq2seq Implementation of Text Summarization.
grok-ai/nn-template15,570
语言:
Python
星标数:
646
分叉数:
66
简介:
Generic template to bootstrap your PyTorch project.
victor369basu/Real-time-stock-market-prediction15,592
语言:
JavaScript
星标数:
645
分叉数:
119
简介:
In this repository, I have developed the entire server-side principal architecture for real-time stock market prediction with Machine Learning. I have used Tensorflow.js for constructing ml model architecture, and Kafka for real-time data streaming and pipelining.
pieces-app/documentation15,604
语言:
TypeScript
星标数:
644
分叉数:
74
简介:
Official documentation for Pieces for Developers
关键参数与规格
关键参数与规格
参数值
语言Jupyter Notebook
类别Tutorials
子类别LLM fundamentals
星标数647
分叉数446
贡献者1
创建日期2023-07-01
更新日期2026-10-13
1 天星标数0
7 天星标数0
排名15,548
上次排名15,358
排名变化-190
7 天星标排名15,047
上次 7 天星标排名15,051
7 天星标排名变化4
总星标排名15,821
上次总星标排名15,794
总星标排名变化-27
国家Japan
README 摘录

Generative AI with LLMs In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications. By taking this course, you'll learn to: Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how

fine-tuning enables LLMs to be adapted to a variety of specific use cases Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners Developers who have a

good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology. Week 1 Generative AI use cases, project lifecycle, and model pre-training Learning Objectives Discuss model pre-training and the value of continued pre-training vs fine-tuning Define

the terms Generative AI, large language models, prompt, and describe the transformer architecture that powers LLMs Describe the steps in a typical LLM-based, generative AI model lifecycle and discuss the constraining factors that drive decisions at each step of model lifecycle Discuss computational challenges during model pre-training and determine how to efficiently reduce memory footprint Define the term scaling law and describe the laws that have been discovered for LLMs related to training dataset size, compute budget, inference

requirements, and other factors Lab 1 - Generative AI Use Case: Summarize Dialogue Week 1 quiz Week 2 Fine-tuning and evaluating large language models Learning Objectives Describe how fine-tuning with instructions using prompt datasets can improve performance on one or more tasks Define catastrophic forgetting and explain techniques that can be used to overcome it Define the term Parameter-efficient Fine Tuning (PEFT) Explain how PEFT decreases computational cost and overcomes catastrophic forgetting Explain how fine-tuning with instructions

using prompt datasets can increase LLM performance on one or more Lab 2 - Fine-tune a generative AI model for dialogue summarization Week 2 quiz Week 3 Reinforcement learning and LLM-powered applications Learning Objectives Describe how RLHF uses human feedback to improve the performance and alignment of large language models Explain how data gathered from human labelers is used to train a reward model for RLHF Define chain-of-thought prompting and describe how it can be used to

improve LLMs reasoning and planning abilities Discuss the challenges that LLMs face with knowledge cut-offs, and explain how information

常见问题

记录了多少星标和分叉?

Ryota-Kawamura/Generative-AI-with-LLMs 有 647 个星标和 446 个分叉。

仓库排名是多少?

Ryota-Kawamura/Generative-AI-with-LLMs 排名第 15,548。

记录的语言和类别是什么?

Ryota-Kawamura/Generative-AI-with-LLMs 有 647 个星标,语言为 Jupyter Notebook,类别为 Tutorials。

哪个仓库排名最接近?

Ryota-Kawamura/Generative-AI-with-LLMs 与 pyaf/load_forecasting 比较,后者排名第 15,543,有 648 个星标。

README

Generative AI with LLMs

In Generative AI with Large Language Models (LLMs), you’ll learn the fundamentals of how generative AI works, and how to deploy it in real-world applications.

By taking this course, you'll learn to:

  • Deeply understand generative AI, describing the key steps in a typical LLM-based generative AI lifecycle, from data gathering and model selection, to performance evaluation and deployment
  • Describe in detail the transformer architecture that powers LLMs, how they’re trained, and how fine-tuning enables LLMs to be adapted to a variety of specific use cases
  • Use empirical scaling laws to optimize the model's objective function across dataset size, compute budget, and inference requirements
  • Apply state-of-the art training, tuning, inference, tools, and deployment methods to maximize the performance of models within the specific constraints of your project
  • Discuss the challenges and opportunities that generative AI creates for businesses after hearing stories from industry researchers and practitioners

Developers who have a good foundational understanding of how LLMs work, as well the best practices behind training and deploying them, will be able to make good decisions for their companies and more quickly build working prototypes. This course will support learners in building practical intuition about how to best utilize this exciting new technology.

Week 1

Generative AI use cases, project lifecycle, and model pre-training

Learning Objectives

  • Discuss model pre-training and the value of continued pre-training vs fine-tuning
  • Define the terms Generative AI, large language models, prompt, and describe the transformer architecture that powers LLMs
  • Describe the steps in a typical LLM-based, generative AI model lifecycle and discuss the constraining factors that drive decisions at each step of model lifecycle
  • Discuss computational challenges during model pre-training and determine how to efficiently reduce memory footprint
  • Define the term scaling law and describe the laws that have been discovered for LLMs related to training dataset size, compute budget, inference requirements, and other factors

Lab 1 - Generative AI Use Case: Summarize Dialogue

Week 1 quiz

Week 2

Fine-tuning and evaluating large language models

Learning Objectives

  • Describe how fine-tuning with instructions using prompt datasets can improve performance on one or more tasks
  • Define catastrophic forgetting and explain techniques that can be used to overcome it
  • Define the term Parameter-efficient Fine Tuning (PEFT)
  • Explain how PEFT decreases computational cost and overcomes catastrophic forgetting
  • Explain how fine-tuning with instructions using prompt datasets can increase LLM performance on one or more

Lab 2 - Fine-tune a generative AI model for dialogue summarization

Week 2 quiz

Week 3

Reinforcement learning and LLM-powered applications

Learning Objectives

  • Describe how RLHF uses human feedback to improve the performance and alignment of large language models
  • Explain how data gathered from human labelers is used to train a reward model for RLHF
  • Define chain-of-thought prompting and describe how it can be used to improve LLMs reasoning and planning abilities
  • Discuss the challenges that LLMs face with knowledge cut-offs, and explain how information retrieval and augmentation techniques can overcome these challenges

Lab 3 - Fine-tune FLAN-T5 with reinforcement learning to generate more-positive summaries

Week 3 Quiz

排名相邻
同类项目