Wang Long Chai
Sep 5, 2024 09:28
The NVIDIA Deep Learning Institute, in collaboration with Dartmouth College, has launched a generative AI education kit to equip students with essential AI skills.
Generative AI, powered by advanced machine learning models and deep neural networks, is revolutionizing industries by generating new content and driving innovation in areas such as healthcare, finance, and entertainment. NVIDIA is at the forefront of this transformation with cutting-edge GPU architectures and software ecosystems such as the H100 Tensor Core GPU and CUDA platform that optimize the development and deployment of generative models, according to the NVIDIA Technical Blog.
The Importance of Generative AI Education
As generative AI models such as GANs and transformers become increasingly sophisticated, there is a growing demand for skilled professionals who can develop, improve, and ethically deploy these technologies. A strong educational foundation in generative AI provides students with the practical skills and theoretical knowledge needed to innovate in areas such as content generation, drug discovery, and autonomous systems.
College and university education in generative AI is critical as AI’s role in nearly every industry is rapidly expanding. By incorporating generative AI into their curricula, universities are preparing the next generation of AI researchers, engineers, and thought leaders to advance the field and solve complex challenges associated with AI-based innovation.
A new Generative AI Teaching Kit, a collaboration between the NVIDIA Deep Learning Institute (DLI) and Dartmouth College, will equip the next generation of professionals with the skills and knowledge needed in this rapidly evolving field.
This comprehensive educational resource gives educators access to cutting-edge tools, frameworks, and hands-on exercises essential for understanding generative AI and the complexities of developing and deploying large-scale language models. By providing students with a deep understanding of generative AI techniques, the teaching kit enables educators to foster future innovation and creativity in AI-based industries.
As students transition into the workforce, they will be better prepared to solve global challenges, from improving health and science to advancing sustainable technologies.
Sam Raymond, an assistant professor of engineering at Dartmouth College, played a key role in developing the content. “The overarching goal is to provide students with the skills to understand and potentially develop GPU-accelerated generative AI applications,” Raymond said. “I believe that students who complete this course will have a significant advantage in the job market and will help fill a knowledge gap in today’s industry.”
Generative AI Education Kit Overview
Each training kit includes lecture slides, hands-on labs, Jupyter notebooks, knowledge checks, and a free online self-paced learning course that provides students with a certificate of competency—all comprehensively packaged and ready to integrate into your classroom and curriculum.
The purpose of the Generative AI Teaching Kit is to introduce the fundamental concepts of Natural Language Processing (NLP) that are essential for understanding LLM and generative AI more broadly. We then review the core concepts of LLM using NVIDIA GPUs, tools and services, open source libraries and frameworks. A simple pre-training exercise of the GPT model demonstrates the basic learning process in the cloud.
The kit also covers diffusion models to explore the application of generative AI in image and video generation. Multimodal LLM architectures are then introduced, with a focus on optimizing different LLM architectures while fine-tuning them using the NVIDIA NeMo framework. Advances in inference and refinement of tools such as chatbots are also discussed, with NVIDIA NIM, NeMo Guardrails, TensorRT, and TensorRT-LLM used to improve efficiency and scalability in production environments.
The Generative AI Teaching Kit contains focused modules that combine theory, algorithms, programming, and examples. This first release includes the following modules:
- Introducing Generative AI
- A spreading model of generative AI
- LLM Orchestration
More modules will be available in future releases of this kit.
This content is valuable to educators in a variety of fields, especially computer science and engineering. The modular design allows instructors to tailor the course to their students’ specific needs and create a personalized learning experience. Some professors around the world have already received early access to the first release modules.
“I am looking forward to incorporating the Generative AI Teaching Kit into my materials science AI course,” said Mohadese Taheri-Mousavi, an assistant professor in Carnegie Mellon University’s Department of Materials Science and Engineering. “The comprehensive lecture notes, including well-structured coding labs with case studies from a variety of fields and an associated online course with a certificate, will provide my students with a cutting-edge resource to deeply understand the broad applications of generative AI techniques in a variety of fields.”
Professor Payam Barnaghi of the Department of Brain Sciences at Imperial College London uses generative AI in his LLM and research using electronic health records and medical data. “The NVIDIA Generative AI Teaching Kit content is a great resource for students learning about the latest developments in AI and machine learning,” Barnaghi said. “Having had early access to the first module, I plan to use this content as a foundation for teaching advanced topics in machine learning for neuroscience courses.”
Given the rapid advancements in generative AI, educators can expect to see updated training materials over time. NVIDIA is committed to providing high-quality training resources and welcomes feedback to continually improve our content.
Get started
Educators can join the NVIDIA DLI Teaching Kit Program to gain free access to the first release of the Generative AI Teaching Kit and other kits.
Introducing NVIDIA Deep Learning Institute
The NVIDIA Deep Learning Institute (DLI) offers resources to meet a variety of learning needs, from learning materials to self-paced and live training, to educator programs. Individuals, teams, organizations, educators, and students can now find everything they need to advance their knowledge of AI, accelerated computing, accelerated data science, graphics, simulation, and more.
Image source: Shutterstock