AI Summer
Summary repository for AI Summer 2023. Introduction to generative AI, with practical applications to inferencing and training
Presented by Vanderbilt Data Science Institute data scientists:
- Dr. Jesse Spencer-Smith, Chief Data Scientist
- Dr. Charreau Bell, Senior Data Scientist
- Myranda Shirk, Senior Data Scientist
- Umang Chaudhry, Data Scientist
- Dr. Abigail Petulante, DSI Postdoctoral Fellow
Overview
The objective of these workshops is to develop foundational skills in understanding, inferencing and training generative AI models and other transformer models.
Setup
You’ll want to use the most advanced AI chat model that you can get access to. Microsoft just opened access to BingGPT through Bing Chat, which is based on an early version of GPT4, currently the most advanced AI chat model available to the public. You’ll need to install the Edge browser (https://www.microsoft.com › edge › download) and go to bing. com. Click on “Chat”.
Workshop Schedule
Week 1 Introduction to Transformer Models, Generative AI, and Prompt Engineering
5/8-5/10 (No meeting Friday for Vanderbilt graduation)
Monday, Wednesday
9am-11am; Office Hour 11am-12pm CDT
Weeks 2 AI-Assisted Programming for AI (yes, very meta)
5/15-5/19
Monday, Wednesday, Friday
9am-11am; Office Hour 11am-12pm CDT
Weeks 3-4 Building AI Systems / Training AI Models
5/22-6/2 (NOTE: Starting TUESDAY for Memorial Day)
Tuesday, Wednesday, Friday
9am-11am; Office Hour 11am-12pm CDT
Breakout Rooms
How to Breakout
Remember we are all learning and exploring
- Please share your video upon entering the room and unmute
- Share your screens--someone volunteer to share their screen upon entering, and everyone be ready to share your screen to show what you’ve found
- Make notes of what you’ve discussed in the Response Reports below
- Everyone be ready to report out (random)
- Make some friends
- Breakout Rooms Worksheets
Report Documents
Google Docs has a limit of 100 people viewing/editing a document at one time.
- If your room number is 1 through 10, use Breakout Room Report 1-10.
- If your room number is 11 through 20, use Breakout Room Report 11-20.
- If your room number is 21 through 30, use Breakout Room Report 21-30.
- If your room number is 31 through 40, use Breakout Room Report 31-40.
- If your room number is 41 through 50, use Breakout Room Report 41-50.
Special Breakout Room Groups
Please be sure your display name is set in Zoom. If you are in one of the following special groups, please pre-pend your name with one of the following qualifiers.
- Data Science for Social Good: DSSG
- Center for AI in Protein Dynamics: Protein
- If you are in a lab and would like your own breakout room: Labname (keep it short, please!)
- If you are faculty and would like to be in a breakout room with other faculty: Faculty
For example, I might be DSSG-Jesse Spencer-Smith
Workshop Video Recordings
Video recordings of these workshops can be found on our YouTube channel AI Summer playlist
Course Resources
- Prompt Engineering paper https://arxiv.org/abs/2302.11382
- Semester-long course on transformer models, DS 5690: Transformers in Theory and Practice . Graduate students and advanced undergraduates can register by contacting me. I welcome auditing by a select number of postdoctoral fellows, and drop-ins from faculty!
Other Resources
Compute Grants for Vanderbilt Faculty and Students
DGX A100 Compute Grant: https://forms.gle/2mGfEy9DB4JU2GpZ8
Python
Transformers
- Natural Language Processing with Transformers by Lewis Tunstall, Leandro von Werra and Thomas Wolf. If you are affiliated with Vanderbilt University, you can access this pre-print book (and any book by O’Reilly) free by logging into O'Reilly Media using your Vanderbilt email address. Vanderbilt licenses all content from O’Reilly. The book covers Transformers for purposes beyond text.
Getting the Most out of this Course
To get the most out of this workshop:
- Open Colab (workbook) notebooks and actively write code along with the instructor
- Actively participate in discussions
- Actively participate in breakout rooms
- Work on homework assignments before coming to class
- Relax your mind and ask questions
Accessing Bing Chat
- Open the Edge browser (yes, Edge) and navigate to www.bing.com
- Select "chat". A new window should open saying you need the new Bing.
- Select "Start chatting" at the bottom of this window. This should prompt you to sign in to a Microsoft account. Do not use an organizational/school email (such as Vanderbilt). Instead, select "No account? Create a new one" and create one with your personal email. Note: if you get stuck in the "use the new Bing" window, go back to Bing.com and select "Sign in" instead. Follow instructions for Step 3.
- Sign in to your personal Microsoft account.
- Select "chat" - it should work now!
