Generative AI, Foundation Models and Large Language Models

Introduction

In this repository, I will save my work on Generative AI, Foundation Models and Large Language Models.

Foundation Models 101

The Full Guide to Foundation Models

Videos

IBM Technology on Youtube is a great place to start. Why foundation models are a paradigm shift for AI

David Tuia Talk on Vision-Language Models in Remote Sensing

**#### Stable Diffusion Paper Explained

Using Stable Diffusion for Image Generation

Courses

Andrew NG Generative AI with Large Language Models

[New] Udemy Natural Language Processing: NLP With Transformers in Python

IBM Generative AI: Foundation Models and Platforms

Edx Databricks: Large Language Models: Foundation Models from the Ground Up

Stanford CS324 - Large Language Models, Stanford University Video

LLM Crash Course - YouTube

LangChain Course

Stanford HAI Workshop

Stanford HAI is a multi-disciplinary institute focused on Foundation models.

Day1

Repositories

Awesome Remote Sensing Foundation Models

Awesome Foundation Models

Awsome Computer Vision Foundation Models

IBM NASA Geospatial is a foundation model trained on NASA's Earth Observing System Data and Information System (EOSDIS) data. It has Segmentation models like Flood. Their base model is called Prithivi. And they have various fine-tuned models like Flood.

SpectralGPT

Awsome Vision Language Models for Earth Observation

Papers

PRESTO Lightweight, Pre-trained Transformers for Remote Sensing Timeseries

A founddation model based on masked image autoencoders, for remote sensing data. can handle multiple satellite data sources, and also can be inputed with time series data.

Towards Geospatial Foundation Models via Continual Pretraining

SpectalGPT

Articles

The Illustrated Transformer