What are Diffusion Models?

Generative modeling is currently one of the most thrilling domains in deep learning research. Traditional models like Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs) have already demonstrated impressive capabilities in synthetically generating realistic data, such as images and text. However, diffusion models is swiftly gaining prominence as a powerful model in the arena of high-quality and stable generative modeling. This blog explores diffusion models, examining their operational mechanisms, architectural designs, training processes, sampling methods, and the key advantages that position them at the forefront of generative AI. ...

February 15, 2024 · 4 min

RAG and LLMs: Teaching Large Models to Use External Knowledge

Large Language Models (LLMs) like GPT or LLaMA are great at generating text. But there’s a catch: They only know what they were trained on, and that knowledge is frozen at training time. So what happens when you ask them something from after their training cutoff? Or something super niche, like a policy from your internal HR docs? Enter RAG – Retrieval-Augmented Generation. A technique that combines LLMs with a search engine, enabling them to look up facts on the fly. ...

July 15, 2024 · 3 min