Prometheus 2: Open-Source Language Model Evaluation and Optimized Triton FP8 GEMM Kernel

Simply AI

May 5 2024 • 12 mins

Discover Prometheus 2, an open-source language model evaluator that closely mirrors human and GPT-4 judgments. Also, PyTorch introduces an optimized Triton FP8 GEMM kernel for accelerated inference in large language models. Plus, explore the potential of an AI dataset for tornado detection and the creation of bespoke programming languages for efficient visual AI systems. Sources: https://www.marktechpost.com/2024/05/04/prometheus-2-an-open-source-language-model-that-closely-mirrors-human-and-gpt-4-judgements-in-evaluating-other-language-models/ https://www.marktechpost.com/2024/05/04/pytorch-researchers-introduce-an-optimized-triton-fp8-gemm-general-matrix-matrix-multiply-kernel-tk-gemm-that-leverages-splitk-parallelization/ https://news.mit.edu/2024/tornet-ai-dataset-carves-new-paths-tornado-detection-0429 https://news.mit.edu/2024/creating-bespoke-programming-languages-efficient-visual-ai-systems-0503 Outline: (00:00:00) Introduction (00:00:41) Prometheus 2: An Open Source Language Model that Closely Mirrors Human and GPT-4 Judgements in Evaluating Other Language Models (00:03:34) PyTorch Researchers Introduce an Optimized Triton FP8 GEMM (General Matrix-Matrix Multiply) Kernel TK-GEMM that Leverages SplitK Parallelization (00:06:14) An AI dataset carves new paths to tornado detection (00:09:30) Creating bespoke programming languages for efficient visual AI systems

You Might Like

Acquired
Acquired
Ben Gilbert and David Rosenthal
Darknet Diaries
Darknet Diaries
Jack Rhysider
Hard Fork
Hard Fork
The New York Times
Marketplace Tech
Marketplace Tech
Marketplace
WSJ’s The Future of Everything
WSJ’s The Future of Everything
The Wall Street Journal
Search Engine
Search Engine
PJ Vogt, Audacy, Jigsaw
TechStuff
TechStuff
iHeartPodcasts
Rich On Tech
Rich On Tech
Rich DeMuro
The Vergecast
The Vergecast
The Verge
Waveform: The MKBHD Podcast
Waveform: The MKBHD Podcast
Vox Media Podcast Network