Zmu (Zach Mustafa)

upvoted an article 9 days ago

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

May 14

• 192

upvoted a collection 28 days ago

Enhance Your Images

Collection

upvoted 2 articles about 1 month ago

Article

Welcome FalconMamba: The first strong attention-free 7B model

Aug 12

• 96

Article

Probabilistic Fractal Activation Function (P-FAF) and Its Advantages Over Traditional Word Vectorization

By

•

Feb 8

• 5

upvoted 5 papers about 1 month ago

Glyph-ByT5: A Customized Text Encoder for Accurate Visual Text Rendering

Paper • 2403.09622 • Published Mar 14 • 16

Sketch2Scene: Automatic Generation of Interactive 3D Game Scenes from User's Casual Sketches

Paper • 2408.04567 • Published Aug 8 • 23

RAG Foundry: A Framework for Enhancing LLMs for Retrieval Augmented Generation

Paper • 2408.02545 • Published Aug 5 • 32

MuChoMusic: Evaluating Music Understanding in Multimodal Audio-Language Models

Paper • 2408.01337 • Published Aug 2 • 10

ReLiK: Retrieve and LinK, Fast and Accurate Entity Linking and Relation Extraction on an Academic Budget

Paper • 2408.00103 • Published Jul 31 • 15

upvoted 2 articles about 2 months ago

Article

Google releases Gemma 2 2B, ShieldGemma and Gemma Scope

Jul 31

• 58

Article

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

Jul 23

• 193

upvoted a collection about 2 months ago

Llama 3.1

Collection

This collection hosts the transformers and original repos of the Meta Llama 3.1, Llama Guard 3 and Prompt Guard models • 11 items • Updated Aug 2 • 569

upvoted a collection 2 months ago

🪐 SmolLM

Collection

A series of smol LLMs: 135M, 360M and 1.7B. We release base and Instruct models as well as the training corpus and some WebGPU demos • 12 items • Updated Aug 18 • 169

upvoted an article 2 months ago

Article

The Rise of Agentic Data Generation

By

•

Jul 15

• 74

upvoted a collection 3 months ago

LLaVA-NeXT-Video

Collection

LLaVA for video. • 5 items • Updated 3 days ago • 37

upvoted an article 3 months ago

Article

How I train a LoRA: m3lt style training overview

By

•

Jul 1

• 45

upvoted 2 collections 3 months ago

synthetic-data-generation-demos

Collection

A collection of demos for various approaches to synthetic data generation • 4 items • Updated Jun 25 • 13

FP8 LLMs for vLLM

Collection

Accurate FP8 quantized models by Neural Magic, ready for use with vLLM! • 37 items • Updated 23 days ago • 51

upvoted a paper 3 months ago

PlankAssembly: Robust 3D Reconstruction from Three Orthographic Views with Learnt Shape Programs

Paper • 2308.05744 • Published Aug 10, 2023 • 1

upvoted a collection 3 months ago

— UI is a good thing 💅 —

Collection

cool spaces with a cool UI, what could be better? • 5 items • Updated Jun 18 • 13

upvoted an article 3 months ago

Article

Personal Copilot: Train Your Own Coding Assistant

Oct 27, 2023

• 25

upvoted an article 4 months ago

Article

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

By

•

Jun 4

• 67

upvoted a collection 4 months ago

Papers - Custom Layers - MLP

Collection

11 items • Updated May 1 • 1

upvoted 3 papers 4 months ago

upvoted 2 collections 4 months ago

sentence-transformers-from-synthetic-data

Collection

Example of using distilabel to generate synthetic triplets data for fine-tuning a Sentence Transformer model • 4 items • Updated Jun 21 • 21

Embedding Model Datasets

Collection

A curated subset of the datasets that work out of the box with Sentence Transformers: https://huggingface.co/datasets?other=sentence-transformers • 67 items • Updated Jul 3 • 61

upvoted an article 4 months ago

Article

Training and Finetuning Embedding Models with Sentence Transformers v3

May 28

• 146

upvoted 3 papers 4 months ago

Automatic Data Curation for Self-Supervised Learning: A Clustering-Based Approach

Paper • 2405.15613 • Published May 24 • 13

ConvLLaVA: Hierarchical Backbones as Visual Encoder for Large Multimodal Models

Paper • 2405.15738 • Published May 24 • 43

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 149

upvoted an article 4 months ago

Article

Fast, High-Fidelity LLM Decoding with Regex Constraints

By

•

Feb 23

• 3

upvoted a collection 4 months ago

Wikimedia Datasets

Collection

Wikimedia datasets, across languages and modalities, from different Wikimedia projects, on the hub. Not all tested. • 19 items • Updated May 16 • 9

upvoted 2 articles 4 months ago

Article

Vision Language Models Explained

Apr 11

• 176

Article

License to Call: Introducing Transformers Agents 2.0

May 13

• 108

upvoted a paper 5 months ago

InternVideo2: Scaling Video Foundation Models for Multimodal Video Understanding

Paper • 2403.15377 • Published Mar 22 • 20

upvoted 2 articles 5 months ago

Article

Improving Prompt Consistency with Structured Generations

Apr 30

• 52

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

upvoted 2 papers 5 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 250

Music Consistency Models

Paper • 2404.13358 • Published Apr 20 • 12

upvoted an article 5 months ago

Article

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Apr 22

• 78

upvoted a collection 5 months ago

GIT

Collection

GIT (Generative Image-to-text Transformer) is a model useful for vision-language tasks such as image/video captioning and question answering. • 18 items • Updated Jul 11 • 10

upvoted 2 articles 5 months ago

Article

Design choices for Vision Language Models in 2024

By

•

Apr 16

• 23

Article

History of State Space Models (SSM) in 2022

By

•

Apr 11

• 10

upvoted a paper 5 months ago

Best Practices and Lessons Learned on Synthetic Data for Language Models

Paper • 2404.07503 • Published Apr 11 • 29

upvoted an article 5 months ago

Article

Text2SQL using Hugging Face Dataset Viewer API and Motherduck DuckDB-NSQL-7B

Apr 4

• 23

upvoted a collection 6 months ago

Recent Mamba Papers

Collection

[NB: Notes are from TuringPost] • 3 items • Updated Mar 26 • 8

upvoted 6 papers 6 months ago

SiMBA: Simplified Mamba-Based Architecture for Vision and Multivariate Time series

Paper • 2403.15360 • Published Mar 22 • 11

Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inference

Paper • 2403.14520 • Published Mar 21 • 32

MyVLM: Personalizing VLMs for User-Specific Queries

Paper • 2403.14599 • Published Mar 21 • 15

VideoAgent: A Memory-augmented Multimodal Agent for Video Understanding

Paper • 2403.11481 • Published Mar 18 • 11

VideoAgent: Long-form Video Understanding with Large Language Model as Agent

Paper • 2403.10517 • Published Mar 15 • 30

Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding

Paper • 2403.09626 • Published Mar 14 • 12

upvoted 5 papers 7 months ago

Enhancing Vision-Language Pre-training with Rich Supervisions

Paper • 2403.03346 • Published Mar 5 • 14

MovieLLM: Enhancing Long Video Understanding with AI-Generated Movies

Paper • 2403.01422 • Published Mar 3 • 26

Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use

Paper • 2403.02626 • Published Mar 5 • 9

VisionLLaMA: A Unified LLaMA Interface for Vision Tasks

Paper • 2403.00522 • Published Mar 1 • 44

ModaVerse: Efficiently Transforming Modalities with LLMs

Paper • 2401.06395 • Published Jan 12 • 3

upvoted a collection 7 months ago

image

Collection

116 items • Updated 2 days ago • 1

Zach Mustafa PRO

AI & ML interests

Organizations

Zmu's activity

PaliGemma – Google's Cutting-Edge Open Vision Language Model

Welcome FalconMamba: The first strong attention-free 7B model

Probabilistic Fractal Activation Function (P-FAF) and Its Advantages Over Traditional Word Vectorization

Google releases Gemma 2 2B, ShieldGemma and Gemma Scope

Llama 3.1 - 405B, 70B & 8B with multilinguality and long context

The Rise of Agentic Data Generation

How I train a LoRA: m3lt style training overview

Personal Copilot: Train Your Own Coding Assistant

🦙⚗️ Using Llama3 and distilabel to build fine-tuning datasets

Training and Finetuning Embedding Models with Sentence Transformers v3

Fast, High-Fidelity LLM Decoding with Regex Constraints

Vision Language Models Explained

License to Call: Introducing Transformers Agents 2.0

Improving Prompt Consistency with Structured Generations

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Design choices for Vision Language Models in 2024

History of State Space Models (SSM) in 2022

Text2SQL using Hugging Face Dataset Viewer API and Motherduck DuckDB-NSQL-7B