SivilTaram (Qian Liu)

upvoted a collection about 22 hours ago

MagpieLM

Collection

Aligning LMs with Fully Open Pipeline • 7 items • Updated about 18 hours ago • 6

upvoted an article 12 days ago

Article

Meet Yi-Coder: A Small but Mighty LLM for Code

By

•

15 days ago

• 11

upvoted a paper 13 days ago

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Paper • 2409.03753 • Published 13 days ago • 17

upvoted a collection 15 days ago

OLMoE

Collection

Artifacts for open mixture-of-experts language models. • 13 items • Updated 4 days ago • 18

upvoted 2 papers 15 days ago

LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models

Paper • 2409.00509 • Published 18 days ago • 38

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published 15 days ago • 74

upvoted a paper 21 days ago

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 82

upvoted a paper 30 days ago

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published about 1 month ago • 51

upvoted 3 papers about 1 month ago

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Paper • 2408.06292 • Published Aug 12 • 114

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Paper • 2408.08072 • Published Aug 15 • 31

MiniCPM-V: A GPT-4V Level MLLM on Your Phone

Paper • 2408.01800 • Published Aug 3 • 74

upvoted an article about 2 months ago

Article

StarCoder: A State-of-the-Art LLM for Code

May 4, 2023

• 24

upvoted a paper about 2 months ago

AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agents

Paper • 2407.18901 • Published Jul 26 • 31

upvoted a collection about 2 months ago

DeepSeekCoder-V2

Collection

6 items • Updated 14 days ago • 81

upvoted a paper about 2 months ago

OpenDevin: An Open Platform for AI Software Developers as Generalist Agents

Paper • 2407.16741 • Published Jul 23 • 67

upvoted an article about 2 months ago

Article

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

By

•

Jul 27

• 21

upvoted a collection 2 months ago

📈 Scaling Laws with Vocabulary

Collection

Increase your vocabulary size when you scale up your language model • 5 items • Updated Aug 11 • 3

upvoted a paper 2 months ago

Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies

Paper • 2407.13623 • Published Jul 18 • 52

upvoted an article 2 months ago

Article

Announcing BigCodeBench-Hard, and More

By

•

Jul 24

• 10

upvoted a paper 2 months ago

Qwen2 Technical Report

Paper • 2407.10671 • Published Jul 15 • 153

upvoted 2 articles 2 months ago

Article

RegMix: Data Mixture as Regression for Language Model Pre-training

By

•

Jul 11

• 8

Article

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

By

•

Jul 11

• 10

upvoted a collection 3 months ago

💡 DICE

Collection

Self-alignment with DPO Implicit Rewards • 5 items • Updated Jul 28 • 7

upvoted a paper 3 months ago

RegMix: Data Mixture as Regression for Language Model Pre-training

Paper • 2407.01492 • Published Jul 1 • 33

upvoted a collection 3 months ago

🧬 RegMix: Data Mixture as Regression

Collection

Automatic data mixture method for large language model pre-training • 10 items • Updated Jul 26 • 5

upvoted a paper 3 months ago

BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions

Paper • 2406.15877 • Published Jun 22 • 45

upvoted a collection 3 months ago

🌸BigCodeBench

Collection

Benchmarking Code Generation with Diverse Function Calls and Complex Instructions https://bigcode-bench.github.io/ • 7 items • Updated Jul 18 • 2

upvoted an article 3 months ago

Article

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

Apr 29

• 71

upvoted 3 papers 3 months ago

DigiRL: Training In-The-Wild Device-Control Agents with Autonomous Reinforcement Learning

Paper • 2406.11896 • Published Jun 14 • 18

DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Paper • 2406.11931 • Published Jun 17 • 56

Bootstrapping Language Models with DPO Implicit Rewards

Paper • 2406.09760 • Published Jun 14 • 37

upvoted an article 3 months ago

Article

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Jun 18

• 35

upvoted 2 papers 3 months ago

DataComp-LM: In search of the next generation of training sets for language models

Paper • 2406.11794 • Published Jun 17 • 48

Pipeline Parallelism with Controllable Memory

Paper • 2405.15362 • Published May 24 • 3

upvoted a paper 4 months ago

Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations

Paper • 2405.18392 • Published May 28 • 12

upvoted a paper 5 months ago

Make Your LLM Fully Utilize the Context

Paper • 2404.16811 • Published Apr 25 • 52

upvoted a collection 5 months ago

Deita

Collection

14 items • Updated May 20 • 9

upvoted an article 5 months ago

Article

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Apr 16

• 13

upvoted a paper 5 months ago

Compression Represents Intelligence Linearly

Paper • 2404.09937 • Published Apr 15 • 27

upvoted a collection 5 months ago

Pile-T5

Collection

T5 trained on the Pile with Llama Tokenizer • 4 items • Updated Jul 6 • 16

upvoted an article 5 months ago

Article

StarCoder2 and The Stack v2

Feb 28

• 5

upvoted a collection 5 months ago

Chinese Tiny LLM

Collection

9 items • Updated Apr 5 • 7

upvoted an article 6 months ago

Article

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

May 23, 2022

• 1

upvoted a paper 6 months ago

Sailor: Open Language Models for South-East Asia

Paper • 2404.03608 • Published Apr 4 • 20

upvoted a collection 6 months ago

DBRX

Collection

DBRX is a mixture-of-experts (MoE) large language model trained from scratch by Databricks. • 3 items • Updated Mar 27 • 90

upvoted 2 papers 6 months ago

LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Models

Paper • 2403.13372 • Published Mar 20 • 58

Unlocking the conversion of Web Screenshots into HTML Code with the WebSight Dataset

Paper • 2403.09029 • Published Mar 14 • 54

upvoted 2 papers 7 months ago

MultiSpider: Towards Benchmarking Multilingual Text-to-SQL Semantic Parsing

Paper • 2212.13492 • Published Dec 27, 2022 • 2

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26 • 26

upvoted a collection 7 months ago

⚓️ Sailor Language Models

Collection

Sailor: Open Language Models tailored for South-East Asia (SEA) released by Sea AI Lab. • 18 items • Updated Jul 26 • 16

upvoted 2 papers 7 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29 • 132

The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits

Paper • 2402.17764 • Published Feb 27 • 590

upvoted a collection 7 months ago

💫 StarCoder2

Collection

StarCoder2 models and datasets! • 8 items • Updated Mar 1 • 79

upvoted 3 papers 7 months ago

upvoted 2 papers 8 months ago

Weak-to-Strong Jailbreaking on Large Language Models

Paper • 2401.17256 • Published Jan 30 • 14

Zero Bubble Pipeline Parallelism

Paper • 2401.10241 • Published Nov 30, 2023 • 22

upvoted a collection 8 months ago

TAPEX

Collection

TAPEX is the state-of-the-art table pre-training models which can be used for table-based question answering and table-based fact verification. • 10 items • Updated Jul 11 • 7

upvoted a paper 9 months ago

TinyLlama: An Open-Source Small Language Model

Paper • 2401.02385 • Published Jan 4 • 88

Qian Liu

AI & ML interests

Articles

RegMix: Data Mixture as Regression for Language Model Pre-training

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

Organizations

SivilTaram's activity

Meet Yi-Coder: A Small but Mighty LLM for Code

StarCoder: A State-of-the-Art LLM for Code

ZebraLogic: Benchmarking the Logical Reasoning Ability of Language Models

Announcing BigCodeBench-Hard, and More

RegMix: Data Mixture as Regression for Language Model Pre-training

MInference 1.0: 10x Faster Million Context Inference with a Single GPU

StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

StarCoder2 and The Stack v2

Efficient Table Pre-training without Real Data: An Introduction to TAPEX