Clémentine Fourrier's picture

Clémentine Fourrier

clefourrier

·

http://clefourrier.github.io

AI & ML interests

None yet

Articles

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Falcon 2: An 11B parameter pretrained language model and VLM, trained on over 5000B tokens tokens and 11 languages

CyberSecEval 2 - A Comprehensive Evaluation Framework for Cybersecurity Risks and Capabilities of Large Language Models

Let's talk about LLM evaluation

Introducing the Open Arabic LLM Leaderboard

Introducing the Open Leaderboard for Hebrew LLMs!

Bringing the Artificial Analysis LLM Performance Leaderboard to Hugging Face

Improving Prompt Consistency with Structured Generations

Introducing the Open Chain of Thought Leaderboard

The Open Medical-LLM Leaderboard: Benchmarking Large Language Models in Healthcare

Introducing the LiveCodeBench Leaderboard - Holistic and Contamination-Free Evaluation of Code LLMs

Introducing the Chatbot Guardrails Arena

Introducing ConTextual: How well can your Multimodal model jointly reason over text and image in text-rich scenes?

TTS Arena: Benchmarking Text-to-Speech Models in the Wild

Introducing the Red-Teaming Resistance Leaderboard

Introducing the Open Ko-LLM Leaderboard: Leading the Korean LLM Evaluation Ecosystem

NPHardEval Leaderboard: Unveiling the Reasoning Abilities of Large Language Models through Complexity Classes and Dynamic Updates

Introducing the Enterprise Scenarios Leaderboard: a Leaderboard for Real World Use Cases

The Hallucinations Leaderboard, an Open Effort to Measure Hallucinations in Large Language Models

A guide to setting up your own Hugging Face leaderboard: an end-to-end example with Vectara's hallucination leaderboard

2023, year of open LLMs

Open LLM Leaderboard: DROP deep dive

Overview of natively supported quantization schemes in 🤗 Transformers

What's going on with the Open LLM Leaderboard?

Introduction to Graph Machine Learning

Organizations

clefourrier's activity

New activity in demo-leaderboard-backend/leaderboard 5 days ago

Change to light background theme

#9 opened 7 days ago by

New activity in gaia-benchmark/leaderboard 5 days ago

Error at test submission

#22 opened 11 days ago by

It seems like at least one submission date is wrong

#21 opened 20 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 5 days ago

How to add task to the leaderboard?

#921 opened 10 days ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 29 days ago

failed open llm leaderboard benchmark

#890 opened 29 days ago by

New activity in open-llm-leaderboard/requests 29 days ago

Failed LLM bechmark test

#55 opened about 1 month ago by

New activity in open-llm-leaderboard-old/results about 1 month ago

Dataset Viewer issue for test results: RowsPostProcessingError

#68 opened 3 months ago by

New activity in gaia-benchmark/GAIA about 1 month ago

How can I check my test result?

#13 opened about 1 month ago by

New activity in demo-leaderboard/gpt2-demo about 1 month ago

Create README.md

#1 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

Failed LLM benchmark request

#882 opened about 1 month ago by

New activity in open-llm-leaderboard/requests about 1 month ago

EpistemeAI

#50 opened about 1 month ago by

New activity in colab-potsdam/multimodal-clem-leaderboard about 1 month ago

Apply for community grant: Academic project (gpu)

#1 opened about 1 month ago by

sherzod-hakimov

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

re-evaluating failed models after fixing the NaN weights

#869 opened about 2 months ago by

New activity in demo-leaderboard-backend/leaderboard about 1 month ago

🚩 Report: Not working

#8 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

NEED A LITTLE HELP

#880 opened about 1 month ago by

maintainers-highlight-submission

#877 opened about 1 month ago by

Surprisingly low score of Rhea-72b-v0.5 and TW3-JRGL-v2

#875 opened about 1 month ago by

What should a finetuned model's license be if the model is MIT but the datasets are Apache 2.0 and cc-by-4.0

#866 opened about 2 months ago by

New activity in gaia-benchmark/leaderboard about 1 month ago

F GAIA, runtime error

#19 opened about 2 months ago by

New activity in gaia-benchmark/results_public about 1 month ago

Upload dataset

#4 opened about 1 month ago by

Upload dataset

#3 opened about 1 month ago by

Delete '2023' config

#2 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 1 month ago

Model deleted from Pending

#850 opened 2 months ago by

Why is the Pending Evaluation Queue not updating?

#870 opened about 1 month ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

Parameter count at 0 for incorrectly detected params is misleading

#867 opened about 2 months ago by

Failed evaluation for model

#865 opened about 2 months ago by

Gemma-2-9B-it scores

#843 opened 2 months ago by

Add fewshot_as_multiturn column

#868 opened about 2 months ago by

Which accuracy rate does IFEval finally use?

#822 opened 3 months ago by

Leaderboard not updating?

#863 opened about 2 months ago by

Llama-3.1-70B fine-tuned failed

#864 opened about 2 months ago by

Model results not showing: dfurman/Qwen2-72B-Orpo-v0.1

#855 opened about 2 months ago by

dynamic rope_scaling on internlm2_5-7b llamafied

#862 opened about 2 months ago by

Feature request: Add non AutoModelForCausalLM models

#391 opened 10 months ago by

KnutJaegersberg

Some suggestions for evaluation priority voting mechanism

#801 opened 3 months ago by

Can't loging to leaderboard to submit or vote. Too many redirects.

#853 opened 2 months ago by

What are "raw" metrics?

#856 opened about 2 months ago by

aginart-salesforce

Jamba model FAILED

#854 opened 2 months ago by

Tweaks / improvements: Add column with parameter count and mouseover labels for datasets

#795 opened 3 months ago by

Is there an issue with adding bos in the new evaluation?

#852 opened 2 months ago by

voting-system-update

#844 opened 2 months ago by

New activity in open-llm-leaderboard/requests about 2 months ago

Renaming Model MaziyarPanahi/Qwen2-72B-Instruct-v0.1 to MaziyarPanahi/calme-2.1-qwen2-72b

#41 opened 2 months ago by

New activity in open-llm-leaderboard/MaziyarPanahi__calme-2.2-llama3-70b-details about 2 months ago

Update README.md

#1 opened about 2 months ago by

New activity in open-llm-leaderboard/results about 2 months ago

Renaming Model MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2 to MaziyarPanahi/calme-2.2-llama3-70b

#4 opened 2 months ago by

New activity in open-llm-leaderboard/requests about 2 months ago

Renaming Model MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.2 to MaziyarPanahi/calme-2.2-llama3-70b

#42 opened 2 months ago by

New activity in open-llm-leaderboard/MaziyarPanahi__calme-2.2-llama3-70b-details about 2 months ago

Rename MaziyarPanahi__Llama-3-70B-Instruct-DPO-v0.2/results_2024-07-17T08-13-13.687245.json to MaziyarPanahi__calme-2.2-llama3-70b/results_2024-07-17T08-13-13.687245.json

#2 opened about 2 months ago by

New activity in open-llm-leaderboard/results about 2 months ago

Renaming Model MaziyarPanahi/Qwen2-72B-Instruct-v0.1 to MaziyarPanahi/calme-2.1-qwen2-72b

#3 opened 2 months ago by

New activity in open-llm-leaderboard/MaziyarPanahi__calme-2.1-qwen2-72b-details about 2 months ago

Update README.md

#1 opened about 2 months ago by

Rename MaziyarPanahi__Qwen2-72B-Instruct-v0.1/results_2024-07-18T06-00-38.574165.json to MaziyarPanahi__calme-2.1-qwen2-72b/results_2024-07-18T06-00-38.574165.json

#2 opened about 2 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

Discussion: naming pattern to converge on to better identify fine-tunes

#761 opened 4 months ago by

commented a paper 2 months ago

Sibyl: Simple yet Effective Agent Framework for Complex Real-world Reasoning

Paper • 2407.10718 • Published Jul 15 • 17 •

New activity in open-llm-leaderboard/open_llm_leaderboard 2 months ago

Wrong results or am i understanding something wrong?

#839 opened 2 months ago by

Small models on MUSR benchmark

#828 opened 2 months ago by

submit-system-update

#838 opened 2 months ago by

How is the score calculated in open-llm-leaderboard

#833 opened 2 months ago by

float32

#834 opened 2 months ago by

How come deepseek v2 is so low in the leaderboard?

#837 opened 2 months ago by

bump-up-gradio_leaderboard

#836 opened 2 months ago by

commented a paper 10 months ago

GAIA: a benchmark for General AI Assistants

Paper • 2311.12983 • Published Nov 21, 2023 • 182 •