Deleting the wiki page 'If there's Intelligent Life out There' cannot be undone. Continue?
1
If there's Intelligent Life out There
Abby McPhee edited this page 2 weeks ago
Optimizing LLMs to be good at specific tests backfires on Meta, Stability.
-.
-.
-.
-.
-.
-.
-
When you acquire through links on our site, we may make an affiliate commission. Here's how it works.
Hugging Face has actually launched its 2nd LLM leaderboard to rank the very best language models it has checked. The new leaderboard seeks to be a more challenging consistent standard for checking open large language design (LLM) efficiency throughout a variety of jobs. Alibaba's Qwen models appear dominant in the leaderboard's inaugural rankings, taking 3 areas in the leading 10.
Pumped to reveal the brand new open LLM leaderboard. We burned 300 H100 to re-run brand-new assessments like MMLU-pro for all major open LLMs!Some learning:- Qwen 72B is the king and Chinese open designs are controling overall- Previous assessments have actually ended up being too easy for recent ... June 26, 2024
Hugging Face's second leaderboard tests language models across 4 tasks: knowledge testing, thinking on extremely long contexts, intricate math abilities, and instruction following. Six benchmarks are utilized to check these qualities, with tests including solving 1,000-word murder secrets, explaining PhD-level concerns in layman's terms, and a lot of challenging of all: formulas. A complete breakdown of the standards used can be found on Hugging Face's blog.
The frontrunner of the brand-new leaderboard is Qwen, annunciogratis.net Alibaba's LLM, which takes 1st, 3rd, and 10th place with its handful of versions. Also appearing are Llama3-70B, Meta's LLM, and a handful of smaller open-source tasks that handled to outperform the pack. Notably absent is any indication of ChatGPT
Delete Page