BigCodeArena: Judging code generations end to end with code executions
•
18
AI & ML interests
None defined yet.
Recent Activity
View all activity
Papers
BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex Instructions
Articles
ZennyKenny
posted
an
update
5 days ago
Post
179
What a trip. Just walked through
@burtenshaw
and
@evalstate
tutorial on adding Hugging Face Skills to your Claude Code agent so you can fine tune LLMs by chatting with AI.
These are the kinds of innovations that are going to help everyone benefit from the power of Artificial Intelligence. Well done gentlemen and thank you for sharing.
These are the kinds of innovations that are going to help everyone benefit from the power of Artificial Intelligence. Well done gentlemen and thank you for sharing.
-
- 1 reply
monsoon-nlp
posted
an
update
10 days ago
Post
373
PatchDNA, a DNA foundation model based on Meta's BLT tokenization strategy https://www.biorxiv.org/content/10.1101/2025.11.28.691095v1
ZennyKenny
posted
an
update
10 days ago
Post
243
😐 I keep seeing takes on LinkedIn from American business influencers melting down about Silicon Valley startup "dependence" on open-source Chinese models.
🤔 Can anyone describe a credible scenario where these models can be leveraged by the Chinese government to endanger American security interests or am I right to believe that this is just Red Scare nonsense?
🤔 Can anyone describe a credible scenario where these models can be leveraged by the Chinese government to endanger American security interests or am I right to believe that this is just Red Scare nonsense?
-
- 2 replies
reach-vb
authored
a
paper
13 days ago
ZennyKenny
posted
an
update
20 days ago
Post
420
The #feedback channel of app early access Slack Workspaces is some of the best unintentional comedy material I have ever come across tbh.
ZennyKenny
posted
an
update
23 days ago
ZennyKenny
posted
an
update
about 1 month ago
Post
330
🎉 Novoyaz is live.
A few months ago, I built a quick POC in Hugging Face that used a fine-tuned variant of OpenAI's OSS-20B model that I trained to convert the text from pre-reform Russian-language documents into modern Russian orthography.
⚡️ This morning, I launched novoyaz.io.
This is a production app, the frontend for which I built in like two hours with Lovable, that uses that same fine-tuned model for transliteration, but now has a bunch of extra features that make using it even easier (like taking and uploading pictures with your on-device camera for example 😅).
👉 If you're a researcher, or know a researcher, for whom this app will improve their day-to-day workflows, please get in touch with me.
A few months ago, I built a quick POC in Hugging Face that used a fine-tuned variant of OpenAI's OSS-20B model that I trained to convert the text from pre-reform Russian-language documents into modern Russian orthography.
⚡️ This morning, I launched novoyaz.io.
This is a production app, the frontend for which I built in like two hours with Lovable, that uses that same fine-tuned model for transliteration, but now has a bunch of extra features that make using it even easier (like taking and uploading pictures with your on-device camera for example 😅).
👉 If you're a researcher, or know a researcher, for whom this app will improve their day-to-day workflows, please get in touch with me.
ZennyKenny
posted
an
update
about 1 month ago
Post
343
Anyone got the scoop on a good OCR model that's available on inference?
Keen to make use of an endpoint (gated or not -- happy to pay for usage) for a personal project, but not so keen to pay for the GPU hosting myself.
🙈🙈🙈
Keen to make use of an endpoint (gated or not -- happy to pay for usage) for a personal project, but not so keen to pay for the GPU hosting myself.
🙈🙈🙈
-
- 4 replies
teelinsan
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
327
Has anyone tried Strawberry Browser? https://strawberrybrowser.com/?ref_id=8D41NQCY7
😇 Shamelessly sharing my referral link here to move up in the waitlist line. Help me out, give it a click.
😇 Shamelessly sharing my referral link here to move up in the waitlist line. Help me out, give it a click.
-
- 2 replies
thomwolf
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
2173
Did Hugging Face just ban hammer a bunch of bot accounts or am I just so uninteresting that 30% of my subs dropped me overnight?
😬 Wait, don't answer that.
😬 Wait, don't answer that.
-
- 2 replies
ZennyKenny
authored
a
paper
about 2 months ago
ZennyKenny
posted
an
update
about 2 months ago
Post
222
🔥 BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution from
bigcode
is now available on Hugging Face!
👉 Check out the paper and please drop an upvote if you like the work BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution (2510.08697)
bigcode
is now available on Hugging Face!👉 Check out the paper and please drop an upvote if you like the work BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution (2510.08697)
Ziyang
authored
a
paper
2 months ago
ZennyKenny
posted
an
update
2 months ago
Post
1241
🥊 Big Code Arena is live!
bigcode/arena
💡
bigcode
is an open scientific collaboration working on responsible training of large language models for coding applications.
👉 The Arena ranks LLMs based on their ability to support natural language vibe coding requests in a competitive format, based on feedback from human reviewers.
🧠 It was a pleasure to contribute to this project led by @terryyz and appear as an additional contributor in the Big Code Arena paper.
💡
bigcode
is an open scientific collaboration working on responsible training of large language models for coding applications.👉 The Arena ranks LLMs based on their ability to support natural language vibe coding requests in a competitive format, based on feedback from human reviewers.
🧠 It was a pleasure to contribute to this project led by @terryyz and appear as an additional contributor in the Big Code Arena paper.
ZennyKenny
posted
an
update
2 months ago
Post
8906
🖤 Probably one of my favorite projects that I've worked on so far, introducing Новояз (Novoyaz).
🛠 One of the first acts of the Bolshevik government after the Russian Revolution was the reform and standardization of the Russian language, which at the time had a non-standard and challenging orthography.
📚 Upon its reform the government launched a nationwide campaign called Ликбез (Likbez), which sought to improve literacy in the country (by the way, it worked, bringing the national literacy rate from <20% in the 1920s to >80% by the 1930s).
‼ While this is a remarkable result that should absolutely be celebrated, it's one that has left behind literally hundreds of thousands if not millions of artifacts using pre-reform Russian orthography.
😓 Researchers and historians are working tirelessly to translate these artifacts to modern Russian so that they may be archived and studied but many have told me that. they are doing this BY HAND (!).
💡 I thought, well this is a perfect use case for OCR and a fine-tuned LLM to step in and help to aid in this important work!
🌏 Introducing НОВОЯЗ (NOVOYAZ)! Powered by ChatDOC/OCRFlux-3B and https://huggingface.co/ZennyKenny/oss-20b-prereform-to-modern-ru-merged, researchers can now convert images of their pre-reform documents to modern Russian orthography using the power of open-source AI!
Check it out and drop a like to support more real-world use cases for open source AI outside of traditional tech-centric domains!
ZennyKenny/Novoyaz
🛠 One of the first acts of the Bolshevik government after the Russian Revolution was the reform and standardization of the Russian language, which at the time had a non-standard and challenging orthography.
📚 Upon its reform the government launched a nationwide campaign called Ликбез (Likbez), which sought to improve literacy in the country (by the way, it worked, bringing the national literacy rate from <20% in the 1920s to >80% by the 1930s).
‼ While this is a remarkable result that should absolutely be celebrated, it's one that has left behind literally hundreds of thousands if not millions of artifacts using pre-reform Russian orthography.
😓 Researchers and historians are working tirelessly to translate these artifacts to modern Russian so that they may be archived and studied but many have told me that. they are doing this BY HAND (!).
💡 I thought, well this is a perfect use case for OCR and a fine-tuned LLM to step in and help to aid in this important work!
🌏 Introducing НОВОЯЗ (NOVOYAZ)! Powered by ChatDOC/OCRFlux-3B and https://huggingface.co/ZennyKenny/oss-20b-prereform-to-modern-ru-merged, researchers can now convert images of their pre-reform documents to modern Russian orthography using the power of open-source AI!
Check it out and drop a like to support more real-world use cases for open source AI outside of traditional tech-centric domains!
ZennyKenny/Novoyaz
ZennyKenny
posted
an
update
2 months ago
Post
560
🔒 Like a lot of other AI builders, I have some anxiety about the emerging surveillance-capitalist paradigm emerging in the AI space.
👉 Of course-- this kind of thing isn't completely new and has been going on for decades, but the difference is the stronger immersion of AI tools into our daily lives (compared to something like a search engine or social network).
❕ That's why I was really excited to come across Lumo: https://lumo.proton.me/u/1/
❕ Lumo is created by
ProtonPrivacy
and offers privacy-first features that make sure that what you do with you AI assistant is your business.
❕ I already trust Proton with my other business apps and I've never been disappointed, plus the Lumo architecture is really fantastic, dynamically routing each query to the most appropriate model for the request.
🔥 Really awesome stuff Proton, thank you as always.
👉 Of course-- this kind of thing isn't completely new and has been going on for decades, but the difference is the stronger immersion of AI tools into our daily lives (compared to something like a search engine or social network).
❕ That's why I was really excited to come across Lumo: https://lumo.proton.me/u/1/
❕ Lumo is created by
ProtonPrivacy
and offers privacy-first features that make sure that what you do with you AI assistant is your business.❕ I already trust Proton with my other business apps and I've never been disappointed, plus the Lumo architecture is really fantastic, dynamically routing each query to the most appropriate model for the request.
🔥 Really awesome stuff Proton, thank you as always.
monsoon-nlp
posted
an
update
3 months ago
Post
456
Bio LLMs train on many genomes, but can we encode differences within a species? TomatoTomato adds pangenome tokens to represent a domestic tomato and a wild tomato in one sequence 🍅 🧬
monsoon-nlp/tomatotomato-gLM2-150M-v0.1
monsoon-nlp/tomatotomato-gLM2-150M-v0.1
ZennyKenny
posted
an
update
3 months ago
Post
2381
The reactions to
mostlyai/synthetic-sdk-demo have been incredible! 🔥
Some users wrote that they were having performance issues on larger datasets, so I've capped the Space's input to 5000 rows and 10 columns, but you can always use the open source SDK that powers the space any time you want on datasets of arbitrary size and shape!
Check it out: https://github.com/mostly-ai/mostlyai 👈
Some users wrote that they were having performance issues on larger datasets, so I've capped the Space's input to 5000 rows and 10 columns, but you can always use the open source SDK that powers the space any time you want on datasets of arbitrary size and shape!
Check it out: https://github.com/mostly-ai/mostlyai 👈