basically-ai/Pebble-10M-Chat
Text Generation • 11.1M • Updated • 41 • 4
👽 Big things for X3
Dan P
Datdanboi25
AI & ML interests
Axiomic Labs Founder
Mechatronics engineer, LLMs, Vision Models, Embedding Models
Recent Activity
liked a model about 7 hours ago
basically-ai/Pebble-10M-Chat liked a model about 7 hours ago
basically-ai/Pebble-10MOrganizations
liked 2
models about 7 hours ago
reacted to Hoglet-33's post with 🔥 about 8 hours ago
Post
669
Pebble 10M and Pebble 10M Chat are now released!
Both models use our Mamba/Transformer 3:1 hybrid architecture and were pretrained on 25 billion tokens.
Pebble 10M Chat was additionally fine-tuned on 250 million tokens of Smol-SmolTalk to improve its conversational capabilities.
You can find them here:
- basically-ai/Pebble-10M
- basically-ai/Pebble-10M-Chat
We hope you enjoy using them. The rest of the Pebble family will be released soon.
Follow for more:
@Hoglet-33
basically-ai
Both models use our Mamba/Transformer 3:1 hybrid architecture and were pretrained on 25 billion tokens.
Pebble 10M Chat was additionally fine-tuned on 250 million tokens of Smol-SmolTalk to improve its conversational capabilities.
You can find them here:
- basically-ai/Pebble-10M
- basically-ai/Pebble-10M-Chat
We hope you enjoy using them. The rest of the Pebble family will be released soon.
Follow for more:
@Hoglet-33
liked a
model about 11 hours ago
Add bench-labs/cagliostro-v2 (150M, Index 20.05)
1
#118 opened about 20 hours ago
by 
TobiasLogic
Hmm interesting!
Haha just kidding, seems like loops are the benchmaxxing direction nowadays, I will resist it though (for now).
NOOOOO banaxi, resist the temptation
Very true
reacted to appvoid's post with 🔥 1 day ago
Post
2277
Love how the small lm community is getting identity over time:
- Channel-Mixing
- XSA
- Three-tower
- Digit aware
- Loops
No one is doing the same! That's so cool.
- Channel-Mixing
- XSA
- Three-tower
- Digit aware
- Loops
No one is doing the same! That's so cool.
- 34 replies
Do you guys have any small model tips?
3
#2 opened 2 days ago
by 
Bc-AI
liked a
Space 1 day ago
liked a
model 1 day ago
Important Bug Report
3
#1 opened 2 days ago
by Banaxi-Tech
reacted to Bc-AI's post with 🔥 1 day ago
Post
2003
Hello everyone! Happy to say that MiniCoder-1 is now in the instruction tuning phase. It is a 216M~ parameter model trained on 16B tokens. It ran on an RTX 6000 Pro Blackwell gpu for around 24~ hours. Now we will do SFT and launch as beta while we work on the final important DPO and RLHF phases. Our goal is a small extreemly fast on device coding assistant with CoT reasoning* baked in! - Bc-AI on behalf of the Smilyai-Labs team
*it is a small model so the reasoning quality wont be as good obviously!
*it is a small model so the reasoning quality wont be as good obviously!
- 2 replies
Congrats!
❤️ 1
#1 opened 2 days ago
by Datdanboi25
reacted to Banaxi-Tech's post with 🔥 2 days ago
Post
2128
We have updated the BananaMind Base Bench leaderboard!
We now have these benchmark cards, they make it way easier to see which models are actually good!
We've also added the model advisor. It asks you what you want to use the model for and the parameter range and gives you the best model for your task!
Try it out at BananaMind/BananaMindBench-Leaderboard
And please give us a follow to BananaMind!
BananaMind
@Banaxi-Tech
We now have these benchmark cards, they make it way easier to see which models are actually good!
We've also added the model advisor. It asks you what you want to use the model for and the parameter range and gives you the best model for your task!
Try it out at BananaMind/BananaMindBench-Leaderboard
And please give us a follow to BananaMind!
@Banaxi-Tech
- 1 reply
Add Kite 7
1
#116 opened 3 days ago
by 
qikp
liked a
dataset 2 days ago
Add Haidass1.5-143M
🤗🚀 6
2
#115 opened 3 days ago
by 
Chillilly88