Datasets processed from MOSS for Fine-Tuning
Matthew Khoriaty
AMindToThink
AI & ML interests
None yet
Recent Activity
liked a dataset 1 day ago
Eccentricity/bashbench2 updated a model about 1 month ago
AMindToThink/code-detection-confound-checkpoints published a model about 1 month ago
AMindToThink/code-detection-confound-checkpointsOrganizations
None yet
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 11 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 8 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 15 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 6 •
Datasets processed from MOSS for Fine-Tuning
RMU: bio forget corpora. cyber: cyber forget. both wikitext retain
https://arxiv.org/abs/2410.19278.
The code https://github.com/AMindToThink/wmdp.
-
AMindToThink/gemma-2-2b-it_RMU_s100_a300_layer3
Text Generation • 3B • Updated • 11 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a100_layer3
Text Generation • 3B • Updated • 8 -
AMindToThink/gemma-2-2b-it_RMU_s100_a500_layer3
Text Generation • 3B • Updated • 15 • -
AMindToThink/gemma-2-2b-it_RMU_s100_a1200_layer3
Text Generation • 3B • Updated • 6 •
models 125
AMindToThink/code-detection-confound-checkpoints
Updated
AMindToThink/folder_structure_test
Updated
AMindToThink/ppo_with_value15
Updated
AMindToThink/ppo_with_value14
Updated
AMindToThink/ppo_push_main_13
Text Generation • 0.2B • Updated • 6
AMindToThink/ppo_push_main_12
0.2B • Updated • 2
AMindToThink/ppo_on_value_no_value11
0.2B • Updated • 3
AMindToThink/pushed_value_model
Text Classification • 0.1B • Updated • 5
AMindToThink/value_model_0
Text Classification • 0.1B • Updated • 4
AMindToThink/ppo
Text Generation • 0.2B • Updated • 10
datasets 8
AMindToThink/olmo-2-1124-7b-four-stage-samples-rlhf-diversity
Preview • Updated • 41
AMindToThink/moss-002-sft-data-instruction-output-ascii-only
Viewer • Updated • 1.75M • 41
AMindToThink/openthoughts-as-assistant-for-sft
Viewer • Updated • 114k • 33
AMindToThink/common_bugs
Viewer • Updated • 45 • 35
AMindToThink/moss-002-sft-data-instruction-output
Viewer • Updated • 3.53M • 36 • 1
AMindToThink/mmlu_wmdp_combined
Viewer • Updated • 4.74k • 49
AMindToThink/mmlu_wmdp_bio_combined
Viewer • Updated • 1.43k • 16
AMindToThink/wmdp-cyber-corpus_unpaired-preference
Viewer • Updated • 5.47k • 17