Programming by Backprop

Code for our ICLR 2026 paper.

Name		Name	Last commit message	Last commit date
Latest commit History 198 Commits
.vscode		.vscode
checkpointing		checkpointing
config		config
data		data
evaluation		evaluation
finetuning		finetuning
tmp		tmp
.gitignore		.gitignore
=2.0.0		=2.0.0
Dockerfile		Dockerfile
README.md		README.md
compose.yml		compose.yml
create_io_data.py		create_io_data.py
deepspeed_conf.yaml		deepspeed_conf.yaml
eval.sh		eval.sh
extract_lighteval_outputs.py		extract_lighteval_outputs.py
gen_A_inputs.txt		gen_A_inputs.txt
generate.sh		generate.sh
generate_B_inputs.txt		generate_B_inputs.txt
last_checkpoint.txt		last_checkpoint.txt
lighteval.sh		lighteval.sh
parse_A_inputs.txt		parse_A_inputs.txt
parse_B_inputs.txt		parse_B_inputs.txt
pbb_eval.py		pbb_eval.py
pbb_eval_mn.py		pbb_eval_mn.py
pbb_generate.py		pbb_generate.py
pbb_lighteval.py		pbb_lighteval.py
pbb_main.py		pbb_main.py
pbb_stage_1_retroactive.out		pbb_stage_1_retroactive.out
plot_pass_at_k.py		plot_pass_at_k.py
requirements.txt		requirements.txt
temp.py		temp.py
temp.txt		temp.txt
temp2.txt		temp2.txt
test.tct		test.tct
test.txt		test.txt
test_file.txt		test_file.txt
train.sh		train.sh
train_multinode_deepspeed.sh		train_multinode_deepspeed.sh

Provide feedback