Add field element comparison script (#504)

* bench vs others

* Standarize guest

* Fix decimals

* Benchmark vs sp1

* Add lambda program

* Remove stray blank line from .gitignore

* Apply suggestion from @gabrielbosio

Co-authored-by: Gabriel Bosio <38794644+gabrielbosio@users.noreply.github.com>

* Add instruments

* Fix syscall number

* Add runtime private inputs, nightly CI workflow, and 500M step projection to bench_vs

* save work

* Fix bench_vs 5x projection inflation and add
  --steps flag for nightly 1M/2M/4M/8M benchmarks

* Switch bench_vs projection to measured cycles and add --cycles
  CLI flag

* Fix grep pipefail in
  bench_vs/run.sh by switching to sed

* Add main field element comparison script for Lambda VM vs SP1 v5/v6

* Add aux elements counting to lambda an sp1 v5

* Fix aux element counting in sp1, guard Lambda VM CLI failure, clarify metric descriptions and ratio legend

* Fix doc, pin version, add test

* check division by zero and extension degree in v5

* Exclude preprocessed columns to match sp1

* Destructure traces

* Change debug_assert fo assert, add verify call for parity with v6, and rename aux output label

* Use usr/bin/env bash

* Remove empty build.rs and unused rust-toolchain, and add --lambda-only, --sp1-only, --report-dir, --no-color flags

* exclude lines of code

---------

Co-authored-by: MauroFab <maurotoscano2@gmail.com>
Co-authored-by: Mauro Toscano <12560266+MauroToscano@users.noreply.github.com>
Co-authored-by: Gabriel Bosio <38794644+gabrielbosio@users.noreply.github.com>
Co-authored-by: jotabulacios <jbulacios@fi.uba.ar>

Author: 4 people

.github/workflows/bench-vs-nightly.yml

@@ -33,10 +33,10 @@ jobs:
       - name: Install SP1 toolchain
         run: |
           export PATH="$HOME/.cargo/bin:$HOME/.sp1/bin:$PATH"
-          if ! cargo prove --version >/dev/null 2>&1; then
+          if ! cargo prove --version 2>/dev/null | grep -qE '\b6\.0\.1\b'; then
             curl -L https://sp1up.succinct.xyz | bash
             export PATH="$HOME/.sp1/bin:$PATH"
-            sp1up
+            sp1up --version v6.0.1
           fi
           cargo prove --version
 

bench_vs/run.sh

@@ -1,4 +1,4 @@
-#!/bin/bash
+#!/usr/bin/env bash
 # Benchmark: Lambda VM vs SP1 v6 — Fibonacci proving time comparison.
 #
 # Usage: ./bench_vs/run.sh [-n 1000 50000 100000 | --steps 1000000 2000000]