getdeps generate-github-actions: collapse per-dep build pyramid into single recursive step

Summary:
Replace the per-dep `Build <dep>` / `Cache <dep>` step pyramid in generated GitHub Actions workflows with a single `Build <project> --recursive` step. With sccache enabled by default (since 6c880b17) we do not need per-dep builds.

Changes:
- `workflow_generator.py`: remove the per-dep deps loop, `has_same_repo_dep`, `no_deps_arg`, `free_up_disk_arg`, and `--use-build-cache` CLI flag; `final_build_cmd` now always passes `--recursive --src-dir=.`
- `templates/workflow.yml.j2`: remove `cache_restore`/`cache_save` macros and the `for dep in deps` loop
- `test/workflow_generator_test.py`: drop `use_build_cache` from base args
- Golden fixtures and all OSS project workflows regenerated via `update-all-github-actions.sh`

Reviewed By: bigfootjon

Differential Revision: D106028158

fbshipit-source-id: e1d69616fe85553b0d00b6822988dac58bec9c3c

Author: r-barnes

.github/workflows/getdeps_linux.yml

@@ -157,148 +157,8 @@ jobs:
       if: ${{ steps.paths.outputs.fbthrift_SOURCE }}
       run: python3 build/fbcode_builder/getdeps.py --allow-system-packages fetch --no-tests fbthrift
 
-    - name: Build libaio
-      if: ${{ steps.paths.outputs.libaio_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libaio
-
-    - name: Build ninja
-      if: ${{ steps.paths.outputs.ninja_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests ninja
-
-    - name: Build cmake
-      if: ${{ steps.paths.outputs.cmake_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests cmake
-
-    - name: Build benchmark
-      if: ${{ steps.paths.outputs.benchmark_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests benchmark
-
-    - name: Build fmt
-      if: ${{ steps.paths.outputs.fmt_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests fmt
-
-    - name: Build googletest
-      if: ${{ steps.paths.outputs.googletest_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests googletest
-
-    - name: Build xxhash
-      if: ${{ steps.paths.outputs.xxhash_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests xxhash
-
-    - name: Build zstd
-      if: ${{ steps.paths.outputs.zstd_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests zstd
-
-    - name: Build zlib
-      if: ${{ steps.paths.outputs.zlib_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests zlib
-
-    - name: Build boost
-      if: ${{ steps.paths.outputs.boost_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests boost
-
-    - name: Build double-conversion
-      if: ${{ steps.paths.outputs.double-conversion_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests double-conversion
-
-    - name: Build fast_float
-      if: ${{ steps.paths.outputs.fast_float_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests fast_float
-
-    - name: Build gflags
-      if: ${{ steps.paths.outputs.gflags_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests gflags
-
-    - name: Build glog
-      if: ${{ steps.paths.outputs.glog_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests glog
-
-    - name: Build libdwarf
-      if: ${{ steps.paths.outputs.libdwarf_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libdwarf
-
-    - name: Build libevent
-      if: ${{ steps.paths.outputs.libevent_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libevent
-
-    - name: Build lz4
-      if: ${{ steps.paths.outputs.lz4_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests lz4
-
-    - name: Build openssl
-      if: ${{ steps.paths.outputs.openssl_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests openssl
-
-    - name: Build snappy
-      if: ${{ steps.paths.outputs.snappy_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests snappy
-
-    - name: Build magic_enum
-      if: ${{ steps.paths.outputs.magic_enum_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests magic_enum
-
-    - name: Build sparsemap
-      if: ${{ steps.paths.outputs.sparsemap_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests sparsemap
-
-    - name: Build liboqs
-      if: ${{ steps.paths.outputs.liboqs_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests liboqs
-
-    - name: Build autoconf
-      if: ${{ steps.paths.outputs.autoconf_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests autoconf
-
-    - name: Build automake
-      if: ${{ steps.paths.outputs.automake_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests automake
-
-    - name: Build libtool
-      if: ${{ steps.paths.outputs.libtool_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libtool
-
-    - name: Build numa
-      if: ${{ steps.paths.outputs.numa_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests numa
-
-    - name: Build libiberty
-      if: ${{ steps.paths.outputs.libiberty_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libiberty
-
-    - name: Build libsodium
-      if: ${{ steps.paths.outputs.libsodium_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libsodium
-
-    - name: Build libunwind
-      if: ${{ steps.paths.outputs.libunwind_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests libunwind
-
-    - name: Build xz
-      if: ${{ steps.paths.outputs.xz_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests xz
-
-    - name: Build folly
-      if: ${{ steps.paths.outputs.folly_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests folly
-
-    - name: Build fizz
-      if: ${{ steps.paths.outputs.fizz_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests fizz
-
-    - name: Build wangle
-      if: ${{ steps.paths.outputs.wangle_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests wangle
-
-    - name: Build mvfst
-      if: ${{ steps.paths.outputs.mvfst_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests mvfst
-
-    - name: Build fbthrift
-      if: ${{ steps.paths.outputs.fbthrift_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --free-up-disk --no-tests fbthrift
-
     - name: Build cachelib
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --src-dir=. cachelib --project-install-prefix cachelib:/usr/local
+      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --recursive --src-dir=. cachelib --project-install-prefix cachelib:/usr/local
 
     - name: Show sccache stats
       if: always()

build/fbcode_builder/getdeps/templates/workflow.yml.j2

@@ -5,25 +5,6 @@ Jinja delimiters here are doubled angle brackets (variables) and angle-percent
 The Jinja env is configured trim_blocks + lstrip_blocks, so block tags on
 their own line consume the whole line cleanly without `-` stripping markers.
 #>
-<% macro cache_restore(name) %>
-    - name: Restore <<name>> from cache
-      id: restore_<<name>>
-      if: ${{ steps.paths.outputs.<<name>>_SOURCE }}
-      uses: actions/cache/restore@v4
-      with:
-       path: ${{ steps.paths.outputs.<<name>>_INSTALL }}
-       key: ${{ steps.paths.outputs.<<name>>_CACHE_KEY }}-install
-<%- endmacro %>
-
-<% macro cache_save(name) %>
-    - name: Save <<name>> to cache
-      uses: actions/cache/save@v4
-      if: ${{ steps.paths.outputs.<<name>>_SOURCE && ! steps.restore_<<name>>.outputs.cache-hit }}
-      with:
-       path: ${{ steps.paths.outputs.<<name>>_INSTALL }}
-       key: ${{ steps.paths.outputs.<<name>>_CACHE_KEY }}-install
-<%- endmacro %>
-
 # This file was <<"@" + "generated">> by getdeps.py
 
 name: <<job_name>>
@@ -146,21 +127,6 @@ jobs:
 <% endfor %>
 <% endif %>
 
-    <# Per-dep build (with optional cache restore + save) #>
-<% for dep in deps %>
-<% if dep.use_cache %>
-<<cache_restore(dep.name)>>
-<% endif %>
-    - name: Build <<dep.name>>
-<% if dep.if_clause %>
-      if: ${{ <<dep.if_clause>> }}
-<% endif %>
-      run: <<dep.build_cmd>>
-<% if dep.use_cache %>
-<<cache_save(dep.name)>>
-<% endif %>
-
-<% endfor %>
 <% if free_up_disk_before_build and not is_windows %>
     - name: Free up disk space before build
       run: |

build/fbcode_builder/getdeps/test/fixtures/expected/folly_shared_libs/getdeps_shared-libs_linux.yml

@@ -124,104 +124,8 @@ jobs:
       if: ${{ steps.paths.outputs.xz_SOURCE }}
       run: python3 build/fbcode_builder/getdeps.py --allow-system-packages fetch --no-tests xz
 
-    - name: Build boost
-      if: ${{ steps.paths.outputs.boost_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests boost
-
-    - name: Build libaio
-      if: ${{ steps.paths.outputs.libaio_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libaio
-
-    - name: Build openssl
-      if: ${{ steps.paths.outputs.openssl_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests openssl
-
-    - name: Build ninja
-      if: ${{ steps.paths.outputs.ninja_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests ninja
-
-    - name: Build cmake
-      if: ${{ steps.paths.outputs.cmake_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests cmake
-
-    - name: Build double-conversion
-      if: ${{ steps.paths.outputs.double-conversion_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests double-conversion
-
-    - name: Build fast_float
-      if: ${{ steps.paths.outputs.fast_float_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests fast_float
-
-    - name: Build fmt
-      if: ${{ steps.paths.outputs.fmt_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests fmt
-
-    - name: Build gflags
-      if: ${{ steps.paths.outputs.gflags_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests gflags
-
-    - name: Build glog
-      if: ${{ steps.paths.outputs.glog_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests glog
-
-    - name: Build googletest
-      if: ${{ steps.paths.outputs.googletest_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests googletest
-
-    - name: Build libdwarf
-      if: ${{ steps.paths.outputs.libdwarf_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libdwarf
-
-    - name: Build libevent
-      if: ${{ steps.paths.outputs.libevent_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libevent
-
-    - name: Build zlib
-      if: ${{ steps.paths.outputs.zlib_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests zlib
-
-    - name: Build lz4
-      if: ${{ steps.paths.outputs.lz4_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests lz4
-
-    - name: Build snappy
-      if: ${{ steps.paths.outputs.snappy_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests snappy
-
-    - name: Build zstd
-      if: ${{ steps.paths.outputs.zstd_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests zstd
-
-    - name: Build autoconf
-      if: ${{ steps.paths.outputs.autoconf_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests autoconf
-
-    - name: Build automake
-      if: ${{ steps.paths.outputs.automake_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests automake
-
-    - name: Build libtool
-      if: ${{ steps.paths.outputs.libtool_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libtool
-
-    - name: Build libiberty
-      if: ${{ steps.paths.outputs.libiberty_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libiberty
-
-    - name: Build libsodium
-      if: ${{ steps.paths.outputs.libsodium_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libsodium
-
-    - name: Build libunwind
-      if: ${{ steps.paths.outputs.libunwind_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests libunwind
-
-    - name: Build xz
-      if: ${{ steps.paths.outputs.xz_SOURCE }}
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --free-up-disk --no-tests xz
-
     - name: Build folly
-      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --src-dir=. folly --project-install-prefix folly:/usr/local
+      run: python3 build/fbcode_builder/getdeps.py --allow-system-packages build --build-type RelWithDebInfo --shared-lib --recursive --src-dir=. folly --project-install-prefix folly:/usr/local
 
     - name: Show sccache stats
       if: always()