Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

README.md

Connecting Ruby and Apache DataFusion with ADBC

Instructions

Prerequisites

  1. Install Ruby

  2. Install dbc

  3. Ensure the native Arrow GLib and ADBC GLib libraries required by red-adbc are installed and discoverable. If bundle install reports missing arrow, arrow-glib, or adbc-glib, use the platform-specific commands below.

    macOS with Homebrew
    brew install apache-arrow-glib apache-arrow-adbc-glib
    Debian/Ubuntu
    sudo apt install libarrow-glib-dev libadbc-glib-dev
    RHEL-compatible distributions
    sudo dnf install arrow-glib-devel adbc-glib-devel
    Windows with RubyInstaller/MSYS2 UCRT64
    pacman -S --needed mingw-w64-ucrt-x86_64-arrow mingw-w64-ucrt-x86_64-arrow-adbc-glib

    If you use a different MSYS2 environment, adjust the package prefix to match it; for example, use mingw-w64-x86_64-* from the MINGW64 shell.

  4. Install Ruby dependencies:

    bundle install

    If you have multiple Ruby installations, ensure ruby and bundle resolve to the same installation before running this command.

Connect to DataFusion

  1. Install the DataFusion ADBC driver:

    dbc install --level user datafusion
  2. Customize the Ruby script main.rb as needed

    • Change the SQL SELECT statement in connection.query(), or keep it set to SELECT * FROM 'games.parquet'; to query the Parquet file included with this example
    • The SET statement disables DataFusion's Arrow StringView output for Parquet scans so that the results can be decoded and formatted by red-arrow; keep it as is
      • If you change the query to produce string columns another way (for example, casting to VARCHAR), you may also need to set datafusion.sql_parser.map_string_types_to_utf8view = false
  3. Run the Ruby script:

    bundle exec ruby main.rb