Skip to content

bigquery-data-replication.md

Latest commit

 

History

History
106 lines (78 loc) · 4.51 KB

bigquery-data-replication.md

File metadata and controls

106 lines (78 loc) · 4.51 KB
Raw

Replication Flows – SAP Datasphere and Google BigQuery

Background

SAP Datasphere introduced Replication Flows starting with version 2021.03. This feature enables fast and seamless copying of multiple tables from a source system to a target system.

📖 For more details on replication flows, please refer to the official documentation.

This guide demonstrates how to replicate data from SAP sources to Google BigQuery.

Steps

  1. Create a Connection in SAP Datasphere to Google BigQuery

    • Follow Step 4: "Creating Google BigQuery Connection" from this link for a detailed walkthrough.

  2. Ensure You Have a Dataset in BigQuery

    • Create a dataset where replicated tables will be stored.

  3. Ensure You Have a Source Connection in BigQuery

    • Go to Connections in SAP Datasphere.
    • Set up a connection to your SAP source (e.g., S/4HANA Cloud).

  4. Start a New Replication Flow

    • In SAP Datasphere, navigate to Data Builder.
    • Click on New Replication Flow. create replication flow in dsp

  5. Select Source Connection

    • Choose the source connection (e.g., S/4HANA Cloud). create replication flow in dsp

  6. Select Source connection

    • Choose SAP S4 HANA. choose source in dsp

  7. Select Source Container
    select source container in dsp

  8. Choose CDS Extraction

    • CDS Views Enabled for Extraction.
    • Click Select. choose CDS extraction in dsp

  9. Add Source Objects

    • Click Add Source Objects and select the CDS Views to replicate.
    • You can select multiple views. Click Add Selection once finalized. add source objects select objects confirm objects

  10. Select Target Connection

  • Choose Google BigQuery as the target.
  • (💡 If errors occur, see the note at the end.) select target connection
  1. Choose Target Container
  • Select the BigQuery dataset created in step 2. choose the target container choose the target container

  1. Set Load Type

    • Click the middle Settings section.
    • Choose between:
      • Initial – one-time full load
      • Initial and Delta – full load + periodic (every 60 minutes) delta updates data setting

  2. Edit Projections (Filters & Mapping)

  3. Modify Write Settings (Optional)

    • Use the Settings icon next to the target connection name to adjust target write behavior.

  4. Finalize and Run Replication Flow

    • Rename the replication flow via the right details panel.
    • Click Save, then Deploy, and finally Run using the top toolbar.
    • Monitor the replication in Data Integration Monitor on the left panel. rename the replication flow save the replication flow deploy the replication flow run the replication flow

  5. View Target Tables in BigQuery

    • Once replication completes, you’ll see the replicated tables in BigQuery.
    • Each table will include three additional columns for delta tracking:
      • operation_flag
      • recordstamp
      • is_deleted select target table

⚠️ Note: You may need to include the Premium Outbound Integration block in your SAP Datasphere tenant to deploy replication flows. include Premium Outbound Integration block

Conclusion

You’ve now successfully created a replication flow from SAP S/4HANA Cloud to Google BigQuery using SAP Datasphere.

If you have questions, feel free to leave a comment below. Thank you!