Skip to content

blakeli0/datastream-delta-plugins

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

60 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Datastream Delta Plugin for CDAP Delta Application

It invokes GCP Datastream service to generate change events of Oracle DB.

Tests require an actual connection to GCP. To run the tests, set the following system properties:
-Dproject.id=[GCP project id]
Alternatively, you can set -DGCLOUD_PROJECT or -DGOOGLE_CLOUD_PROJECT for GCP project id.
-Dservice.account.file=[path to service account key file]
-Dservice.location=[region of the Datastream instance]
-Doracle.host=[Oracle DB ip address or hostname]
-Doracle.user=[Oracle DB username]
-Doracle.password=[Oracle DB password] -Doracle.database=[Oracle DB SID]
-Dgcs.bucket=[GCSBucket Name for writing Datastream result]
-Doracle.tables=[List of tables to be replicated, separated by comma]
-Dstream.id =[Id of existing Datastream stream id]

The GCP project should already enabled Datastream API.

The service account will need permission to : create/delete/get Datastream connection profiles create/delete/get Datastream streams read from GCS Bucket

The Oracle instance should be configured according to the requirement of Datastream: https://cloud.google.com/datastream/docs/configure-your-source-database

The GCS bucket should be in the same region as Datastream instance and Datastream Service Account should have the permission to write to this bucket.

About

plugins for reading from datastream

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • Java 100.0%