)
* Issue #DD-2269 | Special characters issue fixes for sourcing metrics job (#148)
* updated cloud-store-sdk version to 1.4.6
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added the oci datafetcher
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added oci switch for datafetcher
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* workaroud to build from branches and tags
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added a customocistorage service
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* rearanged newstorage service
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* reverted the change for reordering
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* changed method pararmter for customoci storage
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* changed the storage type to oci
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* Changes for s3 configuration
* testing with spark 3.2 version
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* reverting to spark 3.1.0
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* Updated spark version and using aws-s3 config
* Added print statements
* Added print statements
* added oci specific hadoop conf
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated newstoreageservice
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added debug
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated customoci storage
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated customoci storage serivce
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* changed CustomOCIStorageService
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* changed back CustomOCIStorageService
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated dataset to include oci
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added oci switch for fileprefix
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated dispatcher
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated oci spark conf
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated jets3t version
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added debug logs
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added oci support for merge util
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* Changed the storage type to s3
* Added mergeType value in the exception message
* removed debug prints
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* testing with jackson-core 2.1.2
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* added slack test values
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* testing with jackson core 2.10.0
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* testing with jackson core 2.11.0
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* testing with jackson core 2.12.0
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* removed debug prints
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
* updated to use aws_storage_key and aws_storage_secret
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
---------
Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
Co-authored-by: Kumar <kumarks1122@gmail.com>
Co-authored-by: subhash_chandra_budde <subhash.chandra.budde@oracle.com>