Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ED-1231 - Add oci oss support for Build/DataPipeline/AnalyticsCore (#… #163

Merged
merged 2 commits into from
Oct 18, 2023

Commits on Jun 6, 2023

  1. ED-1231 - Add oci oss support for Build/DataPipeline/AnalyticsCore (#155

    )
    
    * Issue #DD-2269 | Special characters issue fixes for sourcing metrics job (#148)
    
    * updated cloud-store-sdk version to 1.4.6
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added the oci datafetcher
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added oci switch for datafetcher
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * workaroud to build from branches and tags
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added a customocistorage service
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * rearanged newstorage service
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * reverted the change for reordering
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * changed method pararmter for customoci storage
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * changed the storage type to oci
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * Changes for s3 configuration
    
    * testing with spark 3.2 version
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * reverting to spark 3.1.0
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * Updated spark version and using aws-s3 config
    
    * Added print statements
    
    * Added print statements
    
    * added oci specific hadoop conf
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated newstoreageservice
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added debug
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated customoci storage
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated customoci storage serivce
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * changed CustomOCIStorageService
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * changed back CustomOCIStorageService
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated dataset to include oci
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added oci switch for fileprefix
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated dispatcher
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated oci spark conf
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated jets3t version
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added debug logs
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added oci support for merge util
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * Changed the storage type to s3
    
    * Added mergeType value in the exception message
    
    * removed debug prints
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * testing with jackson-core 2.1.2
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * added slack test values
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * testing with jackson core 2.10.0
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * testing with jackson core 2.11.0
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * testing with jackson core 2.12.0
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * removed debug prints
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    * updated to use aws_storage_key and aws_storage_secret
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    
    ---------
    
    Signed-off-by: Deepak Devadathan <deepak.devadathan@oracle.com>
    Co-authored-by: Kumar <kumarks1122@gmail.com>
    Co-authored-by: subhash_chandra_budde <subhash.chandra.budde@oracle.com>
    3 people authored Jun 6, 2023
    Configuration menu
    Copy the full SHA
    3099d7d View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Configuration menu
    Copy the full SHA
    23bd714 View commit details
    Browse the repository at this point in the history