Skip to content

Commit

Permalink
Merge pull request apache#50 from liyinan926/master
Browse files Browse the repository at this point in the history
Deleted gobblin-test/build.gradle
  • Loading branch information
liyinan926 committed Mar 13, 2015
2 parents d04ccfc + 38736d5 commit c10e6c0
Show file tree
Hide file tree
Showing 4 changed files with 10 additions and 69 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,8 @@
Gobblin is a universal data ingestion framework for extracting, transforming, and loading large volume of data from a variety of data sources, e.g., databases, rest APIs, FTP/SFTP servers, filers, etc., onto Hadoop. Gobblin handles the common routine tasks required for all data ingestion ETLs, including job/task scheduling, task partitioning, error handling, state management, data quality checking, data publishing, etc. Gobblin ingests data from different data sources in the same execution framework, and manages metadata of different sources all in one place. This, combined with other features such as auto scalability, fault tolerance, data quality assurance, extensibility, and the ability of handling data model evolution, makes Gobblin an easy-to-use, self-serving, and efficient data ingestion framework.

## Documentation
Check out the Gobblin documentation at [https://github.com/linkedin/gobblin/wiki](https://github.com/linkedin/gobblin/wiki)

Check out the Gobblin documentation at [https://github.com/linkedin/gobblin/wiki](https://github.com/linkedin/gobblin/wiki).

## Getting Started

Expand Down Expand Up @@ -42,7 +43,6 @@ Out of the box, Gobblin can run either in standalone mode on a single box or on
Please refer to the page [Getting Started](https://github.com/linkedin/gobblin/wiki/Getting%20Started)
in the documentation on how to run the examples.


## Configuration

Please refer to the page [Configuration Glossary](https://github.com/linkedin/gobblin/wiki/Configuration%20Properties%20Glossary)
Expand Down
14 changes: 7 additions & 7 deletions bin/gobblin-standalone.sh
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ FWDIR_CONF=$FWDIR/conf

function print_usage(){
echo "gobblin-standalone.sh <start | status | restart | stop> [OPTION]"
echo "Where:"
echo "Where OPTION can be:"
echo " --workdir <job work dir> Gobblin's base work directory: if not set, taken from \${GOBBLIN_WORK_DIR}"
echo " --jars <comma-separated list of job jars> Job jar(s): if not set, "$FWDIR_LIB" is examined"
echo " --conf <directory of job configuration files> Directory of job configuration files: if not set, taken from ${GOBBLIN_JOB_CONFIG_DIR}"
Expand Down Expand Up @@ -53,12 +53,12 @@ if [ -z "$JAVA_HOME" ]; then
fi

check=false
if [ $ACTION == "start" ] || [ $ACTION == "restart" ]; then
if [ $ACTION == "start" ] || [ $ACTION == "restart" ]; then
check=true
fi

# User defined job configuration directory overrides $GOBBLIN_JOB_CONFIG_DIR
if [ -n "$JOB_CONFIG_DIR" ]; then
if [ -n "$JOB_CONFIG_DIR" ]; then
export GOBBLIN_JOB_CONFIG_DIR="$JOB_CONFIG_DIR"
fi

Expand All @@ -67,11 +67,11 @@ if [ -z "$GOBBLIN_JOB_CONFIG_DIR" ] && [ "$check" == true ]; then
fi

# User defined work directory overrides $GOBBLIN_WORK_DIR
if [ -n "$WORK_DIR" ]; then
if [ -n "$WORK_DIR" ]; then
export GOBBLIN_WORK_DIR="$WORK_DIR"
fi

if [ -z "$GOBBLIN_WORK_DIR" ] && [ "$check" == true ]; then
if [ -z "$GOBBLIN_WORK_DIR" ] && [ "$check" == true ]; then
die "GOBBLIN_WORK_DIR is not set!"
fi

Expand All @@ -93,7 +93,7 @@ fi

set_user_jars(){
local separator=''
if [ -n "$1" ]; then
if [ -n "$1" ]; then
IFS=','
read -ra userjars <<< "$1"
for userjar in ${userjars[@]}; do
Expand Down Expand Up @@ -122,7 +122,7 @@ start() {
GOBBLIN_JARS=$jar
fi
done

CLASSPATH="$GOBBLIN_JARS:$FWDIR_CONF"

echo "Starting Gobblin standalone daemon"
Expand Down
59 changes: 0 additions & 59 deletions gobblin-test/build.gradle

This file was deleted.

2 changes: 1 addition & 1 deletion settings.gradle
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@
// CONDITIONS OF ANY KIND, either express or implied.
//

def modules = ['gobblin-api','gobblin-azkaban','gobblin-compaction','gobblin-core','gobblin-distribution','gobblin-example','gobblin-metrics','gobblin-metastore','gobblin-rest-service','gobblin-runtime','gobblin-scheduler','gobblin-test','gobblin-utility','gobblin-salesforce']
def modules = ['gobblin-api','gobblin-azkaban','gobblin-compaction','gobblin-core','gobblin-distribution','gobblin-example','gobblin-metrics','gobblin-metastore','gobblin-rest-service','gobblin-runtime','gobblin-scheduler','gobblin-utility','gobblin-salesforce']

modules.each { module ->
include "${module}"
Expand Down

0 comments on commit c10e6c0

Please sign in to comment.