本文共 5893 字,大约阅读时间需要 19 分钟。
fulong@FBI008:~$
sqoop.sh client Sqoop home directory: /home/fulong/Sqoop/sqoop-1.99.3-bin-hadoop200
Sqoop Shell: Type 'help' or '\h' for help.
sqoop:000>
set server --host FBI003 --port 12000 --webapp sqoop Server is set successfully
sqoop:000>
show version --all Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
Sqoop 1.99.3 revision 2404393160301df16a94716a3034e31b03e27b0b
Compiled by mengweid on Fri Oct 18 14:15:53 EDT 2013
sqoop:000>
create connection --cid 001 Creating connection for connector with id
1 Please fill following values to create new connection object
JDBC Driver Class:
oracle.jdbc.driver.OracleDriver JDBC Connection String:
jdbc:oracle:thin:@192.168.0.147:1521:ORCLGBK JDBC Connection Properties:
There are currently 0 values in the map:
Security related configuration options
New connection was successfully created with validation status FINE and persistent id 1
我这里顺便尝试了一下update命令,所以第一遍创建job时输入了错误的tablename: Required argument --xid is missing.
sqoop:000>
create job --xid 1 --type import Creating job for connection with id 1
Please fill following values to create new job object
Nulls in partition column:
Output directory:
/Data/zhaobiao New
job was successfully created with validation status FINE and persistent
id 1 Required argument --jid is missing.
sqoop:000>
update job --jid 1 Please update job metadata:
Table name:
CMS_NEWS_0625 Nulls in partition column:
Output directory: /Data/zhaobiao
Job was successfully updated with status FINE
2.create job完成后,自动分配了一个job id 4.创建Job过程中指定的 Output directory指定的是HDFS中的路径 sqoop:000>
start job --jid 1 2014-06-27 12:44:17 CST: FAILURE_ON_SUBMIT
Exception: org.apache.hadoop.mapred.FileAlreadyExistsException: Output directory hdfs://fulonghadoop/Data/zhaobiao already exists
sqoop:000> start job --jid 1
Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/ 2014-06-27 12:44:53 CST: BOOTING - Progress is not available
sqoop:000>
status job --jid 1 Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/
2014-06-27 12:50:11 CST:
RUNNING - 0.00 % sqoop:000> status job --jid 1
Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/
2014-06-27 13:36:49 CST:
RUNNING - 25.00 % sqoop:000> status job --jid 1
Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/
2014-06-27 13:39:24 CST:
RUNNING - 35.00 % sqoop:000> status job --jid 1
Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/
2014-06-27 13:47:19 CST:
RUNNING - 40.00 % sqoop:000>
status job --jid 1 Server URL: http://FBI003:12000/sqoop/
Creation date: 2014-06-27 12:44:53 CST
Lastly updated by: fulong
External ID: job_1403248336137_0005
http://FBI003:8088/proxy/application_1403248336137_0005/
2014-06-27 14:08:36 CST: SUCCEEDED
org.apache.hadoop.mapreduce.JobCounter
SLOTS_MILLIS_MAPS: 16499226
org.apache.hadoop.mapreduce.lib.output.FileOutputFormatCounter
org.apache.hadoop.mapreduce.lib.input.FileInputFormatCounter
org.apache.hadoop.mapreduce.TaskCounter
PHYSICAL_MEMORY_BYTES: 1185689600
COMMITTED_HEAP_BYTES: 627179520
VIRTUAL_MEMORY_BYTES: 6542311424
MAP_OUTPUT_RECORDS: 644083
org.apache.hadoop.mapreduce.FileSystemCounter
FILE_BYTES_WRITTEN: 931780
HDFS_BYTES_WRITTEN: 431907904
org.apache.sqoop.submission.counter.SqoopCounters
Job executed
successfully 转载地址:http://ebcgi.baihongyu.com/