Ooziee -Aru
-----------
Pre-requisites as follows:
create .sql scripts for this demo:
cat > ddl.sql
create database sakthi;
use sakthi;
create table sakthi2018 (id int, name string);
^C
hdfs dfs -mkdir /user/cloudera/ooziedemo
hdfs dfs -put ddl.sql /user/cloudera/ooziedemo/ddl.sql
cat > dml.sql
insert into sakthi2018(id,name) values(101,'sara');
insert into sakthi2018(id,name) values(102,'mara');
^c
hdfs dfs -put dml.sql /user/cloudera/ooziedemo/dml.sql
copy hive-site.xml to local Desktop:
sudo cp /etc/hive/conf/hive-site.xml /home/cloudera/DeskTop/hive-site.xml
hdfs dfs -put hive-site.xml /user/cloudera/ooziedemo/hive-site.xml
Start Hue in Firefox:
click on Hue link
cloudera : cloudera // username and password
Click on Query -> Scheduler -> WorkFlow
Click on Actions which is hidden behind ^Documents (scroll up to see this within right side pan if it is not visible)
Drag and Drop Hive Action there
select ddl.sql (script)
and hive-site.xml (hive xml)
select dml.sql (script)
and hive-site.xml (hive xml)
click on Jobs - Workflow - Graph
Drag and drop Action
Run,Suspend,Re-run etc
Showing posts with label oozie. Show all posts
Showing posts with label oozie. Show all posts
Monday, 10 December 2018
Subscribe to:
Posts (Atom)
Flume - Simple Demo
// create a folder in hdfs : $ hdfs dfs -mkdir /user/flumeExa // Create a shell script which generates : Hadoop in real world <n>...
-
Import data from MySQL to HDFS using SQOOP with conditional data importing //Conditional import using Where sqoop import \ -connect jdbc:m...
-
// How to add auto generated column Index to existing dataframe? scala> import org.apache.spark.sql.functions._ import org.apache.spark.s...
-
Input file: emp.csv ---------------- empno,ename,designation,manager,hire_date,sal,deptno 7788,SCOTT,ANALYST,7566,12/9/1982,3000,20 73...