Subject Name: Big Data Tools (BDT) Subject Code: 3650010

-> Local file system                                                               

-> HDFS                                                                                                        

-> abc.txt    (Both Are Diff File)

-> abc.txt                                                                                                                                            

-> ls    

-> -copyFromLocal (Upload hadoop)                                                                        

              (Download in loacl)

            -> -moveFromLocal

           -> -moveToLocal

           -ls

            -> -mkdir

            -> -put (Upload)

            -> -get (Download)

            -> -du (Disk Usages) -> Byte

            -> -dus(Disk Usages Summary total size of particular file)

// Virtual Disk Image Path :-

/data/hworkspace/Hortonworks Sandbox with HDP 2.3.2/Hortonworks Sandbox with HDP 2.3.2-disk1.vmdk #

Login Old

-----------

User name :- root

Password :- hadoop

Login New

--------------

User name :- root

Password :- mca@123

==================

In Terminal:-

==================

1)         ssh root@127.0.0.1 -p 2222

2)         mca@123

            su hdfs  ( su = Super User)

            exit

----------

Commands

----------

=>        chmod 777 /opt

=>        cd /opt

=>        mkdir

=>       hadoop fs         ( use for Help old )

=>       hdfs dfs           ( use for Help new )

=>       hadoop namenode -formate (formate the drive(namenode))

hadoop fs -ls

hadoop fs -mkdir Abc

hadoop fs -ls

hdfs dfs -mkdir help

hdfs dfs -ls

MongoDB

1)  ssh root@127.0.0.1 -p 2222

2)  mca@123

3)  mongo

ü  Insert

db.emp.insert({ _id:1 , ENAME:"Scott" , SAL:5000 });

db.emp.insert({ _id:2 , ENAME:"King"  , SAL:1000 });

db.emp.insert({ _id:3 , ENAME:"Peter" , SAL:2000 });

db.emp.insert({ _id:4 , ENAME:"Smith" , SAL:4000 });

db.emp.insert({ _id:5 , ENAME:"John"  , SAL:3000 });

ü  Update  

Parameter :=

(           $set : document[column]        ,           upsert : true/false         ,           multi : true/false          )

db.emp.update({ _id:5 } , { $set: { SAL:3500 } });

db.emp.update({ _id:2 } , { $set: { ENAME:"King" , SAL:7000 } });

db.emp.update({ _id:5 } , { ENAME:"AG" } , { upsert : true });

db.emp.update({ _id:5 } , { $set:{ SAL:3000 } } , { upsert:true });

db.emp.update({ SAL:{ $gt:2000 } } , { $set: { ENAME:"Vijay" } }, { multi:true });

db.emp.update({ _id:5 } , { $set: { BDATE:29 , NAME:"AG" } } , { upsert:true });

ü  Deleted using Update

Parameter :=

(           $unset : { document: 1 }         )

db.emp.update({ _id:5 } , { $unset: { BDATE:1 }});

ü  Find

1 or true

0 or false

db.emp.find( { SAL: { $gt: 3000 } } )

db.emp.find( { SAL: { $gt: 2000, $lt: 5001 } } );

db.emp.find( { SAL: { $gt: 2000, $lt: 5001 } } , { _id:0 , ENAME:1 } );