Sunday, July 30, 2017

Sqoop2 Server

Sqoop CLI limitations
  • User running Scoop CLI , requires connectors installed in the same machine
  • User need to know credentials ( admin may not want to share with all )
  • Scoop jobs are stored locally , and cannot be shared with other team members
  • People can unknowingly create load on RDBMS
Hence a new version is  under development ... called sqoop2 server.
  • sqoop2-sheel only submits jobs to sqoop2 server
  • sqoop2 server does all the work
  • communication to sqoop2 is via json + rest
  • client doesnt need to access hadoop or rdbms ( only server does )

No comments: