Versions Compared

Old Version 1

changes.mady.by.user Robin Rielley

Saved on

compared with

New Version Current

changes.mady.by.user Robin Rielley

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Stop all CDAP programs on the master cluster.

  2. Stop CDAP on the master cluster.

  3. Copy any HDFS files that have not yet been copied using either your distro's solution or distcp.

  4. Run the CDAP replication status tool to retrieve the cluster state:

    Code Block
    [master] $ cdap run io.cdap.cdap.data.tools.ReplicationStatusTool -m -o /tmp/master_state

  5. Copy the master state onto your slave cluster:

    Code Block
    [master] $ scp /tmp/master_state <slave>:/tmp/master_state

  6. Verify that replication has copied the required data onto the slave:

    Code Block
    [slave] $ cdap run io.cdap.cdap.data.tools.ReplicationStatusTool -i /tmp/master_state
...
Master and Slave Checksums match. HDFS Replication is complete.
HBase Replication is complete.

  7. Run Hive's metatool to update the locations for the Hive tables:

    Code Block
    [slave] $ hive --service metatool -updateLocation hdfs://[slave-namenode-host]:[slave-namenode-port] \
             hdfs://[master-namenode-host]:[master-namenode-port] \
             -tablePropKey avro.schema.url -serdePropKey avro.schema.url

  8. Start CDAP on the slave:

    Code Block
    [slave] $ cdap master start