Hive Sqoop change scratchdir

Like Tweet Pin it Share Share Email

In this post  Hive Job Submission failed with exception

I had mentioned about deleting .Trash folder.  For any reason if you are not able to delete the folder you can go with Option B.

Change the  scratchdir for Hive / Sqoop to use

Create a new folder under  hadoop file system.  Example   /db/tmphive

Grant read write access to other user  to  /db/tmphive folder and use this SET property in hive script.

Hive> set hive.exec.scratchdir=/db/tmphive/;

If same is used in Sqoop use  it with -D option

Sqoop import  -Dhive.exec.scratchdir=/db/tmphive/ …. 



Comments (0)

Leave a Reply

Your email address will not be published. Required fields are marked *