Question

I have partitioned table in hive. So I wanna see the directory structure in hadoop hdfs?

From documentation, I have found the following command

hadoop fs -ls /app/hadoop/tmp/dfs/data/

and /app/hadoop/tmp/dfs/data/ is my data path. But this command return

ls: Cannot access /app/hadoop/tmp/dfs/data/: No such file or
directory.

Am I missing something there?

Answer 1

Unless I’m mistaken, it seems you are looking for a temporary directory that you probably defined in the property hadoop.tmp.dir. This is a local directory, but when you do hadoop fs -ls you are looking at what files are available in HDFS, so you won’t see anything.

Since you’re looking or the Hive directories, you are looking for the following property in your hive-site.xml:

hive.metastore.warehouse.dir

The default is /user/hive/warehouse, so if you haven’t changed this property you should be able to do:

hadoop fs -ls /user/hive/warehouse

And this should show you your table directories.