Recently upgraded from hdp 2.3.2 to 2.5.3 using rolling upgrade method. Wile upgrade status in Pause status, pending for commit. HDFS preserving all data in hdfs even after using -skipTrash option.
hdfs dfs -du -s -h give correct size after deletion. But hdfs dfsadmin -report show higher value.
Identified root cause working with hwx is : It keeps data in “trash” folder in datanode disks allocated for dfs storage.
This will be cleared after commit the rolling upgrade through Ambari or manually ” dfsadmin -finalizeUpgrade”