Docbase each folder size report

Hi,

I have space issue in one of our docbase file system which is consuming more space around 95 GB. When i checked the dm_document table, there was no much content and size or less than MBs.

I checked the dm_dmclean job status, it is running daily. I am not sure whether delete job is purging the documents correctly or not. And not sure whether any other folders are having more documents or not.

Is there a way to check that

1. dm_dmClean is purging the files correctly.?

2. docbase report which contains each folder level what space it is occurying in file system.?

Thanks & Regards,

Vijay

Find more posts tagged with

Comments

acarver

Lots of things to check and/or do:

1. the dmClean job should have the clean_content and clean_now flags set to TRUE (otherwise no deleted documents get deleted); does the log file indicate anything? What do you see when you query for orphan content (select * from dmr_content where any parent_id is null ) ?

2. In addition to dmclean, try running the dmFileScan job, which will delete orphan files (i.e. file exists, but dm_document and dmr_content records no longer exist). With 95 GB of files, you might want to use the parameters which limit the number of directories scanned with each FileScan job.

(both dmclean and dmfilescan can be run from the command prompt, in addition to using DA. The Admin Guide will explain. )

3. Ask your server administrator to tell you which directories (or files) are the big space users. Maybe you have some trace or log files that would not show up in dm_document or dmr_content queries.

4. dmLogPurge is another job to clean up old files from the server.

5. Maybe someone is creating many versions of a large document ???

Good luck,

Andrew

KSMatson

A good place to start is by running the dm_StateofDocbase job and check the report.

VijayAM

Thanks for mentioning StateOfDocBase job to get the report.

From the report, i identified that text file content is consuming 78 GB.

When dm_clean job runs, it shows 670841 objects having parent count as 0. But when job is completing, these are not getting purged from file system.

dm_clean trace:

# Count of objects with zero parent count was: 670841
# Content cleanup complete.

When i try to run the dm_filescan from command prompt, log file shows many txt file remove with rm command, but it is not getting deleted from file system. And after sometime, dm filescan job is looping and not completing.

dmfilescan -docbase_name <name> -init_file <server.ini>

State of Docbase Report:

Content Size(KB) by Format:
Format                                 Largest                Average                       Total
text                                    81,769                    130                  78,762,925
msw8                                   116,371                    344                  10,189,510
pdf                                    114,993                    131                   2,565,426
bmp                                      3,840                  2,506                     714,230
excel8book                             231,350                  1,844                     519,916
jpeg                                     3,750                  1,297                     442,271
zip                                     10,418                    133                     249,928
eps                                      4,406                    284                     173,135
jar                                      7,316                    860                     103,160
xml                                      1,011                      3                     103,102

Is any special instructions present for dmfilescan job run.? I hope this job will help me to purge the files from content storage.

bacham2

There is a parameter in the DMCLean job (clean_content) which is TRUE by default.

msroth

You might also want to check this article about keeping your repository "clean". It discusses the dmClean job and some others that might be of interest to you. https://community.emc.com/docs/DOC-2495 or http://msroth.wordpress.com/research/.

VijayAM

I tried running dm filescan job from command prompt, DQL execute method. In either way, it is not deleting files from docbase.

When i was running dm filescan in command prompt, i have logged the output in one log file. In that log, logs are showing with rm <file path>, but files are not getting deleted from file store.

I am not sure when this delete action happens in dm filescan job run.