[Lustre-discuss] How to detect process owner on client

[Michael Kluge]

Hi Satoshi,

I am not aware of any possibility to map the current statistics in /proc
to UIDs. But I might be wrong. We had a script like this a while ago
which did not kill the I/O intensive processes but told us the PIDs. 

What we did is collecting for ~30 seconds the number of I/O operations
per node via /proc on all nodes. Then we attached an strace process to
each process on nodes with heavy I/O load. This strace intercepted only
the I/O calls and wrote one log file per process. If this strace is
running for the same amount of time for each process on a host, you just
need to sort the log files for size.


Regards, Michael


Am Donnerstag, den 10.02.2011, 21:16 -0600 schrieb Satoshi Isono: 
> Dear members,
> 
> I am looking into the way which can detect userid or jobid on the Lustre client. Assumed the following condition;
> 
>  1) Any users run any jobs through scheduler like PBS Pro, LSF or SGE.
>  2) A users processes occupy Lustre I/O.
>  3) Some Lustre servers (MDS?/OSS?) can detect high I/O stress on each server.
>  4) But Lustre server cannot make the mapping between jobid/userid and Lustre I/O processes having heavy stress, because there aren't userid on Lustre servers.
>  5) I expect that Lustre can monitor and can make the mapping.
>  6) If possible for (5), we can make a script which launches scheduler command like as qdel.
>  7) Heavy users job will be killed by job scheduler.
> 
> I want (5) for Lustre capability, but I guess current Lustre 1.8 cannot perform (5). On the other hand, in order to map Lustre process to userid/jobid, are there any ways using like rpctrace or nid stats? Can you please your advice or comments?
> 
> Regards,
> Satoshi Isono
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://lists.lustre.org/mailman/listinfo/lustre-discuss
> 

-- 

Michael Kluge, M.Sc.

Technische Universität Dresden
Center for Information Services and
High Performance Computing (ZIH)
D-01062 Dresden
Germany

Contact:
Willersbau, Room A 208
Phone:  (+49) 351 463-34217
Fax:    (+49) 351 463-37773
e-mail: michael.kluge at tu-dresden.de
WWW:    http://www.tu-dresden.de/zih
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/x-pkcs7-signature
Size: 5973 bytes
Desc: not available
URL: <http://lists.lustre.org/pipermail/lustre-discuss-lustre.org/attachments/20110211/66177c5a/attachment.bin>