[Lustre-discuss] gridftp and Lustre

[Jeffrey Bennett]

I guess you could implement some sort of gridftp plugin, a DSI module is what they call it, to write data directly to the OSS and then you could install gridftp servers on the OSS. This is basically what the HPSS DSI module for Gridftp does, it writes data directly to the HPSS system using the HPSS API. However, I am not sure it's technically possible with Lustre.

I'll take a look at the dCache thing, thanks!

jab  

> -----Original Message-----
> From: Yujun Wu [mailto:yujun at phys.ufl.edu] 
> Sent: Friday, May 22, 2009 10:18 AM
> To: Jeffrey Bennett
> Cc: lustre-discuss at lists.lustre.org
> Subject: RE: [Lustre-discuss] gridftp and Lustre
> 
> Hi Jeffrey,
> 
> Thanks for your e-mail. Then extra traffic is moving from 
> gridftp servers to OSSs, which I really don't like---as you 
> may imagine.
> 
> I know a product called dCache. The gridftp servers don't 
> handle the data traffic directly, but re-directing the data 
> to the data server(dCache pools). 
> 
> 
> Regards,
> Yujun
> On Fri, 22 May 2009, Jeffrey Bennett wrote:
> 
> > The gridftp servers need to be on lustre clients. No way 
> you can send your data directly from the gridftp client to 
> the OSS if this is what you're asking.
> > 
> > jab
> > 
> > > -----Original Message-----
> > > From: lustre-discuss-bounces at lists.lustre.org
> > > [mailto:lustre-discuss-bounces at lists.lustre.org] On 
> Behalf Of Yujun 
> > > Wu
> > > Sent: Friday, May 22, 2009 8:24 AM
> > > To: lustre-discuss at lists.lustre.org
> > > Subject: [Lustre-discuss] gridftp and Lustre
> > > 
> > > Hello,
> > > 
> > > Could somebody give me some advice on how to improve the gridftp 
> > > performance with Lustre?
> > > 
> > > Currently, we are putting files onto Lustre through Lustre file 
> > > system mounted gridftp server. I noticed the network 
> traffic goes in 
> > > this way (use putting data as an example):
> > > 
> > > remote client---->gridftp server--->Lustre OSS
> > > 
> > > And the gridftp server is busy with receiving and sending packets 
> > > all the time. Is there a way for the control info goes to gridftp 
> > > server, but the data go to Lustre OSS directly?
> > > 
> > > Thanks in advance for answering my question.
> > > 
> > > 
> > > Regards,
> > > Yujun
> > > 
> > > 
> > > _______________________________________________
> > > Lustre-discuss mailing list
> > > Lustre-discuss at lists.lustre.org
> > > http://lists.lustre.org/mailman/listinfo/lustre-discuss
> > > 
> 
>