[Lustre-discuss] Heartbeat, LVM and Lustre

[Jim Garlick]

I'm hoping an actual expert will respond to your question and educate
us all, but in the mean time I had a thought:  is device-mapper
starting your volume groups on both systems, and then the LVM resource
agent script is correctly noticing this?

Maybe you need to configure LVM not to start automatically and instead
wait for the resource agent script to do it.

Jim

On Fri, Dec 11, 2009 at 02:01:24AM +1100, Atul Vidwansa wrote:
> Experts,
> 
> I am trying to use Linux heartbeat (2.1.4 with v1 style resource 
> configuration) with LVM to mount Lustre MDTs. My configuration is 
> simple, ha.cf and haresources file is attached. I have an interesting 
> observation. When I reboot MDS nodes and start MDTs with "service 
> heartbeat start" simultaneously on both mds nodes, sometimes I get 
> following message:
> 
> mds1: 2009/12/10_13:48:08 CRITICAL: Resource LVM::mgsvg is active, and 
> should not be!
> mds1: 2009/12/10_13:48:08 CRITICAL: Non-idle resources can affect data 
> integrity!
> 
> 
> mds2: 2009/12/10_13:47:08 CRITICAL: Resource LVM::mgsvg is active, and 
> should not be!
> mds2: 2009/12/10_13:47:08 CRITICAL: Non-idle resources can affect data 
> integrity!
> 
> 
> and heartbeat on both mds nodes does not start any resource (even after 
> waiting for 35 minutes).
> Has anyone seen this before?
> 
> 
> /etc/ha.d/ha.cf :
> ============
> use_logd    on
> logfile        /var/log/ha-log
> debugfile       /var/log/ha-debug
> logfacility     local0
> keepalive    2
> deadtime    120
> warntime    10
> initdead    120
> udpport     694
> mcast        eth0 239.0.0.3 694 1 0
> mcast           ib0 224.0.0.3 694 1 0
> node        mds1
> node        mds2
> auto_failback    off
> stonith_host mds1 external/ipmi mds2 mds2-sp root changeme lanplus
> stonith_host mds2 external/ipmi mds1 mds1-sp root changeme lanplus
> 
> /etc/ha.d/haresources :
> =================
> mds1 LVM::mgsvg Filesystem::/dev/mgsvg/mgs::/lustre/mgs::lustre
> mds1 LVM::home1vg Filesystem::/dev/home1vg/home1::/lustre/home1::lustre
> mds1 LVM::data1vg Filesystem::/dev/data1vg/data1::/lustre/data1::lustre
> mds2 LVM::flushvg Filesystem::/dev/flushvg/flush::/lustre/flush::lustre
> mds2 LVM::data2vg Filesystem::/dev/data2vg/data2::/lustre/data2::lustre
> mds2 LVM::home2vg Filesystem::/dev/home2vg/home2::/lustre/home2::lustre
> 
> Cheers,
> _Atul
> _______________________________________________
> Lustre-discuss mailing list
> Lustre-discuss at lists.lustre.org
> http://*lists.lustre.org/mailman/listinfo/lustre-discuss