Thanx for the info John. Unfortunately I can't use the Red Hat GFS, it requires v3.0 and we cannot upgrade to that yet. I have been pushing for it, but Oracle won't give me an definite answer as to whether their apps are certified for RH 3.0. We could go with Veritas' Storage Foundation for Oracle RAC, but that would require considerable change, and no one here knows the software. For the time being I'll probably have to go with a NAS device and make it as redundant as possible. -----Original Message----- From: wlug-bounces@mail.wlug.org [mailto:wlug-bounces@mail.wlug.org] On Behalf Of John Stoffel Sent: Wednesday, October 13, 2004 9:28 AM To: Worcester Linux Users Group Subject: Re: [Wlug] NFS question Don> I have an Oracle 9i RAC set up consisting of 3 database servers, Don> two apps servers and an EMC Clarion CX700 SAN. The servers are all Don> running Red Hat 2.1, the db servers are at kernel .34 and the apps Don> servers are at .49. I have 5 nfs mount points shared out by the Don> first database server. This is the problem, the fact that you're using NFS in a clustered environment. Have you looked into using a Cluster Filesystem for your needs? Some options would be: http://www.redhat.com/software/rha/gfs/ It even mentions Oracle 9i in the blurb. Don> One mount point is for logs from the database servers (only they Don> connect to it), Why do they all need to log to one filesystem? Can't they log locally and if you want to aggregate the logs, you could rsync them hourly from the servers to a central log host. Don> and the others are for miscellaneous files and storage. We have Don> been doing failover testing, shutting down a database server and Don> seeing if the other two keep processing requests. We have a Don> problem when we shut down the first database server, the one Don> sharing the nfs volumes. The other two servers just hang trying to Don> connect to the shares. I have tried every option in my fstab file Don> to make the servers stop trying to reach the nfs shares if the Don> server is not available, but nothing has worked. Here is one of Don> the lines from the fstab file where I mount a share: Yeah, what you're trying to do isn't going to work without either: 1. moving to a Cluster Filesystem so that all hosts and read/write to the same filesystem on the Clarrion SAN concurrently. 2. moving to a Cluster setup where you have TWO servers in a cluster, and the cluster provides the NFS file service to other servers. 3. Getting a NAS box which provides NFS service to the DB servers and which has the require reliability you need. I personally like NetApps, but they can be pricey. But even with a single head, they're reliable and run well. I had one box with an uptime of almost 500 days. Oh yeah, UPS and Generator backup helps as well. *grin* You could get away with using another cheaper NAS, but since you spent the money on the SAN, why not just use that and GFS to provide the storage you need. Esp if most of the filesystems you provide are read (mostly) then you shouldn't have many problems. John John Stoffel - Senior Unix Systems Administrator - Lucent Technologies stoffel@lucent.com - http://www.lucent.com - 978-952-7548 _______________________________________________ Wlug mailing list Wlug@mail.wlug.org http://mail.wlug.org/mailman/listinfo/wlug