- WLUG - wlug.mailman3.com

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 HI gang, I have another clue - I found a way to lockup the system *guaranteed* within about 3 minutes. Go to this URL and play this game. It is mouse only. http://www.whtmtnliving.net/games/sports/beer_golf.htm I disconnected my keyboard and mouse from the KVM switch and connected them directly to my system - and it *still* locks up reliably when I play the golf game (above) with the 2.6.11.11 kernel. Note I'm also running X.org 6.8.1. Could this be some flakiness in my XF86Config file with the mouse protocol? I could isolate this further if I could find a way to lock up the system in console mode using gpm. Its time to go to CompUSA and spend $4.38 on that serial console cable... Later, Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCsiV8Hl0iXDssISsRAoutAJ4qauOItdJnPoSXS2MuP149kKuMSgCdEXZ8 xP/T9Okh2ngQRZqZresZCDg= =2tw5 -----END PGP SIGNATURE-----

June 17, 2005

udev device removal not removing file

by Karl Hiramoto

I have some USB serial port devices that show up in /dev/tts/USB0 and /dev/tts/USB1 for example.. I have 4 gentoo boxes, and on one of them when I remove the device file does not disappear, on the other boxes the file disappear. What could be causing this? Adding a device is no problem, only the removal does not remove the device file /dev/tts/USB1 for example dmesg shows the device addition and removal just fine. I copied /etc/udev/* from a working machine where removal happens fine the one with problems with device removal and there was no change. They are all running the same kernel, hotplugg, baselayout.. This is an issue for me as i have a program of my own that looks for /dev/tts/USB* Any ideas out there? Thanks.

June 16, 2005

RE: [Wlug] VPN

by Skip Gaede

How about FreeSwan? -----Original Message----- From: wlug-bounces(a)mail.wlug.org [mailto:wlug-bounces@mail.wlug.org] On Behalf Of Aramico Sent: Wednesday, June 15, 2005 8:07 AM To: sageman(a)WPI.EDU; Worcester Linux Users Group Subject: [Wlug] VPN Dear Friends, Can you all please suggest me kind of VPN application based on Linux (especially RedHat 7.3 compatibility) ? Thanks, Aramico _______________________________________________ Wlug mailing list Wlug(a)mail.wlug.org http://mail.wlug.org/mailman/listinfo/wlug

June 15, 2005

Re: [Wlug] Need Homes: 2U+,custom cases/psupp/fans

by Walt Sawyer

I'd like one. Bring it to the meeting tonight. Thanks! Walt On Tue, 2005-06-14 at 13:57 -0400, Doug Mildram wrote: > Yet another Westboro,MA giveaway: (Anyone teaching EE or Hobbies909?) > Free and basically new: empty/nonstandard cases w/powersupp+fans. > > A dead project has left homeless ~15 cases, 19" wide, 24" deep, > (19" wide == standard 18.5" distance between frontpanel mounting holes) > 4.5" high == including .5" high rubber feet. (2U == 3.5", these are taller), > semi-empty inside (a 13"x14"x3.5" area inside plus a 6"x8"x3.5" along psupply) > 19" rackmountable , BUT, ***** NOT ***** set up for PC-based motherboard: > does NOT include disk/floppy/usb brackets or any of THAT pc-ready stuff. > > http://webpages.charter.net/mquinty/case_top.JPG > > Each case has a 400W standard 12v/5v power supply, > and (4) 3.5" fans already mounted (side exhaust) inside; > a removable suitcase-strap-panel on the front as shown; > (see picture case_front.JPG URL below..but it hides the switches below) > also on front panel: 1 power switch; 2 LEDs, "Fan Fail" and "Power". > > http://webpages.charter.net/mquinty/case_front.JPG > > Even MORE Gory detail: > Each case has a custom (now useless) NONstandard screw-post > arrangement which you'd need to re-do > (re-drill new holes as needed, may need shorter posts). > > So it's good if you have something REALLY CUSTOM you want mounted+powered. > > If you ask for just the power supplies, you're missing my mantra: > these babies (CASES) need an inventive home or homes. -- doug mildram > > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug >

June 15, 2005

Re: [Wlug] VPN

by Adam Keck

Hello Aramico, Are you trying to connect to a VPN server or are you trying to provide VPN services to others? -Adam On Jun 15, 2005, at 8:07 AM, Aramico wrote: > Dear Friends, > > > Can you all please suggest me kind of VPN application based on Linux > (especially RedHat 7.3 compatibility) ? > > > Thanks, > > Aramico > _______________________________________________ > Wlug mailing list > Wlug(a)mail.wlug.org > http://mail.wlug.org/mailman/listinfo/wlug

June 15, 2005

VPN

by Aramico

Dear Friends, Can you all please suggest me kind of VPN application based on Linux (especially RedHat 7.3 compatibility) ? Thanks, Aramico

June 15, 2005

Need Homes: 2U+,custom cases/psupp/fans

by Doug Mildram

Yet another Westboro,MA giveaway: (Anyone teaching EE or Hobbies909?) Free and basically new: empty/nonstandard cases w/powersupp+fans. A dead project has left homeless ~15 cases, 19" wide, 24" deep, (19" wide == standard 18.5" distance between frontpanel mounting holes) 4.5" high == including .5" high rubber feet. (2U == 3.5", these are taller), semi-empty inside (a 13"x14"x3.5" area inside plus a 6"x8"x3.5" along psupply) 19" rackmountable , BUT, ***** NOT ***** set up for PC-based motherboard: does NOT include disk/floppy/usb brackets or any of THAT pc-ready stuff. http://webpages.charter.net/mquinty/case_top.JPG Each case has a 400W standard 12v/5v power supply, and (4) 3.5" fans already mounted (side exhaust) inside; a removable suitcase-strap-panel on the front as shown; (see picture case_front.JPG URL below..but it hides the switches below) also on front panel: 1 power switch; 2 LEDs, "Fan Fail" and "Power". http://webpages.charter.net/mquinty/case_front.JPG Even MORE Gory detail: Each case has a custom (now useless) NONstandard screw-post arrangement which you'd need to re-do (re-drill new holes as needed, may need shorter posts). So it's good if you have something REALLY CUSTOM you want mounted+powered. If you ask for just the power supplies, you're missing my mantra: these babies (CASES) need an inventive home or homes. -- doug mildram

June 14, 2005

Reminder: WLUG Meeting, Wed June 15, 7:00 PM

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 HI everybody, This is a reminder about the WLUG meeting to be held on Wednesday, June 15, 2005 at 7:00 PM in the Access Grid room on the WPI Campus in Worcester, MA USA. This meeting is open to anyone who is interested in Linux. Tim Keller will be our guest speaker, and he'll be talking about Logical Volume Management (LVM). More details can be found on the WLUG home page. I will have two books for the no cost raffle: Succeeding with Open Source by Bernard Golden Published by Addison-Wesley 2005 PHP5 Power Programming by Gutmans, Bakken, and Rethans Published by Prentice Hall 2005 The raffle winner is requested to write a review of the book and to post it somewhere on the Internet, and to copy the publisher. We had discussed the possibility of a summer barbecue in lieu of the July meeting. I think someone said we could have the party at their place, but I can't remember who said that. If this person was serious, please contact me via email and we can work out the particulars. It'll be a nice way to celebrate WLUG's 8th anniversary (we started July 1997)! After the meeting, we'll go out for pizza/soda at the Tech Pizza restaurant on Highland Street. Its a small place, but the 8-10 of us that go seem to be having a good time, and we've never had to wait for a table. :-) It may be hot in there this time of year...we'll have to scope it out. See you on Wednesday! Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCrj4THl0iXDssISsRAhttAJsG8rEhMLYrtzolhdFWpnwTBYFWFQCgh/xB RA6vaXZaqh7HUbT8Et7x1zM= =he7f -----END PGP SIGNATURE-----

June 14, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 John Stoffel wrote: > > Andy> So far, so good, but I only installed 2.6.11.11: > Andy> 7:49pm up 2 days 20:40, 7 users, load average: 2.04, 2.08, 2.08 > > Andy> Linux amdtux 2.6.11.11 #1 SMP Tue Jun 7 21:12:53 EDT 2005 x86_64 x86_64 > Andy> x86_64 GNU/Linux > > I assume you did a 'make oldconfig' to keep your settings a close as > possible to the previous kernel? I'm wondering if there's some sort > of difference in settings that might have made a difference here. Well, what I actually did is this: booted previous kernel (2.6.8.something_from_suse) cd /usr/src/linux-2.6.11.11 zcat /proc/config.gz > .config make xconfig (make no changes, save it back out) make ....... > > In any case, good luck, and great to hear it's working well for you. Thanks - I'm keeping my fingers crossed! > > My old dual cpu PIII Xeon 550mhz is still chugging along well, but I'm > starting to think I want a silent NFS/mysql/daemon server with a bunch > of disk and a tape drive to sit off in a quiet corner somewhere to do > backups, serve files, etc. And be stable and quiet. Then my main box > could become a more general play system again. My dual PIII 450MHz system is now a MythTV backend, and it seems quite happy in that role. :-) Later, Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCq6mgHl0iXDssISsRAu6TAJ9EsNQVMwogKOSmUB1weKE2XU83pgCfZGSI 9n5fJ5mD4VwfZD2LxGcLg1E= =6fO7 -----END PGP SIGNATURE-----

June 12, 2005

Re: [Wlug] HOWTO debug hard lockups

by John Stoffel

Andy> So far, so good, but I only installed 2.6.11.11: Andy> 7:49pm up 2 days 20:40, 7 users, load average: 2.04, 2.08, 2.08 Andy> Linux amdtux 2.6.11.11 #1 SMP Tue Jun 7 21:12:53 EDT 2005 x86_64 x86_64 Andy> x86_64 GNU/Linux I assume you did a 'make oldconfig' to keep your settings a close as possible to the previous kernel? I'm wondering if there's some sort of difference in settings that might have made a difference here. In any case, good luck, and great to hear it's working well for you. My old dual cpu PIII Xeon 550mhz is still chugging along well, but I'm starting to think I want a silent NFS/mysql/daemon server with a bunch of disk and a tape drive to sit off in a quiet corner somewhere to do backups, serve files, etc. And be stable and quiet. Then my main box could become a more general play system again. John

June 12, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 So far, so good, but I only installed 2.6.11.11: 7:49pm up 2 days 20:40, 7 users, load average: 2.04, 2.08, 2.08 Linux amdtux 2.6.11.11 #1 SMP Tue Jun 7 21:12:53 EDT 2005 x86_64 x86_64 x86_64 GNU/Linux - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCqiduHl0iXDssISsRApBGAJ4w8HXNq60qb/6BMON3uz4aoywjRwCdHWrC xVYbnucZfFPBUFt3MWZhXNc= =z/Mt -----END PGP SIGNATURE-----

June 10, 2005

RE: [Wlug] HOWTO debug hard lockups

by Keller, Tim

Andy, Your lockup's sound like an SMP issue. I'd try booting a non SMP kernel and then seeing if you can duplicate the lockup... I say this because I was getting practically the same behavior with a duel Xeon machine running FC3. The machine would just up and die in the same way your machine is. Just my $.02. Tim. -----Original Message----- From: wlug-bounces(a)mail.wlug.org [mailto:wlug-bounces@mail.wlug.org] On Behalf Of Andy Stewart Sent: Wednesday, June 08, 2005 7:15 PM To: jmoyer(a)redhat.com; Worcester Linux Users Group Subject: Re: [Wlug] HOWTO debug hard lockups -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Jeff Moyer wrote: > ==> Regarding Re: [Wlug] HOWTO debug hard lockups; Andy Stewart <andystewart(a)comcast.net> adds: > > andystewart> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 > > andystewart> Jeff Moyer wrote: >>>==> Regarding [Wlug] HOWTO debug hard lockups; Andy Stewart >>><andystewart(a)comcast.net> adds: >>> > andystewart> HI gang, > andystewart> My dual Opteron machine is not happy. I cannot get more than > andystewart> 7 straight days of uptime without getting a hard lock, > andystewart> requiring a reboot. (My definition of hard lock is: machine > andystewart> responds neither to keyboard input, mouse input, nor network > andystewart> pings). > andystewart> I can stimulate hard locks by running OpenOffice 1.1.3 (I had > andystewart> 3 tonight, and 3-4 on a previous occasion while running > andystewart> OpenOffice). It makes no sense to me that an application run > andystewart> as a normal user could lockup a machine. > andystewart> I've tried setting "nmi_watchdog=1" to see if I could get an > andystewart> "oops" when it hard locks - no dice. Do you know any other > andystewart> tricks I could try to see if it is the kernel which is locking > andystewart> up? I'm running SuSE's version of 2.6.8. >>>Did you verify that NMIs are being delivered? After boot, cat >>>/proc/interrupts and make sure the NMI line is non-zero. Also note >>>that, at least with upstream and Red Hat kernels, the nmi_watchdog >>>defaults to 1 for Opterons (i.e. you shouldn't need to manually set it). > > andystewart> HI Jeff, > > andystewart> Well, this is weird, I'm seeing a ZERO count for NMIs, so that > andystewart> makes me think they are NOT being delivered. How would I go > andystewart> about solving *that* little problem? I did a "cat > > Well, you can try booting with nmi_watchdog=2. This will try to use the > local APIC to deliver nmi's, but I haven't actually seen a dual processor > system that required this (all of them I've seen work with nmi_watchdog=1). > It is worth a try, however. With nmi_watchdog=1, I see the following output from "dmesg | grep -i nmi" with the 2.6.11.11 kernel I very recently installed: Bootdata ok (command line is root=/dev/sda3 vga=0x31a selinux=0 console=tty0 resume=/dev/sda2 desktop elevator=as nmi_watchdog=1 splash=verbose) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) Kernel command line: root=/dev/sda3 vga=0x31a selinux=0 console=tty0 resume=/dev/sda2 desktop elevator=as nmi_watchdog=1 splash=verbose activating NMI Watchdog ... done. testing NMI watchdog ... CPU#1: NMI appears to be stuck (0)! I'll try nmi_watchdog=2 shortly. Thanks, Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCp3v8Hl0iXDssISsRAoDJAJ0TonNTSEAd+4W0GRPwTW/UoGFssACdEEq9 8IgEFJ7VAL/FVeyPXrEapHg= =jcjE -----END PGP SIGNATURE----- _______________________________________________ Wlug mailing list Wlug(a)mail.wlug.org http://mail.wlug.org/mailman/listinfo/wlug

June 9, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Jeff Moyer wrote: > ==> Regarding Re: [Wlug] HOWTO debug hard lockups; Andy Stewart <andystewart(a)comcast.net> adds: > > andystewart> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 > > andystewart> Jeff Moyer wrote: >>>==> Regarding [Wlug] HOWTO debug hard lockups; Andy Stewart >>><andystewart(a)comcast.net> adds: >>> > andystewart> HI gang, > andystewart> My dual Opteron machine is not happy. I cannot get more than > andystewart> 7 straight days of uptime without getting a hard lock, > andystewart> requiring a reboot. (My definition of hard lock is: machine > andystewart> responds neither to keyboard input, mouse input, nor network > andystewart> pings). > andystewart> I can stimulate hard locks by running OpenOffice 1.1.3 (I had > andystewart> 3 tonight, and 3-4 on a previous occasion while running > andystewart> OpenOffice). It makes no sense to me that an application run > andystewart> as a normal user could lockup a machine. > andystewart> I've tried setting "nmi_watchdog=1" to see if I could get an > andystewart> "oops" when it hard locks - no dice. Do you know any other > andystewart> tricks I could try to see if it is the kernel which is locking > andystewart> up? I'm running SuSE's version of 2.6.8. >>>Did you verify that NMIs are being delivered? After boot, cat >>>/proc/interrupts and make sure the NMI line is non-zero. Also note >>>that, at least with upstream and Red Hat kernels, the nmi_watchdog >>>defaults to 1 for Opterons (i.e. you shouldn't need to manually set it). > > andystewart> HI Jeff, > > andystewart> Well, this is weird, I'm seeing a ZERO count for NMIs, so that > andystewart> makes me think they are NOT being delivered. How would I go > andystewart> about solving *that* little problem? I did a "cat > > Well, you can try booting with nmi_watchdog=2. This will try to use the > local APIC to deliver nmi's, but I haven't actually seen a dual processor > system that required this (all of them I've seen work with nmi_watchdog=1). > It is worth a try, however. With nmi_watchdog=1, I see the following output from "dmesg | grep -i nmi" with the 2.6.11.11 kernel I very recently installed: Bootdata ok (command line is root=/dev/sda3 vga=0x31a selinux=0 console=tty0 resume=/dev/sda2 desktop elevator=as nmi_watchdog=1 splash=verbose) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) Kernel command line: root=/dev/sda3 vga=0x31a selinux=0 console=tty0 resume=/dev/sda2 desktop elevator=as nmi_watchdog=1 splash=verbose activating NMI Watchdog ... done. testing NMI watchdog ... CPU#1: NMI appears to be stuck (0)! I'll try nmi_watchdog=2 shortly. Thanks, Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCp3v8Hl0iXDssISsRAoDJAJ0TonNTSEAd+4W0GRPwTW/UoGFssACdEEq9 8IgEFJ7VAL/FVeyPXrEapHg= =jcjE -----END PGP SIGNATURE-----

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Michael Long

Andy Stewart wrote: >-----BEGIN PGP SIGNED MESSAGE----- >Hash: SHA1 > >John Stoffel wrote: > > >>Andy, >> >>The best thing to do here is to run a serial console to another one of >>your systems and use THAT to try and catch the issue. You can then do >>a SysRq from the remote serial console and/or catch any error >>messages. >> >>Also, are there any messages in dmesg or /var/log/messages? How does >>the bootup look? Any warnings? Also, please try 2.6.12-rc6 and see >>if the problem repeats. >> >>John >> >> > >HI John, > >I'm going to give the serial console a try - I may have a cable lying >around. > >I upgraded to the 2.6.11.11 kernel which did have several fixes for K8. > We'll see how that goes. > >Thanks for the ideas! > >Andy > >- -- >Andy Stewart, Founder >Worcester Linux Users' Group >Worcester, MA, USA >http://www.wlug.org > >-----BEGIN PGP SIGNATURE----- >Version: GnuPG v1.2.5 (GNU/Linux) >Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org > >iD8DBQFCp2yhHl0iXDssISsRAqxcAJwLntOh9GpNmefW/+JdwbAUMRJKBACfbV1P >s2eqMUnY6rjZaIfI6MzZLqQ= >=aLfl >-----END PGP SIGNATURE----- >_______________________________________________ >Wlug mailing list >Wlug(a)mail.wlug.org >http://mail.wlug.org/mailman/listinfo/wlug > > Andy, If that doesn't help try using the system without the kvm and see if you get the same behavior. I have seen odd things in the past when using a faulty kvm switch. Mike

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 John Stoffel wrote: > Andy, > > The best thing to do here is to run a serial console to another one of > your systems and use THAT to try and catch the issue. You can then do > a SysRq from the remote serial console and/or catch any error > messages. > > Also, are there any messages in dmesg or /var/log/messages? How does > the bootup look? Any warnings? Also, please try 2.6.12-rc6 and see > if the problem repeats. > > John HI John, I'm going to give the serial console a try - I may have a cable lying around. I upgraded to the 2.6.11.11 kernel which did have several fixes for K8. We'll see how that goes. Thanks for the ideas! Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCp2yhHl0iXDssISsRAqxcAJwLntOh9GpNmefW/+JdwbAUMRJKBACfbV1P s2eqMUnY6rjZaIfI6MzZLqQ= =aLfl -----END PGP SIGNATURE-----

June 8, 2005

Job opportunity in Natick for experienced Unix admin

by Simoncini, Matthew

List, I work for a large consulting company in Natick, MA. and we're looking for a couple of experienced (mid level) Unix administrators to join our team. Some of the skills that are required include: Unix experience (Sun Solaris 8 or higher) Veritas volume manager Veritas cluster services Storage management experience (preferably EMC Clarion or DMX) Backup management experience (preferably EMC EDM) Team player Desire to learn and grow If you or anyone you know is looking for a position as a Unix Administrator, please contact me off list at matthewsmbox-resumes(a)yahoo.com <mailto:matthewsmbox-resumes@yahoo.com> . Thanks. Matthew

June 8, 2005

MySQL curses management tool?

by John Stoffel

Hi all, A quick googling didn't help, so I'm turning to you all. I'm looking for a mysql management tool which is CLI/curses based and more powerful/easier to use when compared to the mysqlaccess and mysqladmin stuff. Basically, something to help me manage DBs, users and permissions over an SSH connection. I know I could use some of the X tools, but I'd prefer not too if possible. Thanks, John

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by John Stoffel

Andy, The best thing to do here is to run a serial console to another one of your systems and use THAT to try and catch the issue. You can then do a SysRq from the remote serial console and/or catch any error messages. Also, are there any messages in dmesg or /var/log/messages? How does the bootup look? Any warnings? Also, please try 2.6.12-rc6 and see if the problem repeats. John

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Jeff Moyer

==> Regarding Re: [Wlug] HOWTO debug hard lockups; Andy Stewart <andystewart(a)comcast.net> adds: andystewart> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 andystewart> Jeff Moyer wrote: >> ==> Regarding [Wlug] HOWTO debug hard lockups; Andy Stewart >> <andystewart(a)comcast.net> adds: >> andystewart> HI gang, >> andystewart> My dual Opteron machine is not happy. I cannot get more than andystewart> 7 straight days of uptime without getting a hard lock, andystewart> requiring a reboot. (My definition of hard lock is: machine andystewart> responds neither to keyboard input, mouse input, nor network andystewart> pings). >> andystewart> I can stimulate hard locks by running OpenOffice 1.1.3 (I had andystewart> 3 tonight, and 3-4 on a previous occasion while running andystewart> OpenOffice). It makes no sense to me that an application run andystewart> as a normal user could lockup a machine. >> andystewart> I've tried setting "nmi_watchdog=1" to see if I could get an andystewart> "oops" when it hard locks - no dice. Do you know any other andystewart> tricks I could try to see if it is the kernel which is locking andystewart> up? I'm running SuSE's version of 2.6.8. >> Did you verify that NMIs are being delivered? After boot, cat >> /proc/interrupts and make sure the NMI line is non-zero. Also note >> that, at least with upstream and Red Hat kernels, the nmi_watchdog >> defaults to 1 for Opterons (i.e. you shouldn't need to manually set it). andystewart> HI Jeff, andystewart> Well, this is weird, I'm seeing a ZERO count for NMIs, so that andystewart> makes me think they are NOT being delivered. How would I go andystewart> about solving *that* little problem? I did a "cat Well, you can try booting with nmi_watchdog=2. This will try to use the local APIC to deliver nmi's, but I haven't actually seen a dual processor system that required this (all of them I've seen work with nmi_watchdog=1). It is worth a try, however. andystewart> /proc/cmdline" to insure that I had "nmi_watchdog=1" and andystewart> indeed it is there. Perhaps this is the clue we've been andystewart> seeking. Well, it only tells you that the nmi_watchdog won't trigger. We still have no insight into what the problem might actually be. >> If the NMI watchdog works, it will print a message to the console. >> However, you will not see this if you are in X windows. Do you have a >> serial console hooked up, by any chance? I strongly suggest it if you >> have the means. andystewart> I think I have a cable to which I could connect the serial andystewart> port of the Opteron to the serial port of another Linux box andystewart> (and then use minicom or some such terminal program). >> Aside from this, if it is indeed a hard lockup, there is really nothing >> you can do (without purchasing other hardware to help debug the >> problem). andystewart> Yeah, I was afraid of that. >> Please give these suggestions a shot and let us know how it goes. andystewart> Shall do - thanks, everybody! andystewart> Oh, be advised that when you smash your fist on the keyboard andystewart> after your system locks up for the umpteenth time, that a lot andystewart> of dead skin cells will come flying upward out of the bowels andystewart> of the keyboard. I would recommend safety glasses. Noted. =) -Jeff

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Jeff Moyer

==> Regarding Re: [Wlug] HOWTO debug hard lockups; Walt Sawyer <wsawyer(a)norfolk-county.com> adds: wsawyer> Andy, Are you sure it's the hard drive? Try running Knoppix live wsawyer> CD for a while. If it's still running after days(max uptime)+5, wsawyer> then perhaps it's something else. This changes things entirely. He'll be running a different kernel, so this test is not useful, in my opinion. -Jeff wsawyer> If this message is redundant, ignore it! Walt wsawyer> On Tue, 2005-06-07 at 19:19 -0400, Andy Stewart wrote: >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 >> >> Jeff Moyer wrote: > ==> Regarding [Wlug] HOWTO debug hard lockups; Andy >> Stewart <andystewart(a)comcast.net> adds: >> > >> > andystewart> HI gang, >> > >> > andystewart> My dual Opteron machine is not happy. I cannot get more >> than > andystewart> 7 straight days of uptime without getting a hard >> lock, > andystewart> requiring a reboot. (My definition of hard lock >> is: machine > andystewart> responds neither to keyboard input, mouse >> input, nor network > andystewart> pings). >> > >> > andystewart> I can stimulate hard locks by running OpenOffice 1.1.3 (I >> had > andystewart> 3 tonight, and 3-4 on a previous occasion while >> running > andystewart> OpenOffice). It makes no sense to me that an >> application run > andystewart> as a normal user could lockup a machine. >> > >> > andystewart> I've tried setting "nmi_watchdog=1" to see if I could get >> an > andystewart> "oops" when it hard locks - no dice. Do you know any >> other > andystewart> tricks I could try to see if it is the kernel which >> is locking > andystewart> up? I'm running SuSE's version of 2.6.8. >> > >> > Did you verify that NMIs are being delivered? After boot, cat > >> /proc/interrupts and make sure the NMI line is non-zero. Also note >> that, > at least with upstream and Red Hat kernels, the nmi_watchdog >> defaults to 1 > for Opterons (i.e. you shouldn't need to manually set >> it). >> >> HI Jeff, >> >> Well, this is weird, I'm seeing a ZERO count for NMIs, so that makes me >> think they are NOT being delivered. How would I go about solving *that* >> little problem? I did a "cat /proc/cmdline" to insure that I had >> "nmi_watchdog=1" and indeed it is there. Perhaps this is the clue we've >> been seeking. >> >> > If the NMI watchdog works, it will print a message to the console. > >> However, you will not see this if you are in X windows. Do you have a > >> serial console hooked up, by any chance? I strongly suggest it if you >> have > the means. >> >> I think I have a cable to which I could connect the serial port of the >> Opteron to the serial port of another Linux box (and then use minicom or >> some such terminal program). >> >> > >> > Aside from this, if it is indeed a hard lockup, there is really >> nothing you > can do (without purchasing other hardware to help debug >> the problem). >> >> Yeah, I was afraid of that. >> >> > >> > Please give these suggestions a shot and let us know how it goes. >> >> Shall do - thanks, everybody! >> >> Oh, be advised that when you smash your fist on the keyboard after your >> system locks up for the umpteenth time, that a lot of dead skin cells >> will come flying upward out of the bowels of the keyboard. I would >> recommend safety glasses. >> >> Later, >> >> Andy >> >> - -- >> Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA >> http://www.wlug.org >> >> -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: >> Using GnuPG with Thunderbird - http://enigmail.mozdev.org >> >> iD8DBQFCpiuVHl0iXDssISsRAowjAJsHjggG0QsMPQ/H+2YQnzNZPtF9gQCfepvV >> u6O8n+PSW4M0I1MHXsH06Xo= =ViVg -----END PGP SIGNATURE----- >> _______________________________________________ Wlug mailing list >> Wlug(a)mail.wlug.org http://mail.wlug.org/mailman/listinfo/wlug >> wsawyer> -- <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 TRANSITIONAL//EN"> wsawyer> <HTML> <HEAD> <META HTTP-EQUIV="Content-Type" CONTENT="text/html; wsawyer> CHARSET=UTF-8"> <META NAME="GENERATOR" CONTENT="GtkHTML/3.3.2"> wsawyer> </HEAD> <BODY> Andy, Are you sure it's the hard drive?  wsawyer> Try running Knoppix live CD for a while.  If it's still wsawyer> running after days(max uptime)+5, then perhaps it's something wsawyer> else. If this message is redundant, ignore it! wsawyer> Walt On Tue, 2005-06-07 at 19:19 -0400, Andy Stewart wsawyer> wrote: <BLOCKQUOTE TYPE=CITE> <PRE> COLOR="#000000">-----BEGIN PGP SIGNED MESSAGE----- COLOR="#000000">Hash: SHA1 wsawyer> Jeff Moyer wrote: COLOR="#000000">> ==> Regarding [Wlug] HOWTO debug hard wsawyer> lockups; Andy Stewart <<A wsawyer> HREF="mailto:andystewart@comcast.net">andystewart(a)comcast.net</A>> wsawyer> adds: > COLOR="#000000">> andystewart> HI gang, COLOR="#000000">> > wsawyer> andystewart> My dual Opteron machine is not happy. I cannot wsawyer> get more than > andystewart> 7 wsawyer> straight days of uptime without getting a hard lock, COLOR="#000000">> andystewart> requiring a reboot. (My wsawyer> definition of hard lock is: machine COLOR="#000000">> andystewart> responds neither to keyboard wsawyer> input, mouse input, nor network > wsawyer> andystewart> pings). > wsawyer> > andystewart> I can stimulate hard wsawyer> locks by running OpenOffice 1.1.3 (I had COLOR="#000000">> andystewart> 3 tonight, and 3-4 on a wsawyer> previous occasion while running > wsawyer> andystewart> OpenOffice). It makes no sense to me that an wsawyer> application run > andystewart> wsawyer> as a normal user could lockup a machine. COLOR="#000000">> > wsawyer> andystewart> I've tried setting "nmi_watchdog=1" to wsawyer> see if I could get an > wsawyer> andystewart> "oops" when it hard locks - no dice. Do wsawyer> you know any other > wsawyer> andystewart> tricks I could try to see if it is the kernel wsawyer> which is locking > andystewart> wsawyer> up? I'm running SuSE's version of 2.6.8. COLOR="#000000">> > Did you wsawyer> verify that NMIs are being delivered? After boot, cat wsawyer> > /proc/interrupts and make sure the NMI wsawyer> line is non-zero. Also note that, COLOR="#000000">> at least with upstream and Red Hat kernels, wsawyer> the nmi_watchdog defaults to 1 > wsawyer> for Opterons (i.e. you shouldn't need to manually set it). wsawyer> HI Jeff, wsawyer> Well, this is weird, I'm seeing a ZERO count wsawyer> for NMIs, so that makes me think they wsawyer> are NOT being delivered. How would I go about solving wsawyer> *that* little problem? I did a wsawyer> "cat /proc/cmdline" to insure that I had COLOR="#000000">"nmi_watchdog=1" and indeed it is there. wsawyer> Perhaps this is the clue we've been wsawyer> seeking. wsawyer> > If the NMI watchdog works, it will wsawyer> print a message to the console. > wsawyer> However, you will not see this if you are in X windows. Do you wsawyer> have a > serial console hooked up, wsawyer> by any chance? I strongly suggest it if you have COLOR="#000000">> the means. wsawyer> I think I have a cable to which I could wsawyer> connect the serial port of the COLOR="#000000">Opteron to the serial port of another Linux box wsawyer> (and then use minicom or some such wsawyer> terminal program). wsawyer> > > wsawyer> Aside from this, if it is indeed a hard lockup, there is really wsawyer> nothing you > can do (without wsawyer> purchasing other hardware to help debug the problem). wsawyer> Yeah, I was afraid of that. wsawyer> > > wsawyer> Please give these suggestions a shot and let us know how it wsawyer> goes. wsawyer> Shall do - thanks, everybody! wsawyer> Oh, be advised that when you smash your fist wsawyer> on the keyboard after your system wsawyer> locks up for the umpteenth time, that a lot of dead skin wsawyer> cells will come flying upward out of wsawyer> the bowels of the keyboard. I would COLOR="#000000">recommend safety glasses. wsawyer> Later, wsawyer> Andy wsawyer> - -- Andy wsawyer> Stewart, Founder Worcester Linux wsawyer> Users' Group Worcester, MA, wsawyer> USA <A wsawyer> HREF="http://www.wlug.org">http://www.wlug.org</A> wsawyer> -----BEGIN PGP SIGNATURE----- COLOR="#000000">Version: GnuPG v1.2.5 (GNU/Linux) COLOR="#000000">Comment: Using GnuPG with Thunderbird - <A wsawyer> HREF="http://enigmail.mozdev.org">http://enigmail.mozdev.org</A> wsawyer> COLOR="#000000">iD8DBQFCpiuVHl0iXDssISsRAowjAJsHjggG0QsMPQ/H+2YQnzNZPtF9gQCfepvV wsawyer> u6O8n+PSW4M0I1MHXsH06Xo= COLOR="#000000">=ViVg -----END PGP wsawyer> SIGNATURE----- COLOR="#000000">_______________________________________________ wsawyer> Wlug mailing list COLOR="#000000"><A wsawyer> HREF="mailto:Wlug@mail.wlug.org">Wlug(a)mail.wlug.org</A> wsawyer> <A wsawyer> HREF="http://mail.wlug.org/mailman/listinfo/wlug">http://mail.wlug.org/mailman/listinfo/wlug</A> wsawyer> </PRE> </BLOCKQUOTE> <TABLE CELLSPACING="0" CELLPADDING="0" wsawyer> WIDTH="100%"> <TR> <TD> <PRE> -- </PRE> </TD> </TR> </TABLE> wsawyer> </BODY> </HTML> _______________________________________________ wsawyer> Wlug mailing list Wlug(a)mail.wlug.org wsawyer> http://mail.wlug.org/mailman/listinfo/wlug

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Gary Hanley

On Tue, 7 Jun 2005, Andy Stewart wrote: > I'd rather not give up KDE, but I could try blackbox for a while to see > what happens. Well, my guess is that it is a hardware issue How about the MB settings, like the memory timings/clock ratios? Sometimes this can cause problems if they are set too aggressively. Usually there are one-off options in the BIOS menu for stable settings and speed settings so you don't have to tweak everything. Anything there you can check? Maybe down-shift your settings a little and see if the problem goes away. I haven't had the pleasure of working with a dual system every so I'm not familiar with any related BIOS settings you may need to modify. -- Gary

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Baris Hasdemir wrote: > On Tue, 2005-06-07 at 20:10 -0400, Andy Stewart wrote: >>-----BEGIN PGP SIGNED MESSAGE----- >>Hash: SHA1 >> >>Baris Hasdemir wrote: >>>On Tue, 2005-06-07 at 19:14 -0400, Andy Stewart wrote: >>>>I'd rather not give up KDE, but I could try blackbox for a while to see >>>>what happens. >>>It might also worth to disable hardware acceleration support. For >>>example you can use nv instead of nvidia, for a while. >>> >>>baris >>HI Baris, >> >>Thanks for the tip, but my video card is an older one based on the ATI >>Radeon 7500. Not everything in this machine is new. >> >>Thanks, > > Are you using ati or radeon module? if using latter you have the > hardware acceleration support, if I recall correctly. > HI Baris, Hmmm, let me check. It appears that I'm using the radeon module. I'll make a note to try disabling hardware acceleration support for the video card. Thanks for the idea! Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCpl32Hl0iXDssISsRAuKKAJ9nkqIT8By9WV4h9htjaiy7Sb/KpACbBmwF jInvBZ/LKPzIlezoXl7Bc+k= =qs7r -----END PGP SIGNATURE-----

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Baris Hasdemir

On Tue, 2005-06-07 at 20:10 -0400, Andy Stewart wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Baris Hasdemir wrote: > > On Tue, 2005-06-07 at 19:14 -0400, Andy Stewart wrote: > >>I'd rather not give up KDE, but I could try blackbox for a while to see > >>what happens. > > > > It might also worth to disable hardware acceleration support. For > > example you can use nv instead of nvidia, for a while. > > > > baris > > HI Baris, > > Thanks for the tip, but my video card is an older one based on the ATI > Radeon 7500. Not everything in this machine is new. > > Thanks, Are you using ati or radeon module? if using latter you have the hardware acceleration support, if I recall correctly. baris

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Walt Sawyer wrote: > Andy, > Are you sure it's the hard drive? Try running Knoppix live CD for a > while. If it's still running after days(max uptime)+5, then perhaps > it's something else. > > If this message is redundant, ignore it! > Walt HI Walt, I have suffered from hard drive problems on previous systems, and in each of those cases, I had strange errors reported in the /var/log/messages file. That's not to say that a hard drive problem couldn't cause a lockup, but that hasn't been my past experience. With the lockups I'm currently seeing, I'm not seeing any error messages in the /var/log/messages file. At this point, I think anything and everything is suspect until proven otherwise. Thanks for the ideas! I'm jotting them all down. Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCpjjYHl0iXDssISsRAvQFAJ4w8Q4A5Ai25Se0pgkoKdYWo9AFcACdF3Q4 bC9BhLL4vESujGOMSsA4R2o= =+CpT -----END PGP SIGNATURE-----

June 8, 2005

Re: [Wlug] HOWTO debug hard lockups

by Andy Stewart

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Baris Hasdemir wrote: > On Tue, 2005-06-07 at 19:14 -0400, Andy Stewart wrote: >>I'd rather not give up KDE, but I could try blackbox for a while to see >>what happens. > > It might also worth to disable hardware acceleration support. For > example you can use nv instead of nvidia, for a while. > > baris HI Baris, Thanks for the tip, but my video card is an older one based on the ATI Radeon 7500. Not everything in this machine is new. Thanks, Andy - -- Andy Stewart, Founder Worcester Linux Users' Group Worcester, MA, USA http://www.wlug.org -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.5 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFCpjdrHl0iXDssISsRAoz4AJoCqnNFec1qMaYhLluDuyajGurPGQCfYbSi H4FuxFHjw6+5FVAfcaoWLjY= =3+wG -----END PGP SIGNATURE-----

June 8, 2005