Since this is the first time savecore was used on this system, the savecore files are unix.0 and vmcore.0 . For starters, let's take a look at the strings in vmcore.0 and find out a little about the system. We need to find out what type of system we are dealing with, and it would be nice to get an idea of what type of trouble the system got into. Things of particular interest have been underlined to help you see what the trained eye looks for. Hiya... strings vmcore.0 more Generic_101318-41 Illegal instruction g Level = 0 11403144 bytes Thu Jun 16 15:59:0 saved dump... nc Module Version 1.23 loaded Version 1.12 loaded LC_CTYPE CHRCLASS LC_NUMERIC LC_TIME LANGUAGE LC_COLLATE LC_MONETARY LC_MESSAGES @>{] BAD TRAP: type=2 rp=f0ac95bc addr=0 mmu_fsr=0 rw=0 CRHout: Illegal instruction pid=24709, pc=0xfc69d458, sp=0xf0ac9608, psr=0x404000c4, context=931 g1-g7: fc69d440, 8000000, ffffff00, 0, f0ac99e0, 1, fc4c6200 Begin traceback... sp = f0ac9608 Called from f00ee640, fp=f0ac9668, args=fc61607c 80 fc6ca580 1 19f8309 fc61607c Called from fc606ca0, fp=f0ac9760, args=fc61607c 80 fc6ca580 1 19f8309 fc61607c Called from fc607a14, fp=f0ac9858, args=f0ac9e94 f0ac9920 f0ac9e94 1 fc607800 fc6ca580 Called from f0070898, fp=f0ac98b8, args=f0ac9e94 f0ac9920 0 0 0 fc607b04 Called from f0041aa0, fp=f0ac9938, args=f0160dec f0ac9eb4 0 f0ac9e90 fffffffc ffffffff Called from ef790f04, fp=effff138, args=35 0 8d03 1 8 0 End traceback... panic: Illegal instruction syncing file systems... done 3682 static and sysmap kernel pages 90 dynamic kernel data pages 288 kernel-pageable pages 2 segkmap kernel pages 0 segvn kernel pages 180 current user process pages 4242 total pages (4242 chunks) dumping to vp fc21b404, offset 171664 93, Sun Microsystems, Inc. pac: enabled - SuperSPARC/SuperCache cpu0: TI,TMS390Z55 (mid 8 impl 0x0 ver 0x1 clock 50 MHz) mem = 65536K (0x4000000) avail mem = 57569280 Ethernet address = 8:0:20:1f:d9:aa ( Actual Ethernet address has been modified) root nexus = SUNW,SPARCstation-10 iommu0 at root: obio 0xe0000000 sbus0 at iommu0: obio 0xe0001000 espdma0 at sbus0: SBus slot f 0x400000 dma1 at sbus0: SBus slot 0 0x81000 esp0 at espdma0: SBus slot f 0x800000 sparc ipl 4 esp1 at dma1: SBus slot 0 0x80000 SBus level 3 sparc ipl 5 sd1 at esp0: target 1 lun 0 sd1 is /iommu@f,e0000000/sbus@f,e0001000/espdma@f,400000/esp@f,800000/sd@1,0 <SUN1.05 cyl 2036 alt 2 hd 14 sec 72> sd3 at esp0: target 3 lun 0 sd3 is /iommu@f,e0000000/sbus@f,e0001000/espdma@f,400000/esp@f,800000/sd@3,0 <SUN1.05 cyl 2036 alt 2 hd 14 sec 72> sd6 at esp0: target 6 lun 0 sd6 is /iommu@f,e0000000/sbus@f,e0001000/espdma@f,400000/esp@f,800000/sd@6,0 sd18 at esp1: target 3 lun 0 sd18 is /iommu@f,e0000000/sbus@f,e0001000/dma@0,81000/esp@0,80000/sd@3,0 <SUN1.05 cyl 2036 alt 2 hd 14 sec 72> Unable to install/attach driver 'isp' root on /pseudo/md@0:0,blk fstype ufs WARNING: forceload of misc/md_hotspares failed obio0 at root zs0 at obio0: obio 0x100000 sparc ipl 12 zs0 is /obio/zs@0,100000 zs1 at obio0: obio 0x0 sparc ipl 12 zs1 is /obio/zs@0,0 cpu 0 initialization complete - online Unable to install/attach driver 'vme' Unable to install/attach driver 'mcp' Unable to install/attach driver 'mcpzsa' Unable to install/attach driver 'vme' Unable to install/attach driver 'mcp' Unable to install/attach driver 'mcpzsa' Unable to install/attach driver 'stc' ledma0 at sbus0: SBus slot f 0x400010 le0 at ledma0: SBus slot f 0xc00000 sparc ipl 6 le0 is /iommu@f,e0000000/sbus@f,e0001000/ledma@f,400010/le@f,c00000 lebuffer0 at sbus0: SBus slot 0 0x40000 le1 at lebuffer0: SBus slot 0 0x60000 SBus level 4 sparc ipl 7 le1 is /iommu@f,e0000000/sbus@f,e0001000/lebuffer@0,40000/le@0,60000 dump on /dev/md/dsk/d30 size 102800K t 3 0x0 sbusmem3 is /iommu@f,e0000000/sbus@f,e0001000/sbusmem@3,0 sbusmem15 at sbus0: SBus slot f 0x0 sbusmem15 is /iommu@f,e0000000/sbus@f,e0001000/sbusmem@f,0 Unable to install/attach driver 'xbox' SUNW,bpp0 at sbus0: SBus slot f 0x4800000 SBus level 2 sparc ipl 3 SUNW,bpp0 is /iommu@f,e0000000/sbus@f,e0001000/SUNW,bpp@f,4800000 Unable to install/attach driver 'pn' Unable to install/attach driver 'cgeight' Unable to install/attach driver 'ipi3sc' audio: no mmcodec device foundSUNW,DBRIe0 at sbus0: SBus slot f 0x8010000 SBus level 5 sparc ipl 9 SUNW,DBRIe0 is /iommu@f,e0000000/sbus@f,e0001000/SUNW,DBRIe@f,8010000 pseudo-device: vol0 vol0 is /pseudo/vol@0 Unable to install/attach driver 'xbox' Unable to install/attach driver 'vme' Unable to install/attach driver 'mcp' Unable to install/attach driver 'vme' Unable to install/attach driver 'mcp' Unable to install/attach driver 'mcpzsa' Unable to install/attach driver 'vme' Unable to install/attach driver 'mcp' Unable to install/attach driver 'mcpp' Unable to install/attach driver 'stc' Unable to install/attach driver 'isp' Unable to install/attach driver 'qec' Unable to install/attach driver 'qe' (References to custom hardware and its driver have been omitted) cseight0 at sbus0: SBus slot 1 0x800 and SBus slot 1 0xc00 and SBus slot 1 0x1800 and SBus slot 1 0x1c00 and SBus slot 1 0x2000 SBus level 5 sparc ipl 9 cseight0 is /iommu@f,e0000000/sbus@f,e0001000/cseight@1,800 cseight1 at sbus0: SBus slot 3 0x800 and SBus slot 3 0xc00 and SBus slot 3 0x1800 and SBus slot 3 0x1c00 and SBus slot 3 0x2000 SBus level 5 sparc ipl 9 cseight1 is /iommu@f,e0000000/sbus@f,e0001000/cseight@3,800 Hiya... ( We quit out of more at this point as another set of reboot messages was showing up) What did we learn from the messages ring buffer? First, the system has the Solaris 2.3 jumbo kernel patch 101318-41 installed. This patch fixes several nasty kernel- related bugs . It's good to see that the customer has the patch installed. Second, the system panic'ed due to a bad trap type 2, which is an illegal instruction. Third, we see that the system has one CPU module, running at 50 megahertz clock speed. We will come back to this later. Finally, we also discover that we are dealing with some unknown quantities : custom hardware and custom device drivers. We will remember this; however, we will try not to let it prejudice us during our analysis work. (Ahem! Please, no snickering!) |