Other Crash upon access to krb5p NFSv4 export

R

rjr

I have a machine which recently crashed with:

Code: 
kernel: Fatal trap 12: page fault while in kernel mode

The configuration is as such:
​
VMware VM, Xeon(R) CPU E5-2630, 4 core, 8 GB RAM​
10.3-RELEASE-p11 FreeBSD 10.3-RELEASE-p11​
​
Relevant entries in /etc/rc.conf:

Code: 
kinit_enable="YES"
gssd_enable="YES"
nfsuserd_enable="YES"

The entry in /etc/fstab:

Code: 
nas:/encr_volume                 /data  nfs  rw,tcp,nfsv4,sec=krb5p,gssname=nfs,late

Here's a backtrace from the crash dump:

Code: 
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...

Unread portion of the kernel message buffer:
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = interrupt enabled, resume, IOPL = 0
current process         = 41770 (newnfs 1)
trap number             = 12
panic: page fault
cpuid = 0
KDB: stack backtrace:
#0 0xffffffff8098e3e0 at kdb_backtrace+0x60
#1 0xffffffff809510b6 at vpanic+0x126
#2 0xffffffff80950f83 at panic+0x43
#3 0xffffffff80d55f8b at trap_fatal+0x36b
#4 0xffffffff80d5628d at trap_pfault+0x2ed
#5 0xffffffff80d5590a at trap+0x47a
#6 0xffffffff80d3b8d2 at calltrap+0x8
#7 0xffffffff81c2a411 at swcr_process+0x8f1
#8 0xffffffff81c27b39 at crypto_dispatch+0x69
#9 0xffffffff81c15e1a at aes_encrypt_1+0xba
#10 0xffffffff81c15bae at aes_decrypt+0x16e
#11 0xffffffff81c12e42 at krb5_unwrap+0x452
#12 0xffffffff81c1d280 at xdr_rpc_gss_unwrap_data+0x250
#13 0xffffffff81c1c6ad at rpc_gss_validate+0x2ed
#14 0xffffffff80b51abb at clnt_vc_call+0xa1b
#15 0xffffffff80b4feea at clnt_reconnect_call+0x4fa
#16 0xffffffff80843a0c at newnfs_request+0xa8c
#17 0xffffffff8087cd02 at nfscl_request+0x72
Uptime: 24d20h46m26s
Dumping 601 out of 8167 MB:..3%..11%..22%..32%..43%..51%..62%..72%..83%..91%

Reading symbols from /boot/modules/vmxnet.ko...done.
Loaded symbols for /boot/modules/vmxnet.ko
Reading symbols from /boot/modules/vmxnet3.ko...done.
Loaded symbols for /boot/modules/vmxnet3.ko
Reading symbols from /boot/kernel/kgssapi_krb5.ko.symbols...done.
Loaded symbols for /boot/kernel/kgssapi_krb5.ko.symbols
Reading symbols from /boot/kernel/kgssapi.ko.symbols...done.
Loaded symbols for /boot/kernel/kgssapi.ko.symbols
Reading symbols from /boot/kernel/crypto.ko.symbols...done.
Loaded symbols for /boot/kernel/crypto.ko.symbols
Reading symbols from /boot/kernel/rc4.ko.symbols...done.
Loaded symbols for /boot/kernel/rc4.ko.symbols
Reading symbols from /boot/modules/vmmemctl.ko...done.
Loaded symbols for /boot/modules/vmmemctl.ko
#0  doadump (textdump=<value optimized out>) at pcpu.h:219
219     pcpu.h: No such file or directory.
        in pcpu.h
(kgdb) bt
#0  doadump (textdump=<value optimized out>) at pcpu.h:219
#1  0xffffffff80950d12 in kern_reboot (howto=260) at /usr/src/sys/kern/kern_shutdown.c:486
#2  0xffffffff809510f5 in vpanic (fmt=<value optimized out>, ap=<value optimized out>) at /usr/src/sys/kern/kern_shutdown.c:889
#3  0xffffffff80950f83 in panic (fmt=0x0) at /usr/src/sys/kern/kern_shutdown.c:818
#4  0xffffffff80d55f8b in trap_fatal (frame=<value optimized out>, eva=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:858
#5  0xffffffff80d5628d in trap_pfault (frame=0xfffffe01f00b6e20, usermode=<value optimized out>) at /usr/src/sys/amd64/amd64/trap.c:681
#6  0xffffffff80d5590a in trap (frame=0xfffffe01f00b6e20) at /usr/src/sys/amd64/amd64/trap.c:447
#7  0xffffffff80d3b8d2 in calltrap () at /usr/src/sys/amd64/amd64/exception.S:236
#8  0xffffffff81c2f5d1 in rijndaelDecrypt (rk=0xfffff80006d8e8f8, Nr=<value optimized out>, ct=<value optimized out>,
    pt=0xfffff8002aaec278 "\202������;�/M\237Y&\031�\210�;�(�m-\215u��\004\037�\026�\f-q�J�\031\2161\211\222~BN�\a\t�l�\023�B\002�\212�\021�嵼2]G9�P1>\001$�@�M�\201q\235�\200.���\220r\227M���\003�\203`\\�\016\027\222\036\nc\031G�(��\030\2021\217\203�\022�^�\035\006PV5s�C�G�|9�") at /usr/src/sys/modules/crypto/../../crypto/rijndael/rijndael-alg-fst.c:1177
#9  0xffffffff81c2a411 in swcr_process (dev=<value optimized out>, crp=0xfffff801d3b3f318, hint=-1819015790) at /usr/src/sys/modules/crypto/../../opencrypto/cryptosoft.c:249
#10 0xffffffff81c27b39 in crypto_dispatch (crp=0xfffff801d3b3f318) at /usr/src/sys/modules/crypto/../../opencrypto/crypto.c:806
#11 0xffffffff81c15e1a in aes_encrypt_1 (ks=<value optimized out>, buftype=<value optimized out>, buf=0xfffff80214fb6500, skip=<value optimized out>, len=<value optimized out>,
    ivec=<value optimized out>, encdec=0) at /usr/src/sys/modules/kgssapi_krb5/../../kgssapi/krb5/kcrypto_aes.c:160
#12 0xffffffff81c15bae in aes_decrypt (ks=<value optimized out>, inout=<value optimized out>, skip=<value optimized out>, len=<value optimized out>, ivec=<value optimized out>,
    ivlen=254614228) at /usr/src/sys/modules/kgssapi_krb5/../../kgssapi/krb5/kcrypto_aes.c:304
#13 0xffffffff81c12e42 in krb5_unwrap (ctx=<value optimized out>, minor_status=<value optimized out>, mp=0xfffffe01f00b7318, conf_state=0xfffffe01f00b7310, qop_state=<value optimized out>)
    at kcrypto.h:130
#14 0xffffffff81c1d280 in xdr_rpc_gss_unwrap_data (resultsp=0xfffffe01f00b74a0, ctx=0xfffff80009790600, qop=0, svc=<value optimized out>, seq=89186)
    at /usr/src/sys/modules/kgssapi/../../rpc/rpcsec_gss/rpcsec_gss_prot.c:293
#15 0xffffffff81c1c6ad in rpc_gss_validate (auth=<value optimized out>, xid=<value optimized out>, verf=<value optimized out>, resultsp=0xfffffe01f00b74a0)
    at /usr/src/sys/modules/kgssapi/../../rpc/rpcsec_gss/rpcsec_gss.c:707
#16 0xffffffff80b51abb in clnt_vc_call (cl=<value optimized out>, ext=<value optimized out>, proc=<value optimized out>, args=<value optimized out>, resultsp=0xfffffe01f00b7890, utimeout=
      {tv_sec = 2147483647, tv_usec = 0}) at /usr/src/sys/rpc/clnt_vc.c:511
#17 0xffffffff80b4feea in clnt_reconnect_call (cl=0xfffff80004e34d80, ext=0xfffffe01f00b7700, proc=1, args=0xfffff8020a9ff400, resultsp=0xfffffe01f00b7890, utimeout=
      {tv_sec = 2147483647, tv_usec = 0}) at /usr/src/sys/rpc/clnt_rc.c:271
#18 0xffffffff80843a0c in newnfs_request (nd=<value optimized out>, nmp=<value optimized out>, clp=<value optimized out>, nrp=<value optimized out>, vp=<value optimized out>,
    td=<value optimized out>, cred=<value optimized out>, prog=<value optimized out>, vers=<value optimized out>, retsum=<value optimized out>, toplevel=<value optimized out>,
    xidp=<value optimized out>, sep=<value optimized out>) at /usr/src/sys/fs/nfs/nfs_commonkrpc.c:747
#19 0xffffffff8087cd02 in nfscl_request (nd=0xe0, vp=0xe5, p=0xf2d1ad4, cred=<value optimized out>, stuff=0xe5) at /usr/src/sys/fs/nfsclient/nfs_clport.c:871
#20 0xffffffff808643e9 in nfsrpc_read (vp=0xfffff80065cde760, uiop=0xfffffe01f00b7b00, cred=<value optimized out>, p=0x0, nap=0xfffffe01f00b79c8, attrflagp=0xfffffe01f00b7a94)
    at /usr/src/sys/fs/nfsclient/nfs_clrpcops.c:1441
#21 0xffffffff808740d5 in ncl_readrpc (vp=0xfffff80065cde760, uiop=0xfffffe01f00b7b00, cred=0xfffff80018dd7100) at /usr/src/sys/fs/nfsclient/nfs_clvnops.c:1382
#22 0xffffffff8087fafd in ncl_doio (vp=0xfffff80065cde760, bp=0xfffffe01f0f67b08, cr=0x93940592, td=<value optimized out>, called_from_strategy=<value optimized out>)
    at /usr/src/sys/fs/nfsclient/nfs_clbio.c:1626
#23 0xffffffff80882084 in nfssvc_iod (instance=<value optimized out>) at /usr/src/sys/fs/nfsclient/nfs_clnfsiod.c:302
#24 0xffffffff8091a53a in fork_exit (callout=0xffffffff80881e30 <nfssvc_iod>, arg=0xffffffff815c3984, frame=0xfffffe01f00b7c00) at /usr/src/sys/kern/kern_fork.c:1027
#25 0xffffffff80d3be0e in fork_trampoline () at /usr/src/sys/amd64/amd64/exception.S:611
#26 0x0000000000000000 in ?? ()
Current language:  auto; currently minimal
(kgdb)

I understand 10.3 is recently EoL'd, yet I am hoping to pique someone's interest, and perhaps get some tips on how to further troubleshoot this issue. The machine was up for 4 weeks before the crash, and has been up for a week since. I have similarly configured machines that have been running fine.
 
You must log in or register to reply here.
Back
Top