Solved HP Compaq Elite 8300 SFF can't wake up from sleep

Hello,

I'd like to use FreeBSD on a HP Compaq Elite 8300 Small Form Factor. Unfortunately, I can't get working sleep/resume, neither S3 (suspend to RAM) nor S4 (suspend to disk). I don't care about S4, but I definitely need functional S3.

The machine is booting FreeBSD 13.0-RELEASE-p5, root on ZFS, in UEFI mode.

Running acpiconf -s 3 works as expected, but resume fails: when I press the power button, the computer powers on for a very short time, then powers off again and reboots.

This isn't related to DRM: the machine has nothing but Intel integrated graphics, and the problem is the same with and without drm.ko and i915kms.ko loaded.

Other operating systems (NetBSD, OpenBSD, Linux) aren't affected.

What can I try?
 
Depending on what you use it for, I just wouldn't let it sleep. Also, have you tried paying attention to how acpiconf -s 3 even works under other systems? The other systems probably have some different defaults than FreeBSD. If you get those defaults copied over to FreeBSD, you might be able to figure it out.
 
It's meant to be used as a desktop machine, so, well, no sleep at all isn't really an option.

Do you have an idea what kind of settings I should look for? I'm not familiar with ACPI stuff.

As additional information: loading acpi_hp.ko and/or acpi_video.ko doesn't make any difference.
 
In that case, I'd suggest looking at acpiconf(8) and see what other places it points you to. Great way to start exploring.

And in reference to some trolls we've seen recently, the forums are always there to help along with such explorations, make sense of info we come across, and help arrive at meaningful results, even if the results are different than the original goal. :p (This part is aimed more at everyone else who might be reading this thread).
 
If you like, I can let you have a copy of a file that you can copy to e.g. a suitably formatted USB flash drive, then update the BIOS (from that file) before booting an OS.
That would be nice, because I don't have a Windows system to run that .exe updater!
 
For comparison, I tested with 12.2-RELEASE and 14.0-CURRENT, as well as booting in legacy BIOS mode: it didn't work in any configuration. The only noticeable difference was with 14.0, where instead of an almost instant reboot after resume, the computer would stay on, but without outputing any video signal.
 
Some motherboards allow updating over the ethernet connection, …

As far as I recall, not so with 8200 and 8300 SFF.

00.03.08 Rev.A

K01_0308.BIN at <https://mega.nz/file/8VcjCC5Q#_O0yhBaJEcC_zBd53CoTz_4AnBR0bv8u2L1WHl27G7E>

Write it to the msdosfs file system of a non-partitioned drive. (The update routine might not find the file if written to a partition of the drive.)

Code:
% gpart show da2
gpart: No such geom: da2.
% lsblk da2
DEVICE         MAJ:MIN SIZE TYPE                                          LABEL MOUNT
da2              2:33  1.9G -                                                 - /media/General_UDisk_
% mount | grep da2
/dev/da2 on /media/General_UDisk_ (msdosfs, local)
%

I do have other files on this drive, but I don't recall them being required for the routine that you'll run.

1636591210657.png
 
K01_0308.BIN at <https://mega.nz/file/8VcjCC5Q#_O0yhBaJEcC_zBd53CoTz_4AnBR0bv8u2L1WHl27G7E>

Write it to the msdosfs file system of a non-partitioned drive. (The update routine might not find the file if written to a partition of the drive.)
Done, thank you.

Upgrading from that file doesn't work, it seems I have to upgrade to v.02.99 first:
Could you please share K01_0299.BIN as well? :)
 
Thank you sir! Now I have an up to date BIOS.

Unfortunately, still no luck with resume. Anything else to try?
 
… This isn't related to DRM: …

… Anything else to try?

Graphics. Recall:

… with 14.0, where instead of an almost instant reboot after resume, the computer would stay on, but without outputing any video signal.

An 8300 SFF desktop will pass through my hands in the near future (I might gently chase the customer today).

If I can find time, out of hours, to temporarily put in place a disk with FreeBSD (probably 14.0-CURRENT): I'll let you know what's found. I do have a readily available installation, but it's on a mobile hard disk drive. Not suitable for sleep/wake.

In the meantime, maybe try x11-drivers/xf86-video-intel.
 
Just curious, did you try 14-CURRENT with i915kms ?

Also, could you please set debug.acpi.suspend_bounce=1 before a suspend?
This should help to understand if the problem is in one of device drivers or somewhere deeper in the ACPI suspend/resume code/
 
I meant, the mobile hard disk drive is not suitable because it's on USB.

When I last checked, FreeBSD lacked the required support for USB.
I guess this is the difference between US English and GB English... "mobile hard disk drive"... I would have never guessed that really means "USB stick". Most of them are really SSD's rather than HDD's, but it's not impossible to find a USB to SATA adapter, and attach an HDD to that... 😅
 
Just curious, did you try 14-CURRENT with i915kms ?
I didn't until now and this... works! Do you think there is any chance to get it working the same way on 13.0-RELEASE?

Back on 13.0:
Also, could you please set debug.acpi.suspend_bounce=1 before a suspend?
This works fine.
Here's my dmesg from just after trying this:
Code:
---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.0-RELEASE-p4 #0: Tue Aug 24 07:33:27 UTC 2021
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 11.0.1 (git@github.com:llvm/llvm-project.git llvmorg-11.0.1-0-g43ff75f2c3fe)
VT(efifb): resolution 1024x768
CPU: Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz (3392.36-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>                                                                                                                                     
  Structured Extended Features3=0x9c000400<MD_CLEAR,IBPB,STIBP,L1DFL,SSBD>                                                                                                                   
  XSAVE Features=0x1<XSAVEOPT>                                                                                                                                                               
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID                                                                                                                                                         
  TSC: P-state invariant, performance statistics                                                                                                                                             
real memory  = 17179869184 (16384 MB)                                                                                                                                                         
avail memory = 16499134464 (15734 MB)                                                                                                                                                         
Event timer "LAPIC" quality 600                                                                                                                                                               
ACPI APIC Table: <HPQOEM SLIC-BPC>                                                                                                                                                           
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs                                                                                                                                           
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads                                                                                                                                   
random: registering fast source Intel Secure Key RNG                                                                                                                                         
random: fast provider: "Intel Secure Key RNG"                                                                                                                                                 
random: unblocking device.                                                                                                                                                                   
ioapic0 <Version 2.0> irqs 0-23                                                                                                                                                               
Launching APs: 1 2 6 4 3 5 7                                                                                                                                                                 
Timecounter "TSC-low" frequency 1696180278 Hz quality 1000                                                                                                                                   
KTLS: Initialized 8 threads                                                                                                                                                                   
random: entropy device external interface                                                                                                                                                     
[ath_hal] loaded                                                                                                                                                                             
WARNING: Device "kbd" is Giant locked and may be deleted before FreeBSD 14.0.                                                                                                                 
kbd1 at kbdmux0                                                                                                                                                                               
000.000062 [4354] netmap_init               netmap: loaded module                                                                                                                             
mlx5en: Mellanox Ethernet driver 3.6.0 (December 2020)                                                                                                                                       
nexus0                                                                                                                                                                                       
efirtc0: <EFI Realtime Clock>                                                                                                                                                                 
efirtc0: registered as a time-of-day clock, resolution 1.000000s                                                                                                                             
cryptosoft0: <software crypto>                                                                                                                                                               
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS>                                                                                                                                             
acpi0: <HPQOEM SLIC-BPC>                                                                                                                                                                     
acpi0: Power Button (fixed)                                                                                                                                                                   
cpu0: <ACPI CPU> on acpi0                                                                                                                                                                     
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0                                                                                                                     
Timecounter "HPET" frequency 14318180 Hz quality 950                                                                                                                                         
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xf7800000-0xf7bfffff,0xe0000000-0xefffffff irq 16 at device 2.0 on pci0
vgapci0: Boot video device
xhci0: <Intel Panther Point USB 3.0 controller> mem 0xf7c20000-0xf7c2ffff irq 16 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <simple comms> at device 22.0 (no driver attached)
uart2: <Intel Panther Point KT Controller> port 0xf0e0-0xf0e7 mem 0xf7c3a000-0xf7c3afff irq 19 at device 22.3 on pci0
uart2: Using 1 MSI message
em0: <Intel(R) PRO/1000 Network Connection> port 0xf080-0xf09f mem 0xf7c00000-0xf7c1ffff,0xf7c39000-0xf7c39fff irq 20 at device 25.0 on pci0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Using an MSI interrupt
em0: Ethernet address: 74:46:a0:c0:0f:d9
em0: netmap queues/slots: TX 1/1024, RX 1/1024
ehci0: <Intel Panther Point USB 2.0 controller> mem 0xf7c38000-0xf7c383ff irq 16 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
hdac0: <Intel Panther Point HDA Controller> mem 0xf7c30000-0xf7c33fff irq 22 at device 27.0 on pci0
ehci1: <Intel Panther Point USB 2.0 controller> mem 0xf7c37000-0xf7c373ff irq 23 at device 29.0 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci1
usbus2: 480Mbps High Speed USB v2.0
pcib1: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci1: <ACPI PCI bus> on pcib1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Panther Point AHCI SATA controller> port 0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf060-0xf07f mem 0xf7c36000-0xf7c367ff irq 19 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
acpi_button0: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROM> at iomem 0xcf000-0xcffff pnpid ORM0000 on isa0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
Timecounters tick every 1.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
hdacc0: <Realtek ALC221 HDA CODEC> at cad 0 on hdac0
hdaa0: <Realtek ALC221 Audio Function Group> at nid 1 on hdacc0
pcm0: <Realtek ALC221 (Analog)> at nid 23 and 27,26 on hdaa0
pcm1: <Realtek ALC221 (Analog 2.0+HP)> at nid 20,33 on hdaa0
hdacc1: <Intel Panther Point HDA CODEC> at cad 3 on hdac0
hdaa1: <Intel Panther Point Audio Function Group> at nid 1 on hdacc1
pcm2: <Intel Panther Point (HDMI/DP 8ch)> at nid 6 on hdaa1
Trying to mount root from zfs:zroot/ROOT/default []...
Root mount waiting for: usbus0 usbus1 usbus2 CAM
ugen2.1: <Intel EHCI root HUB> at usbus2
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen0.1: <0x8086 XHCI root HUB> at usbus0
uhub0 on usbus1
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1 on usbus0
uhub1: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub2 on usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
cd0 at ahcich1 bus 0 scbus1 target 0 lun 0
cd0: <hp DVD-RAM GH80N RF04> Removable CD-ROM SCSI device
cd0: Serial Number 222CD063960
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
ses0 at ahciem0 bus 0 scbus3 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <ST320LT007-9ZV142 0006HPM1> ATA8-ACS SATA 2.x device
ada0: Serial Number W0Q9PY6S
ada0: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 305245MB (625142448 512 byte sectors)
ada0: quirks=0x1<4K>
ada1 at ahcich2 bus 0 scbus2 target 0 lun 0
ada1: <SAMSUNG MZ7PD256HAFV-000H7 DXM05H6Q> ACS-2 ATA SATA 3.x device
ada1: Serial Number S16PNYAD806694
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 244198MB (500118192 512 byte sectors)
ada1: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ses0: pass0,ada0 in 'Slot 00', SATA Slot: scbus0 target 0
ses0: pass1,cd0 in 'Slot 01', SATA Slot: scbus1 target 0
ses0: pass2,ada1 in 'Slot 02', SATA Slot: scbus2 target 0
uhub1: 8 ports with 8 removable, self powered
uhub0: 3 ports with 3 removable, self powered
uhub2: 3 ports with 3 removable, self powered
Root mount waiting for: usbus1 usbus2
ugen1.2: <vendor 0x8087 product 0x0024> at usbus1
uhub3 on uhub0
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x0024> at usbus2
uhub4 on uhub2
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
Root mount waiting for: usbus1 usbus2
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
Root mount waiting for: usbus1
ugen1.3: <Microsoft Comfort Curve Keyboard 2000> at usbus1
ukbd0 on uhub3
ukbd0: <Microsoft Comfort Curve Keyboard 2000, class 0/0, rev 2.00/1.73, addr 3> on usbus1
kbd2 at ukbd0
Root mount waiting for: usbus1
ugen1.4: <Logitech Optical USB Mouse> at usbus1
ichsmb0: <Intel Panther Point SMBus controller> port 0xf040-0xf05f mem 0xf7c35000-0xf7c350ff irq 18 at device 31.3 on pci0
smbus0: <System Management Bus> on ichsmb0
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: cannot find EC device
acpi_wmi0: Embedded MOF found
ACPI: \134_SB.WMID.WQZZ: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361)
drmn0: <drmn> on vgapci0
vgapci0: child drmn0 requested pci_enable_io
vgapci0: child drmn0 requested pci_enable_io
[drm] Unable to create a private tmpfs mount, hugepage support will be disabled(-19).
VT: Replacing driver "efifb" with new "dummy".
Failed to add WC MTRR for [0xe0000000-0xefffffff]: -22; performance may suffer
[drm] Got stolen memory base 0xdb200000, size 0x4000000
[drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[drm] Driver supports precise vblank timestamp query.
Firmware Warning (ACPI): Possibly buggy BIOS with ACPI_TYPE_INTEGER for function enumeration
 (20201113/ACPI-2675)
[drm] Connector VGA-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.VGA-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector HDMI-A-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.HDMI-A-1
[drm]   - kern.vt.fb.default_mode
[drm] Connector DP-1: get mode from tunables:
[drm]   - kern.vt.fb.modes.DP-1
[drm]   - kern.vt.fb.default_mode
sysctl_warn_reuse: can't re-use a leaf (hw.dri.debug)!
[drm] Initialized i915 1.6.0 20190822 for drmn0 on minor 0
WARNING: Device "fb" is Giant locked and may be deleted before FreeBSD 14.0.
VT: Replacing driver "dummy" with new "fb".
start FB_INFO:
type=11 height=1080 width=1920 depth=32
cmsize=16 size=8294400
pbase=0xe030d000 vbase=0xfffff800e030d000
name=drmn0 flags=0x0 stride=7680 bpp=32
cmap[0]=0 cmap[1]=7f0000 cmap[2]=7f00 cmap[3]=c4a000
end FB_INFO
drmn0: fb0: i915drmfb frame buffer device
lo0: link state changed to UP
em0: link state changed to UP
uhid0 on uhub3
uhid0: <Microsoft Comfort Curve Keyboard 2000, class 0/0, rev 2.00/1.73, addr 3> on usbus1
ums0 on uhub3
ums0: <Logitech Optical USB Mouse, class 0/0, rev 2.00/3.40, addr 4> on usbus1
ums0: 3 buttons and [XYZ] coordinates ID=0
uhub2: at usbus2, port 1, addr 1 (disconnected)
ugen2.2: <vendor 0x8087 product 0x0024> at usbus2 (disconnected)
uhub4: at uhub2, port 1, addr 2 (disconnected)
uhub4: detached
uhub2: detached
uhub0: at usbus1, port 1, addr 1 (disconnected)
ugen1.2: <vendor 0x8087 product 0x0024> at usbus1 (disconnected)
uhub3: at uhub0, port 1, addr 2 (disconnected)
ugen1.3: <Microsoft Comfort Curve Keyboard 2000> at usbus1 (disconnected)
ukbd0: at uhub3, port 5, addr 3 (disconnected)
ukbd0: detached
uhid0: at uhub3, port 5, addr 3 (disconnected)
uhid0: detached
ugen1.4: <Logitech Optical USB Mouse> at usbus1 (disconnected)
ums0: at uhub3, port 6, addr 4 (disconnected)
ums0: detached
uhub3: detached
uhub0: detached
uhub1: at usbus0, port 1, addr 1 (disconnected)
uhub1: detached
vgapci0: child drmn0 requested pci_set_powerstate
i915 raw-wakerefs=3 wakelocks=3 on cleanup
acpi0: cleared fixed power button status
vgapci0: child drmn0 requested pci_set_powerstate
vgapci0: child drmn0 requested pci_enable_io
vgapci0: child drmn0 requested pci_enable_io
xhci0: Port routing mask set to 0xffffffff
uhub0 on usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub0: 8 ports with 8 removable, self powered
em0: link state changed to DOWN
uhub1 on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub2 on usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
em0: link state changed to UP
uhub2: 3 ports with 3 removable, self powered
uhub1: 3 ports with 3 removable, self powered
ugen2.2: <vendor 0x8087 product 0x0024> at usbus2
uhub3 on uhub2
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
ugen1.2: <vendor 0x8087 product 0x0024> at usbus1
uhub4 on uhub1
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
uhub4: 6 ports with 6 removable, self powered
uhub3: 8 ports with 8 removable, self powered
ugen1.3: <Microsoft Comfort Curve Keyboard 2000> at usbus1
ukbd0 on uhub4
ukbd0: <Microsoft Comfort Curve Keyboard 2000, class 0/0, rev 2.00/1.73, addr 3> on usbus1
kbd2 at ukbd0
uhid0 on uhub4
uhid0: <Microsoft Comfort Curve Keyboard 2000, class 0/0, rev 2.00/1.73, addr 3> on usbus1
ugen1.4: <Logitech Optical USB Mouse> at usbus1
ums0 on uhub4
ums0: <Logitech Optical USB Mouse, class 0/0, rev 2.00/3.40, addr 4> on usbus1
ums0: 3 buttons and [XYZ] coordinates ID=0
 
The problem does not look like it's related to any particular driver. Seems to be something in the ACPI code or in the platform code (like multiprocessor support, etc).
So, most likely would not be easy to identify what exactly needs to be merged form 14 to 13.
 
Back
Top