RE: Freebios2 recovery progress... pci64 mem optimization

[YhLu]

Cool, with prefmem 64 bit, and mem opt.

Get back 512M RAM.

Mellanox IB PCI-E card support real pci mem64.

base1: 0xd8000000 limit1: 0xfcffffffff size: 0x18800000 align: 27
base2: 0xf4000000 limit2: 0xfe8fffff size: 0x04c00000 align: 26
base1: 0xfce0000000 limit1: 0xfcffffffff size: 0x18800000 align: 27
base2: 0xf8000000 limit2: 0xfe8fffff size: 0x04c00000 align: 26
PCI_DOMAIN: 0000 00 <- [0x0000001000 - 0x0000005fff] io
PCI_DOMAIN: 0000 01 <- [0xfce0000000 - 0xfcf87fffff] prefmem
PCI_DOMAIN: 0000 02 <- [0x00f8000000 - 0x00fcbfffff] mem

Setting variable MTRR 0, base:    0MB, range: 2048MB, type WB
Setting variable MTRR 1, base: 2048MB, range: 1024MB, type WB
Setting variable MTRR 2, base: 3072MB, range:  512MB, type WB
Setting variable MTRR 3, base: 3584MB, range:  256MB, type WB
Setting variable MTRR 4, base: 3840MB, range:  128MB, type WB

LBsuse91AMD64:~ # lspci -vvxxx -s 3:0.0 
0000:03:00.0 InfiniBand: Mellanox Technology MT25208 InfiniHost III Ex HCA
(rev a0)
        Subsystem: Mellanox Technology MT25208 InfiniHost III Ex HCA
        Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
        Interrupt: pin A routed to IRQ 18
        Region 0: Memory at fc800000 (64-bit, non-prefetchable)
        Region 2: Memory at fce8000000 (64-bit, prefetchable) [size=8M]
        Region 4: Memory at fce0000000 (64-bit, prefetchable) [size=128M]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] Vital Product Data
        Capabilities: [90] Message Signalled Interrupts: 64bit+ Queue=0/5
Enable-
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] #10 [0001]
00: b3 15 78 62 42 01 10 00 a0 00 06 0c 10 00 00 00
10: 04 00 80 fc 00 00 00 00 0c 00 00 e8 fc 00 00 00
20: 0c 00 00 e0 fc 00 00 00 00 00 00 00 b3 15 78 62
30: 00 00 00 00 40 00 00 00 00 00 00 00 00 01 00 00
40: 01 48 02 00 00 00 00 00 03 90 ff 7f 11 11 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 10 00 01 00 c0 0f 00 00 00 20 01 00 81 f4 03 08
70: 00 00 81 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 11 00 1f 00 00 20 08 00 00 22 08 00
90: 05 60 8a 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

LBsuse91AMD64:~ # lspci -vvxxx -s 8:0.0  
0000:08:00.0 InfiniBand: Mellanox Technology MT25208 InfiniHost III Ex HCA
(rev a0)
        Subsystem: Mellanox Technology MT25208 InfiniHost III Ex HCA
        Control: I/O- Mem+ BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr+
Stepping- SERR+ FastB2B-
        Status: Cap+ 66Mhz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR-
        Interrupt: pin A routed to IRQ 50
        Region 0: Memory at fca00000 (64-bit, non-prefetchable)
        Region 2: Memory at fcf8000000 (64-bit, prefetchable) [size=8M]
        Region 4: Memory at fcf0000000 (64-bit, prefetchable) [size=128M]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0-,D1-,D2-,D3hot-,D3cold-)
                Status: D0 PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [48] Vital Product Data
        Capabilities: [90] Message Signalled Interrupts: 64bit+ Queue=0/5
Enable-
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] #10 [0001]
00: b3 15 78 62 42 01 10 00 a0 00 06 0c 10 00 00 00
10: 04 00 a0 fc 00 00 00 00 0c 00 00 f8 fc 00 00 00
20: 0c 00 00 f0 fc 00 00 00 00 00 00 00 b3 15 78 62
30: 00 00 00 00 40 00 00 00 00 00 00 00 00 01 00 00
40: 01 48 02 00 00 00 00 00 03 90 ff 7f 11 11 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 10 00 01 00 c0 0f 00 00 00 20 01 00 81 f4 03 08
70: 00 00 81 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 11 00 1f 00 00 20 08 00 00 22 08 00
90: 05 60 8a 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

Freebios2 recovery progress... pci64 mem optimization

YhLu  writes:
> Cool, with prefmem 64 bit, and mem opt.
>
> Get back 512M RAM.

That is my motivation.  The fact that 256M video cards
are prefmem but are not 64bit is annoying.

On the server side everything seems to be large 64bit prefetchable memory areas.

32bit kernels have an issue with 64bit resources though :(

Eric