Question

[cgm999]

Hi
Can you please share some info related to

• how much memory 1M ipv4 and 200k ipv6 entries this module uses?
• how fast it takes to lookup for respective size?
  cheers

[bnchdan]

sorry for the late reply! The memory usage shouldn’t increase substantially. The data is stored in a tree structure.

You can see below the tests for 16,711,680 IPv4 entries (/24 * 65,536 subnets). The test was run on a VirtualBox Debian machine with 8 GB RAM and 4 CPU cores.

init.lua

local o2
local o3
for j=0, 255 do
    o2 = tostring(j)
    for k=0, 255 do

        local o3 = tostring(k)
        subnets=subnets+1
        
        blockedIPs:addSubnet("10."..o2.."."..o3..".0/24")


    end
end

acces.lua

ngx.header.content_type = "text/plain"

ngx.say("subnets "..subnets)
ngx.say("IPs ".. tostring(subnets * 255) )

local t0=ngx.now()
ngx.say(os.clock(), " ms")
ngx.say(" is blocked : ",blockedIPs:isInSubnets("10.200.200.25"))

ngx.say(os.clock(), " ms")

ngx.say(" is blocked : ",blockedIPs:isInSubnets("10.255.255.255"))
ngx.say(" is blocked : ",blockedIPs:isInSubnets("34.200.200.25"))

ngx.say(os.clock(), " ms")

result:

[bnchdan]

sorry for the late reply! The memory usage shouldn’t increase substantially. The data is stored in a tree structure.

You can see below the tests for 16,711,680 IPv4 entries (/24 * 65,536 subnets). The test was run on a VirtualBox Debian machine with 8 GB RAM and 4 CPU cores.

init.lua

local o2
local o3
for j=0, 255 do
    o2 = tostring(j)
    for k=0, 255 do

        local o3 = tostring(k)
        subnets=subnets+1
        
        blockedIPs:addSubnet("10."..o2.."."..o3..".0/24")


    end
end

acces.lua

ngx.header.content_type = "text/plain"

ngx.say("subnets "..subnets)
ngx.say("IPs ".. tostring(subnets * 255) )

local t0=ngx.now()
ngx.say(os.clock(), " ms")
ngx.say(" is blocked : ",blockedIPs:isInSubnets("10.200.200.25"))

ngx.say(os.clock(), " ms")

ngx.say(" is blocked : ",blockedIPs:isInSubnets("10.255.255.255"))
ngx.say(" is blocked : ",blockedIPs:isInSubnets("34.200.200.25"))

ngx.say(os.clock(), " ms")

result:

*the time is in seconds not ms