logo

InferX AI Function Platform (Lambda Function for Inference)

    --   Serve tens models in one box with ultra-fast (<2 sec) cold start (contact: support@inferx.net)

Nodes

nodename Ip Address CIDR CPU Count CPU Memory (GB) MaxContextPerGPU BlobStore GPUs
node3 192.168.0.44 10.1.2.0/8 30 400 2 True {
 "vRam": 14336,
 "map": {
  "0": {
   "contextCnt": 2,
   "slotCnt": 56
  },
  "1": {
   "contextCnt": 2,
   "slotCnt": 56
  }
 },
 "slotSize": 268435456,
 "totalSlotCnt": 56
}