logo

InferX AI Function Platform (Lambda Function for Inference)

    --   Serve tens models in one box with ultra-fast (<2 sec) cold start (contact: support@inferx.net)

Nodes

nodename Ip Address CIDR CPU Count CPU Memory (GB) MaxContextPerGPU BlobStore GPUs
node2 192.168.0.44 10.1.2.0/8 30 400 1 True {
 "vRam": 14848,
 "map": {
  "0": {
   "contextCnt": 1,
   "slotCnt": 58
  },
  "1": {
   "contextCnt": 1,
   "slotCnt": 58
  }
 },
 "slotSize": 268435456,
 "totalSlotCnt": 58
}