InferX AI Function Platform (Lambda Function for Inference)

-- Serve tens models in one box with ultra-fast (<2 sec) cold start (contact: support@inferx.net)

Models

tenant	namespace	model name	gpu count	vram (GB)	cpu	memory (GB)	standby			state	snapshot nodes	revision
tenant	namespace	model name	gpu count	vram (GB)	cpu	memory (GB)	gpu	pageable	pinned	state	snapshot nodes	revision
public	Deci	DeciLM-7B	2	13.0	20.0	50.0	Blob	Blob	Blob	Normal	['node3']	227
public	Deci	DeciLM-7B-instruct	2	13.0	20.0	50.0	Blob	Blob	Blob	Normal	['node3']	230

Summary

Model Count	2
GPU Count	4
VRAM (GB)	52.0 GB
CPU Cores	40.0
Memory (GB)	100.0 GB