InferX AI Function Platform (Lambda Function for Inference)

-- Serve tens models in one box with ultra-fast (<2 sec) cold start (contact: support@inferx.net)

Models

tenant	namespace	model name	gpu count	vram (GB)	cpu	memory (GB)	standby			state	snapshot nodes	revision
tenant	namespace	model name	gpu count	vram (GB)	cpu	memory (GB)	gpu	pageable	pinned	state	snapshot nodes	revision
public	mosaicml	mpt-7b	2	13.8	20.0	50.0	Blob	Blob	Blob	Normal	['node3']	165
public	mosaicml	mpt-7b-storywriter	2	13.8	20.0	50.0	Blob	Blob	Blob	Normal	['node3']	349

Summary

Model Count	2
GPU Count	4
VRAM (GB)	55.2 GB
CPU Cores	40.0
Memory (GB)	100.0 GB