Spring Sale - Up to 30% off gaming rigs · Free 2-day shipping over $99
3-Year Warranty on everything Free 2-Day shipping over $99 30-Day free returns Secure payment
-14% CvvStar AI Inference Server — 4× L4 24GB — 2U · Xeon Gold 5416S · 256GB DDR5 · 4× L4 24GB · 4× 1.92TB NVMe
Visit the CvvStar Store

CvvStar AI Inference Server — 4× L4 24GB

4.8 (12 Reviews)
SKU: srv-custom-inference
Processor Intel Xeon Gold 5416S (2.0 GHz, 30MB)
Graphics 4× NVIDIA L4 24GB GDDR6 (96GB VRAM)
Memory 256GB DDR5-4800 ECC
Storage 4× 1.92TB NVMe SSD
OS Ubuntu 22.04 + vLLM / TensorRT-LLM

Cost-optimized inference server with 4× NVIDIA L4 24GB GPUs — perfect for serving Llama 3 8B, Mistral, and embedding models at scale. Xeon Gold 5416S with 256GB ECC DDR5 and 4× 1.92TB NVMe. Each L4 consumes only 72W for high efficiency. Supports vLLM, TensorRT-LLM, and Triton Inference Server.

Specifications

Performance

Processor Intel Xeon Gold 5416S (2.0 GHz, 30MB)
Generation 4th Gen Sapphire Rapids
Cores / Threads 16 cores / 32 threads

Memory & Storage

RAM Installed 256GB DDR5-4800 ECC
RAM Type DDR5 ECC Registered
RAM Slots 32 DIMM slots
Max RAM 8TB
Storage 4× 1.92TB NVMe SSD
Storage Type PCIe 5.0 NVMe
Max Storage 8× 2.5" NVMe bays

Graphics

Graphics Card 4× NVIDIA L4 24GB GDDR6 (96GB VRAM)

Physical & Other

Operating System Ubuntu 22.04 + vLLM / TensorRT-LLM
Weight 32 kg
Ports 4× 25GbE · iDRAC · 6× USB
Warranty 3 Years Onsite

Customer Reviews

No reviews yet. Be the first to review this product!

Frequently Asked Questions

What processor does the CvvStar AI Inference Server — 4× L4 24GB have?
The CvvStar AI Inference Server — 4× L4 24GB is powered by Intel Xeon Gold 5416S (2.0 GHz, 30MB) (4th Gen Sapphire Rapids, 16 cores / 32 threads). It handles demanding workloads like gaming, video editing, and software development with ease.
How much memory (RAM) does the CvvStar AI Inference Server — 4× L4 24GB have?
This configuration comes with 256GB DDR5-4800 ECC (DDR5 ECC Registered). It supports expansion up to 8TB. That's enough memory for smooth multitasking, virtual machines, and large applications.
What storage does the CvvStar AI Inference Server — 4× L4 24GB offer?
It ships with 4× 1.92TB NVMe SSD (PCIe 5.0 NVMe), providing fast boot times and ample space for your files, games, and applications.
What graphics card is in the CvvStar AI Inference Server — 4× L4 24GB?
The CvvStar AI Inference Server — 4× L4 24GB features 4× NVIDIA L4 24GB GDDR6 (96GB VRAM). This delivers strong performance for modern games and GPU-accelerated tasks.
What operating system comes with the CvvStar AI Inference Server — 4× L4 24GB?
It comes pre-installed with Ubuntu 22.04 + vLLM / TensorRT-LLM. You can start using it right out of the box without any setup.
Does the CvvStar AI Inference Server — 4× L4 24GB come with a warranty?
Yes. Every CvvStar product includes a 3-year international warranty covering manufacturing defects. Repairs and replacements are handled in-house by our engineers.
Is the CvvStar AI Inference Server — 4× L4 24GB in stock?
Yes, it's currently in stock and ready to ship. Order before 4 PM and we dispatch the same business day.
What is the return policy for the CvvStar AI Inference Server — 4× L4 24GB?
We offer a 30-day free return policy. If you are not completely satisfied, you can return the item within 30 days of delivery for a full refund. Return shipping is free.

You May Also Like

Added to cart