1. Home
  2. Knowledge Base
  3. CMPv2
  4. CMPv2- Creating a GPU Virtual Machine
  1. Home
  2. Knowledge Base
  3. Compute
  4. CMPv2- Creating a GPU Virtual Machine

CMPv2- Creating a GPU Virtual Machine

CloudPe KB — Creating a GPU Virtual Machine
Knowledge Base  ·  Compute
Creating a GPU Virtual Machine on CloudPe
A complete step-by-step guide to deploying a GPU-accelerated virtual machine on CloudPe — from GPU selection to a running, CUDA-ready instance.
⏱ 10–15 minutes👤 All Users📍 Mumbai (IN-WEST2)📅 CloudPe 2026
🧠
What You’ll Accomplish
This guide walks through every field of the CloudPe GPU VM creation wizard — GPU type, compute flavor, OS image, billing period, storage policy, network, security, and Cloud-Init — before clicking Create GPU VM.
Prerequisites
Ensure these are in place before you begin
🔑
Active Account
Verified account at app.cloudpe.com
💰
Billing / Credits
Sufficient balance or active billing method
📁
Project Created
At least one project in your account
🎖
GPU Quota
GPU quota approved — contact support if needed
🔐
SSH Key (Recommended)
Public key uploaded under Billing → SSH Keys
🌐
Network Available
Public or private network in your region

1
Navigate to GPU VMs
Access the GPU VM creation wizard from the sidebar
1
Open GPU VMs from the Sidebar
In the left sidebar, expand Compute and click GPU VMs. You’ll see the GPU VMs list page. Click the + Create GPU VM button at the top right, or go directly to app.cloudpe.com/dashboard/gpu-vms/create.
app.cloudpe.com/dashboard/gpu-vms
Fig 1.1 — GPU VMs section showing the + Create GPU VM button
GPU VMs vs Virtual MachinesGPU VMs are listed separately under Compute → GPU VMs — not under Virtual Machines. They follow a dedicated 5-step wizard: GPU → Flavor → Image → Billing → Configure. The GPU type you choose determines the region and available flavors automatically.

2
Select GPU Type
Choose the NVIDIA GPU accelerator for your workload
1
Review Available GPU Types
CloudPe offers 6 NVIDIA GPU types. Each card shows the GPU name, VRAM, and number of available flavors. Click a card to select it. The region is automatically assigned based on where that GPU hardware is available.
app.cloudpe.com/dashboard/gpu-vms/create — Step 1: GPU
Fig 2.1 — All 6 available NVIDIA GPU types on CloudPe
2
GPU Type Reference
GPUVRAMBest ForFlavors
NVIDIA H200141 GBLLM training, large-scale deep learning, HPC2
NVIDIA L40S48 GBAI inference, rendering, computer vision1
NVIDIA RTX6000 ADA48 GBProfessional visualisation, CAD, moderate ML1
NVIDIA RTX A500024 GBML experimentation, data science, fine-tuning1
NVIDIA L424 GBReal-time inference, video transcoding, edge AI3
NVIDIA RTX A400016 GBML prototyping, development, light inference1
⚠ Region is Determined by GPU AvailabilityYou do not choose a region manually for GPU VMs. The region is auto-assigned based on the GPU type and flavor you select. If a GPU shows 0 flavors available, all instances are currently allocated — wait for capacity or contact CloudPe support to join the waitlist.

3
Select Flavor
Choose the compute configuration — vCPU and RAM — for your GPU VM
1
Select a Flavor
Based on the GPU type you selected, available flavors are listed. Each flavor shows the vCPU count, RAM, attached region, and pricing. The GPU VRAM is the same across all flavors of the same GPU type — only the host vCPU and system RAM differ.
app.cloudpe.com/dashboard/gpu-vms/create — Step 2: Flavor
Fig 3.1 — Flavor selection for NVIDIA H200 showing 2 available configurations
2
H200 Flavor Reference
FlavorvCPURAMRegionPrice/hrPrice/mo
gpu.h200.384g48384 GBMumbai DC2 Zone B₹187.00₹1,22,859
gpu.h200.512g48512 GBMumbai DC2 Zone B₹234.17₹1,53,849
💡 GPU Memory is Fixed Per GPU TypeSelecting a higher-RAM flavor does not give you more GPU VRAM — all H200 flavors have the same 141 GB VRAM. Choose a higher-RAM flavor if your workload requires large in-memory dataset preprocessing or multiple concurrent processes running alongside GPU tasks.

4
Select Operating System
Choose a GPU-optimised image or your custom image
1
Choose from GPU Images or Custom Images
The Image step has two tabs. GPU Images contains CloudPe-managed images with NVIDIA drivers and CUDA pre-installed. Custom Images lists your own uploads and snapshots. Select Ubuntu-24.04-GPU-v2 from the GPU Images tab for new deployments.
app.cloudpe.com/dashboard/gpu-vms/create — Step 3: Image
Fig 4.1 — GPU Images tab showing Ubuntu 24.04 GPU image (Recommended)
2
Image Options
TabImageIncludesNotes
GPU ImagesUbuntu-24.04-GPU-v2NVIDIA drivers, CUDA toolkit, nvidia-smi, Python 3✅ Recommended for all workloads
Custom ImagesYour snapshots / uploadsDepends on source image⚠ Drivers may need manual install
✅ Always Use GPU Images for New DeploymentsUbuntu-24.04-GPU-v2 is pre-configured with NVIDIA drivers, CUDA toolkit, cuDNN, and Python 3 GPU support — ready to use immediately after boot. Using a Custom Image without pre-installed GPU drivers requires manual apt install nvidia-driver-535 nvidia-cuda-toolkit followed by a reboot before the GPU becomes available.

5
Select Billing Period
Choose how you want to be billed — longer periods offer better value
1
Select a Billing Period
Choose from Hourly, Monthly, Quarterly, Semi-Annual, or Annual billing. Committing to longer periods unlocks significant discounts (up to 20% off). Check the Auto-renew subscription box to renew automatically at period end.
app.cloudpe.com/dashboard/gpu-vms/create — Step 4: Billing
Fig 5.1 — Billing period selection with discount badges and full pricing estimate
2
Billing Period & Pricing (H200 · gpu.h200.384g)
PeriodTotal PriceEffective RateDiscount
Hourly₹187.00 / hr₹187.00/hr
Monthly₹1,22,859.00 / mo₹168.30/hr10% off
Quarterly₹3,63,528.00 / qtr₹165.99/hr11% off
Semi-Annual₹6,86,664.00 / 6mo₹156.77/hr16% off
Annual₹13,10,496.00 / yr₹149.60/hr20% off
3
Pricing Estimate — Monthly Bundle Breakdown
ComponentDetailsMonthly Cost
GPU Compute48 vCPU · 384 GB RAM · NVIDIA H200₹1,22,859.00
Boot Volume50 GB (default)₹223.38
Public IP1× Floating IP₹179.95
Total (Monthly, 10% off)₹1,23,262.33
⚠ GPU VMs Are Billed from Creation, Not First UseBilling starts the moment the GPU VM is created and reaches Running state — even if you have not connected yet. Use Hourly for short experiments and commit to Monthly or longer for production workloads to save up to 20%.

6
Configure Your GPU VM
Set project, name, storage, network, security, and advanced options
The final step covers all operational settings. Fields are grouped into 8 subsections below.
app.cloudpe.com/dashboard/gpu-vms/create — Step 5: Configure
Fig 6.1 — Full Configure step: project, VM name, storage policy, network, security, and Cloud-Init
1
Select Project
Choose the project where this GPU VM will be deployed. Projects control billing grouping, quota, and team access. The region (e.g. Mumbai DC2 Zone B) is shown automatically based on the flavor you selected and cannot be changed here.
Default-IN-WEST2 Zone B
IN-WEST2 Zone B  ·  0 VMs
2
VM Name
Enter a unique name for your GPU VM. Use only letters, numbers, hyphens (-), and underscores (_). The name is permanent after creation and is used in API calls and the dashboard.
✓ Good: h200-training-01, llm-inference-prod
✗ Bad: my server!, GPU VM 1 (spaces and special characters not allowed)
3
Boot Volume Size
Set the size of the root disk using the slider or by typing a value. The minimum is 30 GB for GPU images. For GPU workloads that store large model checkpoints or datasets on the boot disk, increase to 100–500 GB.
📊 Default: 50 GB  ·  Minimum: 30 GB  ·  Maximum: 10,240 GB
4
Storage Policy (NVMe Tier)
Eco NVMeBudget
Up to 15,000 IOPS · 500 MB/s
₹4.50 /GB/mo
• Erasure Coding (not replication)
• Slower recovery on failure
• Cannot migrate to Standard/Pro
Standard NVMePopular
Up to 25,000 IOPS · 1,000 MB/s
₹6.20 /GB/mo
• 3× Replication
• Upgrade to Pro (no downtime)
• Formerly: General Purpose NVMe
Pro NVMeGPU/DB
Up to 50,000 IOPS · 2,000 MB/s
₹8.00 /GB/mo
• 3× Replication
• Downgrade to Standard (no downtime)
• Best for: Databases, ERP, GPU VMs
TierMax IOPSThroughput₹/GB/moResilienceTier Change
Eco NVMe15,000500 MB/s₹4.50Erasure CodingData migration required
Standard NVMe25,0001,000 MB/s₹6.203× ReplicationUpgrade to Pro (no downtime)
Pro NVMe50,0002,000 MB/s₹8.003× ReplicationDowngrade to Standard (no downtime)
🔴 GPU VMs: Use Pro NVMe or Standard NVMeGPU workloads are highly I/O sensitive. Pro NVMe delivers up to 50,000 IOPS and 2,000 MB/s — critical for fast checkpoint saves, model loading, and dataset streaming. Eco NVMe uses Erasure Coding instead of 3× Replication, causing higher latency under GPU I/O bursts. Eco NVMe volumes cannot be migrated to Standard or Pro in-place — data copy to a new volume is required.
5
Additional Data Volumes (Optional)
Click + Add Volume to attach extra data volumes alongside the boot disk. Useful for storing large ML datasets, model weights, or checkpoints separately from the OS disk. Each additional volume can have its own size and NVMe tier.
💡 Separate Boot and Data Volumes for ML WorkloadsKeep your OS on a smaller boot volume (50–100 GB) and attach a separate data volume (500 GB–10 TB) for datasets and model checkpoints. This allows you to replace or snapshot VMs without losing training data.
6
Network Configuration
OptionDefaultDescription
Public Network✅ EnabledAssigns a public IP. Required for SSH access and internet connectivity (pulling models, packages). Billed separately as a Floating IP.
Private Network✖ DisabledAdds an internal interface for VM-to-VM communication. Enable if your GPU VM needs to talk to databases or other VMs on a private subnet.
Use + Create a new network to create a private VPC if none exists in your region.
7
Security — Root Password & SSH Key
FieldRequiredDetails
Root PasswordOptionalLeave empty to auto-generate. CloudPe generates a secure password visible in the VM details page after creation.
SSH KeyRecommendedSelect an existing key from the dropdown or click Generate to create a new one. Keys are managed in Billing & Account → SSH Keys.
✅ SSH Key is the Secure Way to Access GPU VMsFor production GPU VMs, always configure an SSH key. This allows ssh ubuntu@<public-ip> access and enables tools like VSCode Remote SSH, JupyterLab, and nvidia-smi monitoring without needing a password.
8
Advanced Options — User Data (Cloud-Init)
CloudPe pre-fills a GPU-ready Cloud-Init template that installs CUDA and Python 3 on first boot. You can extend it to auto-install your ML stack, download model weights, or start services automatically.
Default pre-filled template:
#cloud-config
packages:
  - nvidia-cuda-toolkit
  - python3-pip
Example — Extended template with PyTorch + Jupyter:
#cloud-config
packages:
  - nvidia-cuda-toolkit
  - python3-pip

runcmd:
  - pip3 install torch torchvision --index-url https://download.pytorch.org/whl/cu124
  - pip3 install jupyter transformers datasets
  - jupyter notebook --ip=0.0.0.0 --port=8888 --no-browser &
💡 Cloud-Init for Repeatable GPU EnvironmentsUse Cloud-Init to create reproducible GPU VM environments. Each new VM spins up with your full ML stack (PyTorch, TensorFlow, model downloads) installed automatically — no manual SSH commands needed. Keep Cloud-Init scripts in version control alongside your code.

7
Review & Create
Verify the Configuration Summary and launch your GPU VM
Before clicking Create GPU VM, review the full Configuration Summary. Verify GPU type, flavor, image, billing period, storage, and network settings are all correct.
📋 Configuration Summary — Example
ProjectDefault-IN-WEST2 Zone B
GPUNVIDIA H200 (141 GB VRAM)
Flavorgpu.h200.384g — 48 vCPU · 384 GB RAM
RegionMumbai DC2 Zone B (IN-WEST2)
ImageUbuntu-24.04-GPU-v2
BillingMonthly (10% off)
Storage50 GB · Pro NVMe
NetworkPublic (Floating IP)
SSH Keykube (default)
Estimated Cost₹1,23,262.33 / month (~₹187/hr)
🖥 Create GPU VM
GPU VM creation typically takes 2–5 minutes. Status changes to Running once ready.
✅ After Creation — Connect to Your GPU VMOnce the VM shows Running status, copy the Public IP from the VM details page. Connect via: ssh ubuntu@<public-ip>. Run nvidia-smi to verify the GPU is detected and check VRAM usage and driver version. The pre-installed CUDA toolkit is ready for immediate use — no additional driver installation needed.

🚀
After Your GPU VM is Running
Quick-start actions after creation
👖
SSH into VM
ssh ubuntu@<public-ip> — default user is ubuntu. Your SSH key authenticates automatically.
💻
Verify GPU
Run nvidia-smi to confirm GPU detection, check VRAM, driver version, and CUDA version.
🐍
Install ML Stack
Python 3 and pip are pre-installed. Run pip3 install torch transformers jupyter or use Cloud-Init to auto-install on next boot.
📖
Run Jupyter
Start with jupyter notebook --ip=0.0.0.0 --port=8888 and open http://<ip>:8888 in your browser.
📷
Snapshot First
Before experiments, create a snapshot from VM Details → Snapshots. This saves your configured environment.
🛑
Stop vs Delete
Subscription billing may continue even when stopped. For cost savings, delete the VM and restore from snapshot when needed.

?
Frequently Asked Questions
Common questions about GPU VM creation on CloudPe
Can I upgrade my GPU type after creation?
No — the GPU type is fixed at creation. To switch GPU types, create a new GPU VM with the desired GPU, migrate your data from a snapshot or volume, then delete the old VM.
What does “0 flavors available” mean on a GPU card?
All instances of that GPU type are currently allocated in that region. You can wait for capacity to free up, or contact CloudPe support to join the waitlist for that GPU.
Why is there no Region selection step for GPU VMs?
Unlike regular VMs, GPU VMs are placed automatically in the region where the selected GPU flavor is available. The region is shown in the flavor card and confirmed in the Configuration Summary.
How do I install NVIDIA drivers if I use a Custom Image?
Boot the VM, then run: sudo apt update && sudo apt install -y nvidia-driver-535 nvidia-cuda-toolkit. Reboot after installation and verify with nvidia-smi.
Can I run multiple GPU workloads simultaneously on one GPU VM?
Yes — a single GPU VM has one physical GPU that can run multiple CUDA processes concurrently. Use CUDA MPS (Multi-Process Service) for optimal resource sharing between processes.
What is the difference between GPU Images and Custom Images?
GPU Images are CloudPe-managed images with NVIDIA drivers, CUDA, and GPU utilities pre-installed and tested. Custom Images are your own uploads or snapshots — useful for restoring a previously configured environment.
Can I access my GPU VM without SSH using a browser console?
Yes — from the VM details page, click the Console button for a browser-based terminal. Useful if SSH is misconfigured or the public IP is temporarily unreachable.
☁ CloudPe
GPU Virtual Machines — Knowledge Base
© 2026 CloudPe / LeapSwitch Networks  ·  support@cloudpe.com
Was this article helpful?

Related Articles

Need Support?

Can't find the answer you're looking for?
Contact Support
This is a staging environment