Questions tagged [nvme]
The nvme tag has no usage guidance.
115
questions
0
votes
0
answers
10
views
How to format NVMe drive in Linux suitable for raid 1 and lvm on xen Host
I want to create a software raid on two identical SSDs
How do I create partitions and format them optimal?
lsblk
nvme0n1 259:0 0 953.9G 0 disk
nvme1n1 259:1 0 953.9G 0 ...
- 2,499
-2
votes
0
answers
36
views
Dell PowerEdge R760 24 NVMe Passive Drives
I would like to buy a PowerEdge R760 and fill it up with 24 NVMe 2.5" U.3 7.68 TB Micron disks. I have asked repeadly Dell to clarify the setup but they keep not answering.
Does anybody know what ...
-1
votes
0
answers
35
views
Software Mirror RAID1 using NVMe SSDs - Hardware Considerations for Reliability and Durability [closed]
I am planning to use Windows Storage Spaces to create a 2-way mirror volume (i.e. Software RAID-1) out of 2 NVMe SSDs, with the most important factor being reliability and data redundancy (performance ...
- 105
0
votes
1
answer
47
views
SSD Configuration choices for a 2-Way-Mirror Software RAID
I want data redundancy for my SSDs, and so would likely be using a software RAID like Windows Storage Spaces in a simple, fully-provisioned 2-way mirror configuration.
To minimize the risk of both ...
- 105
2
votes
2
answers
506
views
Install an NVMe SSD on a Dell Precision 5820 tower
I have a Dell Precision 5820 tower that came with 2 NVMe SSD disks on the FlexBay (the front compartment). I have been talking to Technical Support in my country (Spain) to find out how to install a ...
- 460
8
votes
3
answers
823
views
Unexpected poor performance with NVMe drives on an X9DR3-F
I am experiencing what seems like uncharacteristically low performance from an NVMe SSD stripe in a server. The hardware is as follows:
Motherboard: X9DR3-F
CPU: Dual E5-2650v2
RAM: 128GB DDR3-1333 ...
- 379
9
votes
1
answer
521
views
Understanding ZFS NVMe benchmarks with FIO
I'm trying to benchmark an all-NVMe ZFS disk array. I'm familiar with extremely fast benchmark results, with very little disk activity due to efficient ZFS caching. I ran into the reverse: massive ...
- 167
4
votes
1
answer
244
views
pacemaker agent nvmet-subsystem missing
I tried to follow the drbd Howto "Highly Available NVMe Over Fabrics (NVMe-oF) on RHEL 9", but run into the error
`Error: Unable to find agent 'nvmet-subsystem', try specifying its full name`...
- 41
2
votes
2
answers
818
views
How is Hardware RAID for NVME drives configured on SuperMicro?
I've purchased as x13sae motherboard from supermicro which is advertised as
M.2 Interface: 3 PCIe 4.0 x4 (RAID 0, 1, 5) M.2 Form Factor: 2280 M.2 Key: M-Key
I have two NVME dries in my m.2 ports. I ...
- 2,393
4
votes
2
answers
811
views
How does hardware RAID handle firmware updates for the underlying drives?
My SuperMicro X13SAE has hardware raid for the three m.2 NVME drives that it supports. My question is how does it handle firmware updates for these drives? If the drives aren't being exposed to the ...
- 2,393
1
vote
0
answers
173
views
RAID-5 read speed is very slow
I have windows 11 pro for workstation and use 2 RAID-5 volumes for storage (nvme group and ssd group). The read speed for the nvme group is around 2220 MB/s and the write speed is around 170 MB/s. SSD ...
0
votes
0
answers
181
views
LVM Thin pool performance with NVMe
I have 24 Samsung PM1733 7.68 TB and a server platform Gigabyte R282-Z94 with 2x 7702 64cores AMD EPYC. OS: Oracle Linux 8.6, 5.4.17-2136.311.6.el8uek.x86_64
I need this server for testing so I have ...
- 89
-1
votes
1
answer
108
views
How do I resize the filesystem on a RAID0 array?
My server consists of 2x512GB and 1x3.5TB disks.
root@bb2 ~ # lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
nvme0n1 259:0 0 476.9G 0 disk
├─nvme0n1p1 259:3 0 10.7G 0 part
│ └─...
- 99
1
vote
1
answer
437
views
Booting specifics on NVMe
I have a problem with transferring my OS from SATA SSD to PCIe NVMe and maybe someone can give me more ideas to solve the next problem.
The hardware is HPE MicroServer Gen8 running Windows Server 2022....
- 11
0
votes
0
answers
282
views
changing queue parameter nr_request on NVMe dev
We would like to use NVMes (SAMSUNG MZ1LB1T9HALS-00007) as a cache-tier in a Ceph System (17.2.0). The problem is that the stored data has a lot of small files and if hot-tiering is set to ~70% on the ...
- 101
2
votes
2
answers
333
views
How to bind spdk driver to NVMe device if root filesystem is mounted there?
I am trying to use SPDK in Ubuntu 20.04 (Linux kernel 5.4.0) to run storage applications. My NVMe SSD is allocated as below:
$ lsblk
...
nvme0n1 259:1 0 1.5T 0 disk
├─nvme0n1p1 ...
- 144
1
vote
0
answers
161
views
How to add to excludes alerts on smartmontool
I faced with problem and hope for your help.
Started getting notifications from smart on Debian 10 server:
Device: /dev/nvme1, Critical Warning (0x04): Reliability
Found that this alert causing ...
- 11
1
vote
1
answer
264
views
Erratic SMART readings on one member of a RAID 1 array
I am managing a server that uses 2 nvme ssds on RAID 1 connectivity.
At once point I lost access to one of the 2 and got my normal raid array degraded mails from mdadm.
So I asked from the hosting ...
- 11
0
votes
0
answers
36
views
Does interface bandwidth and/or interface type (SATA/NVME) affect IO and Random 4KB RW performance
TLDR: The advertised IOPS of NVME drives is leaps above any SATA SSDs, but how much of this is due to limitations of the:
Interface (SATA/NVME)
Interface Bandwidth (PCIE Gen 4, Gen 3, SATA 3, SATA 2)
...
1
vote
1
answer
151
views
Why does `hdparm -t` take so long to produce accurate results on my EC2 instance?
I'm profiling a data-processing program that I wrote and I want to understand the theoretical throughput of the machine I'm on. Specifically, I want to measure what disk read speed my g4dn EC2 ...
- 121
1
vote
1
answer
285
views
Strange IO activity
I have some strange IO activity on a server and I can't figure our where it's coming from.
To provide some background, I had to replace an NVMe (Samsung PM81) from a server due to wear. I didn't ...
0
votes
0
answers
493
views
Extend the root partition
We need to extend the root (nvme0n1p1) partition that is adjacent to the 2nd SWAP (nvme0n1p2) partition that is adjacent to the third (nvme0n1p3) LVM2 partition that has 2 volume groups in ext4 format ...
2
votes
1
answer
695
views
How to blink or identify NVMe drives connected to an LSI 9500 tri-mode controller
we have the following setup in Supermicro server:
LSI 9400 -> expander -> 10 x HDD
LSI 9500 -> expander -> 2 x NVMe
|------------| |-----------|
| LSI 9400 |...
- 205
0
votes
0
answers
181
views
ZoL+FIO Randwrite nvme bs=8k@32io = 148MiB/s?
Sorry for the title, but it's very short summary of BS that I'm looking into. Situation
I'm using ZoL 2.1.5 (from jonathonf's ppa) on Ubuntu (tried 20.04&22.04)
I have following NVMe disk
...
0
votes
0
answers
1k
views
How does RAID0 affect IOPS performance for NVMe SSDs?
I have an application which needs to read large amounts of small and randomly distributed entries from storage. To improve the performance I am considering to install a specialized hardware RAID ...
- 135
1
vote
0
answers
580
views
Mirror Accelerated Parity / NVMe / ReFs / Fast-Tier Issues
I'm currently building a lab server with some cheapish hardware. 2 NVMe SSDs, bunch of 3.5 HDDs. After creating a Tiered Storage (NVMe-Mirror & HDD-parity), formating it with ReFS, everything ...
- 164
0
votes
1
answer
193
views
In NVMe, what is the difference between a reserved log and an unsupported log?
I'm reading through the NVMe specification. On page 237 it says the following for get-log return value 0x09:
Invalid Log Page: The log page indicated is invalid or not supported.
This error condition ...
- 1,068
0
votes
0
answers
226
views
centos7.9 mdadm raid0's performance which is only 50% of centos8 mdadm raid0
I use the same PC and same NVMe SSDs do the raid performance test on different OS. The steps are as follows:
mdadm -C -v /dev/md0 -l0 -n4 /dev/nvme[0123]n1
mkfs.xfs /dev/md0
mount -o discard /dev/md0 ...
0
votes
1
answer
2k
views
Google Cloud Platform instance creation failure (Invalid value for field 'resource.disks[1].initializeParams.diskSizeGb')
I'm trying to create an instance using GCP. The followings are the specifications (the rest of the settings are set as default):
Region: us-west1-b
GPU type: NVIDIA Tesla V100
Number of GPUs: 1
Series:...
google-cloud-platform
-1
votes
1
answer
180
views
SSD IOPS inquire
I have question about IOPS
For example is there difference in IOPS if the SSD was ( sata 2.5 or M.2 sata or M.2 M-key nvme )
i know
sata interface = 600MB
M.2 sata = 600MB
m.2 M-Key nvme = 2000MB
But ...
- 1
1
vote
1
answer
1k
views
NVMe SSD poor writing performance on Debian 10
I just went for some disk performance tests on my DIY NAS and noticed some very poor performace results with my NVME disk writes !
My NAS runs Debian 10 with this config :
ASROCK X470D4U with Ryzen 5 ...
- 23
1
vote
1
answer
487
views
NVMe parallel writes
I'm trying to understand better how writing to NVMe can be optimized.
I have a process which writes a large amount of data to disk (~100 gb) in one batch job. The data is spread across 100s of files.
...
- 11
1
vote
2
answers
688
views
AWS i3en.3xlarge really low iops
I just launched a new instance ec2 instance of type i3en.3xlarge. Operating system is Ubuntu. I mounted the NVMe Instance store but every speed test I run is incredible low at around 7k iops. What am ...
0
votes
1
answer
350
views
Does the Dell PowerEdge R240 support booting from M.2 NVMe drives?
Did anybody try whether the Dell PowerEdge R240 (or the 14th generation in general) supports booting from M.2 NVMe disks inserted through some (non-Dell) PCIe-M.2-adapter card? Dells manual doesn't ...
- 242
2
votes
1
answer
243
views
Intel S2600JF server: Processor PCIe Link Speed menu in the BIOS is missing
i have a Intel 4 node server with S2600 JF motherboard per node (older, DDR3 RAM, E5-2600 v1 and v2).
I want to insert a NVMe pcie card (with two drives) that requires bifurcation.
Based on the ...
- 168
0
votes
0
answers
2k
views
PCI NVMe mdadm RAID1 performance too slow
I know this has been discussed multiple times but I have not found any solution so far that worked so posting here hoping there is some solutions in Dec 2021…
I have a Dell R640 server with dual Xeon ...
3
votes
2
answers
3k
views
Health Tests on NVMe
On the servers I have, with HDD or SSD, I have a cron that periodically runs:
/usr/sbin/smartctl --test=short/long /dev/sd1
(for each disk)
While it runs, it just looks at the output of /usr/sbin/...
- 583
5
votes
0
answers
736
views
AWS: Can't mount my restored volume (EBS snapshot)
I restored an EBS volume from AWS Backup and attached it to a new EC2 instance. When I lsblk I can see it under the name /dev/nvme1n1.
More specifically the output of lsblk is:
NAME MAJ:MIN RM ...
- 147
0
votes
1
answer
653
views
Can we prevent Windows from marking NVMe drives as removable?
I've noticed recently that when adding NVMe drives to Windows, it has a tendency to mark them as removable. I think this is more likely on "enterprise" NVMe SSDs, at least in my experience. ...
1
vote
1
answer
516
views
Show free SSD space after TRIM / UNMAP / Deallocate?
For a hard drive supporting ATA TRIM, SCSI UNMAP, or NVMe Deallocate, is it possible to report on the amount of unallocated space?
For example, we take a 1TB drive, then write 500GB data to it, then ...
- 483
0
votes
1
answer
2k
views
How do I maximize nvme raid0(md) performance (in linux)?
Nvme raid0 read(and write) performance is sometimes worse than the performance of one individual underlying drive.
hdparm -t /dev/md0 :
Timing buffered disk reads: 7054 MB in 3.00 seconds = ...
- 41
6
votes
3
answers
2k
views
Very slow write speed (NVME drive) on 10G network
Setting up an experimental lab cluster, the write speed for data received via 10G fiber connection is 10% of the local write speeds.
Testing transfer speed between two identical machines; iperf3 shows ...
- 191
0
votes
0
answers
88
views
Single-disk array full: how to add a spare disk without losing data?
So I rent this server from Hetzner and it was labeled as 2x512gb nvme ssd. Indeed, the server contains two 512 gb nvme ssd but (my fault) I noticed only later that they were in some sort of software ...
- 105
6
votes
3
answers
979
views
MongoDB on NVMe in production
I'm setting up my db production environment and I have some questions. The server has two NVMe disks, but they cannot be used in the hardware RAID controller. Do I need RAID with NVMe?
Would it be ...
- 163
1
vote
1
answer
1k
views
Windows storage spaces tiered storage not using nvme drive?
I'm trying to run an Ethereum full node (geth v1.10) with archiving for big data analysis.
The storage requirements are expected to be 8TB after being fully sync'd.
I have a Synology NAS that is ...
1
vote
1
answer
639
views
Interpreting SMART Logs of Newly Installed NVMe RAID0 Crashing Everyday
An Ubuntu 20.04 system has been stable for a year until a 2nd and 3rd NVMe drive is installed on the motherboard to form a 2x1TB RAID0 array. Ever since then, there is huge amount of IO load on this ...
- 1,459
5
votes
1
answer
481
views
Are my drives being utilized equally with Linux Software RAID 0 array?
I have four NVMe drives in a RAID 0 configuration.
I am attempting to determine how many IOPS the array is handling.
When I run iostat, it appears that one drive is handling more IO than the other ...
4
votes
3
answers
4k
views
How can I override IRQ affinity for NVME devices
I am trying to move all interrupts over to cores 0-3 to keep the rest of my cores free for high speed, low latency virtualization.
I wrote a quick script to set IRQ affinity to 0-3:
#!/bin/bash
while ...
- 1,138
3
votes
2
answers
3k
views
Dell R630 supported PCIe to NVMe (m.2) adapter and drive?
I can't seem to find any information anywhere about supported PCIe to NVMe (m.2) adapter and a brand of drive that will also work.
I am aware third party adapters and drives tend to work with various ...
user609425
1
vote
0
answers
115
views
Read data off Apple NGFF M2
I have one of those propietary NGFF M2 SSDs found in older Macbooks. I bought a converter which is supposed to convert it to a standard NVMe. When I plug it in my Linux box only sees it as a SCSI ...
- 541