Skip to Main Content

Hardware

Announcement

Testing banner

VdBench error number: 22; Maximum native memory allocation

User_12XFONov 30 2022

Any thoughts to what could have been the reason?
In linux environment, if PAGESIZE is 65536(64k), vdbench will fail and 4k is normal, you can check with getconf PAGESIZE command: getconf PAGESIZE
Does vdbench not apply to PAGESIZE (64k)?

Executed commands:
----------------------------------------------------------------------
I have done the following in the shared directory of linux samba.
./vdbench -f wpf-200m-smb2

/mnt/smb1/ is a shared directory

logfile:
----------------------------------------------------------------------
[vdbench50406]# ./vdbench -f wpf-200m-smb2

Copyright (c) 2000, 2016, Oracle and/or its affiliates. All rights reserved.
Vdbench distribution: vdbench50406 Wed July 20 15:49:52 MDT 2016
For documentation, see 'vdbench.pdf'.

14:10:34.407 input argument scanned: '-fwpf-200m-smb2'
14:10:34.409 input argument scanned: '-vr'
14:10:34.541 Anchor size: anchor=/mnt/smb1/vvv2/smb200m: dirs: 100; files: 60,000; bytes: 11.44
14:10:34.834 Starting slave: /home/vdbench50406/vdbench SlaveJvm -m xxx.xxx.xxx.xxx -n node1-10-221130-14.10.34.348
14:10:35.454 All slaves are now connected
14:10:39.002 Starting RD=format_for_rd1
14:10:39.275 hd1-0: anchor=/mnt/smb1/vvv2/smb200m mkdir complete.
14:10:39.476 *
14:10:39.476 *******************************************************************************************
14:10:39.476 * Slave hd1-0 aborting: open failed for /mnt/smb1/vvv2/smb200m/vdb.1_1.dir/vdb_f0003.file *
14:10:39.476 *******************************************************************************************
14:10:39.476 *
14:10:41.775
14:10:41.776 Slave hd1-0 prematurely terminated.
14:10:41.776
14:10:41.776 Slave aborted. Abort message received:
14:10:41.776 open failed for /mnt/smb1/vvv2/smb200m/vdb.1_1.dir/vdb_f0003.file
14:10:41.776
14:10:41.776 Look at file hd1-0.stdout.html for more information.
14:10:42.279
14:10:42.279 Slave hd1-0 prematurely terminated.
14:10:42.279
java.lang.RuntimeException: Slave hd1-0 prematurely terminated.
at Vdb.common.failure(common.java:335)
at Vdb.SlaveStarter.startSlave(SlaveStarter.java:198)
at Vdb.SlaveStarter.run(SlaveStarter.java:47)

stdout:
----------------------------------------------------------------------
14:10:35.899 14:10:35.898 Beginning of run setup
14:10:35.899 14:10:35.898 **********************
14:10:35.899
14:10:35.899
14:10:35.930 14:10:35.930 File '/var/log/messages.1' does not exist. Monitoring bypassed
14:10:36.010 14:10:36.009 Starting initializeFileAnchor for fsd1
14:10:36.022 14:10:36.022 Completed the creation of the directory list for /mnt/smb1/vvv2/smb200m: 100 directories.
14:10:38.121 14:10:38.120 Generated 60,000 file names; total anchor size: 11.444t (12,582,912,000,000)
14:10:38.230 14:10:38.229 Created new mmap file: /tmp/vdbench.pid604181.fsd1.mmap.0 mmap size: 91.553m
14:10:38.231 14:10:38.230 Allocating Data Validation map: 96,000,000 one-byte entries for each 131,072-byte block.
14:10:38.233 14:10:38.231 Created new DV map: fsd1 size: 12,582,912,000,000 bytes; key block size: 131072; entries: 96,000,000
14:10:38.233 14:10:38.232 During anchor creation for anchor=/mnt/smb1/vvv2/smb200m there were 100 directories and 8 files
14:10:38.233 14:10:38.232 Completed initializeFileAnchor for fsd1: 2.22
14:10:38.258 14:10:38.258 Started 8 threads for fwd=format,fsd=fsd1
14:10:38.259 14:10:38.258 Started 8 FwgThreads
14:10:38.259 14:10:38.258 Waiting for task synchronization
14:10:38.259 14:10:38.258 Requesting full garbage collection
14:10:38.259 14:10:38.259 GcTracker: cum: 4 intv: 4 ms: 65 mss: 0.00% Heap_MB max: 911 curr: 221 used: 112 free: 108
14:10:38.336 14:10:38.335 GcTracker: cum: 6 intv: 2 ms: 73 mss: 0.00% Heap_MB max: 911 curr: 221 used: 23 free: 197
14:10:38.336 14:10:38.335 task_wait_start_complete() end

<a name="_1588970020"></a><i><b>14:10:39.002 Starting RD=format_for_rd1</b></i>

14:10:39.005 14:10:39.004 task_run_all(): 9 tasks
14:10:39.273 14:10:39.272 Message to master: anchor=/mnt/smb1/vvv2/smb200m mkdir complete.
14:10:39.414 14:10:39.413 error: 22
14:10:39.414 14:10:39.413 file_open(), open /mnt/smb1/vvv2/smb200m/vdb.1_1.dir/vdb_f0003.file failed
14:10:39.414 14:10:39.414 Maximum native memory allocation: 2,097,152; Current allocation: 2,097,152
14:10:39.414 14:10:39.414
14:10:39.414 14:10:39.414 open failed for /mnt/smb1/vvv2/smb200m/vdb.1_1.dir/vdb_f0003.file
14:10:39.414 14:10:39.414
14:10:39.415 java.lang.RuntimeException: open failed for /mnt/smb1/vvv2/smb200m/vdb.1_1.dir/vdb_f0003.file
14:10:39.415 at Vdb.common.failure(common.java:335)
14:10:39.416 at Vdb.ActiveFile.openFile(ActiveFile.java:172)
14:10:39.416 at Vdb.FwgThread.openForWrite(FwgThread.java:435)
14:10:39.416 at Vdb.OpCreate.doOperation(OpCreate.java:53)
14:10:39.416 at Vdb.OpFormat.doOperation(OpFormat.java:100)
14:10:39.416 at Vdb.FwgThread.run(FwgThread.java:205)

paramfile:
----------------------------------------------------------------------
hd=default,vdbench=/home/vdbench50406,user=root,shell=ssh
hd=hd1,system=node1
#hd=hd2,system=node2

fsd=fsd1,anchor=/mnt/smb1/vvv2/smb200m,depth=1,width=100,files=600,size=200M,openflags=o_direct,shared=yes

fwd=default,xfersize=1M,fileio=random,fileselect=random,rdpct=60,threads=24

fwd=fwd1,fsd=fsd1,host=hd1
#fwd=fwd2,fsd=fsd1,host=hd2

rd=rd1,fwd=fwd*,fwdrate=max,format=restart,elapsed=120,interval=1

Comments
Post Details
Added on Nov 30 2022
0 comments
62 views