AnsweredAssumed Answered

Disksetup permissions error

Question asked by stevens on Nov 19, 2013
Latest reply on Nov 19, 2013 by stevens
I'm installing m5 on a 4 node cluster.  When running disksetup I get an error (see below).  This is the initial attempt at running disksetup. disksetup was run as root.  Any thoughts?

2013-11-19 16:53:03,1164 ERROR Global mrconfig.cc:3524 x.x.0.0:0 LoadDisk failed Permission denied.(13).
Error 13, Permission denied. Disk load /dev/sdb


The disksetup.0.log is below:

2013-11-19 16:52:58,733 5291 InitLogging:123 INFO

***** Starting disksetup: PID 5291 *****

2013-11-19 16:52:58,733 5291 <module>:1175 INFO argv: ['/opt/mapr/server/disksetup', '-F', '/tmp/disks.txt']
2013-11-19 16:52:58,734 5291 <module>:1176 INFO Options:
Using -F force option

2013-11-19 16:52:58,734 5291 SetCldbRole:933 INFO Create cid = 1 for cldb role
2013-11-19 16:52:58,734 5291 LoadDiskTab:436 INFO No disktab file: /opt/mapr/conf/disktab
2013-11-19 16:52:58,734 5291 LoadInputFile:457 INFO Start parsing input file: /tmp/disks.txt
2013-11-19 16:52:58,734 5291 LoadInputFile:461 INFO /dev/sdb
/dev/sdc
/dev/sdd
/dev/sde
/dev/sdf
/dev/sdg
/dev/sdh
/dev/sdi
/dev/sdj
/dev/sdk
/dev/sdl
/dev/sdm
/dev/sdn
/dev/sdo
/dev/sdp
/dev/sdq
/dev/sdr
/dev/sds
/dev/sdt
/dev/sdu
/dev/sdv
/dev/sdw
/dev/sdx

2013-11-19 16:52:58,734 5291 LoadInputFile:486 INFO Loaded disks:
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdb'], 1, '/dev/sdb')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdc'], 1, '/dev/sdc')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdd'], 1, '/dev/sdd')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sde'], 1, '/dev/sde')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdf'], 1, '/dev/sdf')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdg'], 1, '/dev/sdg')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdh'], 1, '/dev/sdh')
2013-11-19 16:52:58,734 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdi'], 1, '/dev/sdi')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdj'], 1, '/dev/sdj')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdk'], 1, '/dev/sdk')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdl'], 1, '/dev/sdl')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdm'], 1, '/dev/sdm')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdn'], 1, '/dev/sdn')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdo'], 1, '/dev/sdo')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdp'], 1, '/dev/sdp')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdq'], 1, '/dev/sdq')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdr'], 1, '/dev/sdr')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sds'], 1, '/dev/sds')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdt'], 1, '/dev/sdt')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdu'], 1, '/dev/sdu')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdv'], 1, '/dev/sdv')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdw'], 1, '/dev/sdw')
2013-11-19 16:52:58,735 5291 LoadInputFile:488 INFO ([], 0, ['/dev/sdx'], 1, '/dev/sdx')
2013-11-19 16:52:58,735 5291 GetMfsUp:938 INFO Lookup for : /opt/mapr/conf/mapr-clusters.conf
2013-11-19 16:52:58,736 5291 RunCmd:183 INFO mapr-mfs status:
/etc/init.d/mapr-mfs status
2013-11-19 16:52:58,814 5291 RunCmd:186 ERROR rc=3
2013-11-19 16:52:58,814 5291 RunCmd:187 ERROR mfs is stopped
2013-11-19 16:52:58,815 5291 RunCmd:191 INFO mapr-mfs status tried. err 3
2013-11-19 16:52:58,815 5291 RunCmd:183 INFO Fileserver start:
/etc/init.d/mapr-mfs start
2013-11-19 16:52:59,012 5291 RunCmd:183 INFO Disk list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list
2013-11-19 16:53:02,988 5291 LogCurrentInfo:895 INFO start setup
2013-11-19 16:53:02,988 5291 RunCmd:183 INFO Disk list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list
2013-11-19 16:53:03,000 5291 LogCurrentInfo:900 INFO ListDisks resp: status 0 count=0
2013-11-19 16:53:03,000 5291 RunCmd:183 INFO DiskGroup list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  dg list
2013-11-19 16:53:03,013 5291 LogCurrentInfo:905 INFO No. of DGs (0)

2013-11-19 16:53:03,013 5291 RunCmd:183 INFO sp list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  sp list
2013-11-19 16:53:03,027 5291 LogCurrentInfo:910 INFO 2013-11-19 16:53:03,0266 ERROR Global mrconfig.cc:546 x.x.0.0:0 No SP on this disk

ListSPs resp: status 0:0
2013-11-19 16:53:03,028 5291 RunCmd:183 INFO Change mode: chmod g+rw /dev/sdb:
chmod g+rw /dev/sdb
2013-11-19 16:53:03,032 5291 RunCmd:183 INFO Change group /dev/sdb:
chgrp mapr /dev/sdb
2013-11-19 16:53:03,037 5291 RunCmd:183 INFO Disk init /dev/sdb:
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk init  -F /dev/sdb
2013-11-19 16:53:03,102 5291 RunCmd:183 INFO Disk load /dev/sdb:
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk load /dev/sdb
2013-11-19 16:53:03,117 5291 RunCmd:186 ERROR rc=13
2013-11-19 16:53:03,118 5291 RunCmd:187 ERROR 2013-11-19 16:53:03,1164 ERROR Global mrconfig.cc:3524 x.x.0.0:0 LoadDisk failed Permission denied.(13).
2013-11-19 16:53:03,118 5291 AbortWithError:175 ERROR Error 13, Permission denied. Disk load /dev/sdb
2013-11-19 16:53:03,119 5291 AbortWithError:178 ERROR ['  File "/opt/mapr/server/disksetup", line 1188, in <module>\n    RunDiskSetup();\n', '  File "/opt/mapr/server/disksetup", line 1070, in RunDiskSetup\n    InitAllDisks(force);\n', '  File "/opt/mapr/server/disksetup", line 532, in InitAllDisks\n    disk.InitDevices(forceOption);\n', '  File "/opt/mapr/server/disksetup", line 407, in InitDevices\n    LoadDisk(dev);\n', '  File "/opt/mapr/server/disksetup", line 285, in LoadDisk\n    return RunCmd(cmd, msg);\n', '  File "/opt/mapr/server/disksetup", line 195, in RunCmd\n    AbortWithError(rc, msg);\n', '  File "/opt/mapr/server/disksetup", line 177, in AbortWithError\n    stack_trace = traceback.format_stack(frame)\n']
2013-11-19 16:53:03,119 5291 LogCurrentInfo:895 INFO Abort
2013-11-19 16:53:03,119 5291 RunCmd:183 INFO Disk list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list
2013-11-19 16:53:03,133 5291 LogCurrentInfo:900 INFO ListDisks resp: status 0 count=0
2013-11-19 16:53:03,134 5291 RunCmd:183 INFO DiskGroup list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  dg list
2013-11-19 16:53:03,147 5291 LogCurrentInfo:905 INFO No. of DGs (0)

2013-11-19 16:53:03,148 5291 RunCmd:183 INFO sp list :
/opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  sp list
2013-11-19 16:53:03,161 5291 LogCurrentInfo:910 INFO 2013-11-19 16:53:03,1606 ERROR Global mrconfig.cc:546 x.x.0.0:0 No SP on this disk

ListSPs resp: status 0:0
2013-11-19 16:53:03,162 5291 RunCmd:183 INFO Fileserver stop:
/etc/init.d/mapr-mfs stop

Outcomes