AnsweredAssumed Answered

Error 52 Invalid exchange on initial node/cluster disksetup

Question asked by wilcosprey on Dec 28, 2014
Latest reply on Dec 29, 2014 by wilcosprey
Trying to setup a small two node cluster.

I'm getting the below error "ERROR Error 52, Invalid exchange." when running disksetup on one of the nodes. The device is a single unpartitioned unformatted 1.5TB drive.

Each machine has a single disk for mapr. OS is on two separate drives, a 240gb ssd containing boot and root, and a 1TB hdd containing /opt, /var, /tmp, /home and swap. disksetup ran successfully on one of the machines but not the other.

There is no lvm or raid.

Can anyone help me out?

From /opt/mapr/logs/disksetup.0.log:

    2014-12-28 01:45:35,482 25224 InitLogging:128 INFO
    
    ***** Starting disksetup: PID 25224 *****
    
    2014-12-28 01:45:35,482 25224 :1240 INFO argv: ['/opt/mapr/server/disksetup', '-F', './disks.txt']
    2014-12-28 01:45:35,482 25224 :1241 INFO Options:
    Using -F force option
    
    2014-12-28 01:45:35,482 25224 LoadDiskTab:459 INFO No disktab file: /opt/mapr/conf/disktab
    2014-12-28 01:45:35,482 25224 LoadInputFile:480 INFO Start parsing input file: ./disks.txt
    2014-12-28 01:45:35,483 25224 LoadInputFile:484 INFO /dev/sdc
    
    2014-12-28 01:45:35,483 25224 LoadInputFile:509 INFO Loaded disks:
    2014-12-28 01:45:35,483 25224 LoadInputFile:511 INFO ([], 0, ['/dev/sdc'], 1, '/dev/sdc')
    2014-12-28 01:45:35,483 25224 GetMfsUp:1001 INFO Lookup for : /opt/mapr/conf/mapr-clusters.conf
    2014-12-28 01:45:35,483 25224 RunCmd:197 INFO mapr-mfs status:
    /etc/init.d/mapr-mfs status
    2014-12-28 01:45:35,563 25224 RunCmd:200 ERROR rc=3
    2014-12-28 01:45:35,563 25224 RunCmd:201 ERROR mapr-mfs.service - LSB: Start MapR services
       Loaded: loaded (/etc/rc.d/init.d/mapr-mfs)
       Active: inactive (dead) since Sun 2014-12-28 01:32:46 EST; 12min ago
      Process: 25114 ExecStop=/etc/rc.d/init.d/mapr-mfs stop (code=exited, status=0/SUCCESS)
      Process: 24997 ExecStart=/etc/rc.d/init.d/mapr-mfs start (code=exited, status=0/SUCCESS)
    
    Dec 28 01:32:36 barry mapr-mfs[24997]: correct memory settings, fileserver should be started using:
    Dec 28 01:32:36 barry mapr-mfs[24997]: maprcli node services -fileserver start -nodes
    Dec 28 01:32:36 barry mapr-mfs[24997]: INFO: Fileserver not configured for MapR-DB
    Dec 28 01:32:36 barry runuser[25043]: pam_limits(runuser:session): unknown limit item 'renice'
    Dec 28 01:32:36 barry runuser[25043]: pam_unix(runuser:session): session opened for user mapr by (uid=0)
    Dec 28 01:32:36 barry runuser[25043]: pam_unix(runuser:session): session closed for user mapr
    Dec 28 01:32:36 barry systemd[1]: Started LSB: Start MapR services.
    Dec 28 01:32:42 barry systemd[1]: Stopping LSB: Start MapR services...
    Dec 28 01:32:42 barry mapr-mfs[25114]: Waiting up to 30 seconds ...
    Dec 28 01:32:46 barry systemd[1]: Stopped LSB: Start MapR services.
    2014-12-28 01:45:35,564 25224 RunCmd:205 INFO mapr-mfs status tried. err 3
    2014-12-28 01:45:35,564 25224 RunCmd:197 INFO Fileserver start:
    /etc/init.d/mapr-mfs start
    2014-12-28 01:45:36,524 25224 RunCmd:197 INFO Disk list -v :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list -v
    2014-12-28 01:45:37,092 25224 LogCurrentInfo:957 INFO start setup Trying to capture debug info, following errors can be ignored
    
    2014-12-28 01:45:37,092 25224 RunCmd:197 INFO Disk list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list
    2014-12-28 01:45:37,108 25224 LogCurrentInfo:962 INFO ListDisks resp: status 0 count=0
    2014-12-28 01:45:37,109 25224 RunCmd:197 INFO DiskGroup list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  dg list
    2014-12-28 01:45:37,126 25224 LogCurrentInfo:967 INFO No. of DGs (0)
    
    2014-12-28 01:45:37,127 25224 RunCmd:197 INFO sp list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  sp list
    2014-12-28 01:45:37,145 25224 LogCurrentInfo:972 INFO 2014-12-28 01:45:37,1436 ERROR Global mrconfig.cc:544 No SP on this disk
    
    ListSPs resp: status 0:0
    2014-12-28 01:45:37,145 25224 LogCurrentInfo:974 INFO
    Done capturing debug info
    
    
    2014-12-28 01:45:37,146 25224 AddUdevRules:753 INFO Fixing udev rules
    2014-12-28 01:45:37,146 25224 AddUdevRules:760 INFO old udev rules:
    KERNEL=="sdc", GROUP="mapr", MODE="0660"
    
    2014-12-28 01:45:37,147 25224 BackupUdevRules:686 INFO /tmp/99-mapr-disk.rules.bak.25224 created. Contents:
    
    2014-12-28 01:45:37,147 25224 UpdateUdevRules:793 INFO Update udev rules
    KERNEL=="sdc", GROUP="mapr", MODE="0660"
    KERNEL=="sdc", GROUP="mapr", MODE="0660"
    
    2014-12-28 01:45:37,147 25224 RunCmd:197 INFO UpdateUdevRules:
    /bin/mv /tmp/99-mapr-disk.rules.25224 /lib/udev/rules.d/99-mapr-disk.rules
    2014-12-28 01:45:37,156 25224 RunCmd:197 INFO UpdateUdevRules:
    /sbin/udevadm control --reload-rules
    2014-12-28 01:45:37,175 25224 RunCmd:197 INFO Change mode: chmod g+rw /dev/sdc:
    chmod g+rw /dev/sdc
    2014-12-28 01:45:37,181 25224 RunCmd:197 INFO Change group /dev/sdc:
    chgrp mapr /dev/sdc
    2014-12-28 01:45:37,188 25224 RunCmd:197 INFO Disk init /dev/sdc:
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk init  -F /dev/sdc
    2014-12-28 01:45:37,212 25224 RunCmd:197 INFO Disk load /dev/sdc:
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk load /dev/sdc
    2014-12-28 01:45:38,250 25224 RunCmd:200 ERROR rc=52
    2014-12-28 01:45:38,250 25224 RunCmd:201 ERROR 2014-12-28 01:45:38,2484 ERROR Global mrconfig.cc:3762 LoadDisk failed Invalid exchange.(52).
    2014-12-28 01:45:38,251 25224 AbortWithError:192 ERROR Error 52, Invalid exchange. Disk load /dev/sdc['  File "/opt/mapr/server/disksetup", line 1253, in \n    RunDiskSetup();\n', '  File "/opt/mapr/server/disksetup", line 1136, in RunDiskSetup\n    InitAllDisks(force);\n', '  File "/opt/mapr/server/disksetup", line 555, in InitAllDisks\n    disk.InitDevices(forceOption);\n', '  File "/opt/mapr/server/disksetup", line 430, in InitDevices\n    LoadDisk(dev);\n', '  File "/opt/mapr/server/disksetup", line 307, in LoadDisk\n    return RunCmd(cmd, msg);\n', '  File "/opt/mapr/server/disksetup", line 209, in RunCmd\n    AbortWithError(rc, msg);\n', '  File "/opt/mapr/server/disksetup", line 190, in AbortWithError\n    stack_trace = traceback.format_stack(frame)\n']
    2014-12-28 01:45:38,252 25224 LogCurrentInfo:957 INFO Abort Trying to capture debug info, following errors can be ignored
    
    2014-12-28 01:45:38,252 25224 RunCmd:197 INFO Disk list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  disk list
    2014-12-28 01:45:39,271 25224 LogCurrentInfo:962 INFO ListDisks resp: status 0 count=0
    2014-12-28 01:45:39,272 25224 RunCmd:197 INFO DiskGroup list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  dg list
    2014-12-28 01:45:42,295 25224 LogCurrentInfo:967 INFO No. of DGs (0)
    
    2014-12-28 01:45:42,296 25224 RunCmd:197 INFO sp list :
    /opt/mapr/server/mrconfig -h 127.0.0.1 -p 5660  sp list
    2014-12-28 01:45:42,315 25224 LogCurrentInfo:972 INFO 2014-12-28 01:45:42,3136 ERROR Global mrconfig.cc:544 No SP on this disk
    
    ListSPs resp: status 0:0
    2014-12-28 01:45:42,315 25224 LogCurrentInfo:974 INFO
    Done capturing debug info
    
    
    2014-12-28 01:45:42,316 25224 RestoreUdevRules:694 INFO Udev restoration not required.
    2014-12-28 01:45:42,316 25224 RunCmd:197 INFO Fileserver stop:
    /etc/init.d/mapr-mfs stop
    2014-12-28 01:45:46,480 25224 ExitDiskSetup:160 ERROR Error 52, Invalid exchange. Disk load /dev/sdc['  File "/opt/mapr/server/disksetup", line 1253, in \n    RunDiskSetup();\n', '  File "/opt/mapr/server/disksetup", line 1136, in RunDiskSetup\n    InitAllDisks(force);\n', '  File "/opt/mapr/server/disksetup", line 555, in InitAllDisks\n    disk.InitDevices(forceOption);\n', '  File "/opt/mapr/server/disksetup", line 430, in InitDevices\n    LoadDisk(dev);\n', '  File "/opt/mapr/server/disksetup", line 307, in LoadDisk\n    return RunCmd(cmd, msg);\n', '  File "/opt/mapr/server/disksetup", line 209, in RunCmd\n    AbortWithError(rc, msg);\n', '  File "/opt/mapr/server/disksetup", line 190, in AbortWithError\n    stack_trace = traceback.format_stack(frame)\n']



Outcomes