AnsweredAssumed Answered

odd results trying to give some partitions to MapR, on a disk that also has some LVM partitions

Question asked by kevin on Nov 6, 2012
Latest reply on Nov 14, 2012 by kevin
I have a two node mapr cluster running on Ubuntu 12.04. I'm adding another node that runs on Centos 6.3   

The Centos node is using LVM. While tricky, I carved out raw partitions for MapR. It's tricky, you have to fs downsize, lv downsize, pv downsize, then downsize the actual partition. Then create the parititions in the freed up space for MapR.

The latest Gparted 0.14.0-1 can handle the last step now, since it can resize LVM partitions Although you have to do the LVM stuff first. So while not for the faint-hearted, it is possible to free up space for MapR on a disk that is being used by LVM. (and give raw partitions to MapR)

/dev/cciss/c0d0p1 and c0d0p2 are system 

/dev/ccis/c0d0p5-7 are the new partitions I created for mapr (they are NOT lvm, they are just logical paritions in an extended partition) I had formatted them, so 6 and 7 say "Linux" below, but 5 says nothing because I tried adding it to MapR, and it probably did something to the partition.


I tried adding the disk using the dashboard/browser.

I see a couple of problems.

1) Somehow mapr thought it added /dev/c0d0p5, which doesn't exist. The correct partition name is /dev/cciss/c0d0p5
notice it's considered dead

2) The /dev/dm-0, dm-1, dm-2 are the extra names due to LVM on the system partitions, for /dev/cciss/c0d0p1-3

maprcli shouldn't list those as available for use.

3) I had tried using configure.sh to add the disks when I brought up mapr on that node (just mapr-fileserver and mapr-metrics. zookeeper and cldb are on another node). But it didn't seem to take..I used these names for the partitions to give to MapR

    /dev/cciss/c0d0p5
    /dev/cciss/c0d0p6
    /dev/cciss/c0d0p7

going to play some more. Thought I'd see if there was any feedback that could help.
The machine is a HP DL380G4, 2006 vintage. Smart Array Raid controller.

    RAID bus controller: Compaq Computer Corporation Smart Array 64xx (rev 01)




The output below is from these commands

all:

    maprcli disk list -host 127.0.0.1 -output verbose
    

system only:

    maprcli disk list -host 127.0.0.1 -output verbose  -system 1
    

mapr only:

    maprcli disk list -host 127.0.0.1 -output verbose  -system 0
                                                                   

**all**

    diskname           powerstatus  fstype       firmwareversion  mount  status  errormsg     serialnum                         vendor  hostname   totalspace  modelnum       
    /dev/cciss/c0d0                              2.58             1      0                    600508b1001fffffa008edda77720001  HP      127.0.0.1  700049      LOGICAL_VOLUME 
    /dev/cciss/c0d0p1               ext4                          1      0                                                              127.0.0.1                             
    /dev/cciss/c0d0p2               LVM2_member                   0      0                                                              127.0.0.1                             
    /dev/cciss/c0d0p3               Extended                      0      0                                                              127.0.0.1                             
    /dev/cciss/c0d0p5                                             0      0                                                              127.0.0.1                             
    /dev/cciss/c0d0p6               Linux                         0      0                                                              127.0.0.1                             
    /dev/cciss/c0d0p7               Linux                         0      0                                                              127.0.0.1                             
    /dev/dm-0                       ext4                          0      0                                                              127.0.0.1  51200                      
    /dev/dm-1                       swap                          0      0                                                              127.0.0.1  12000                      
    /dev/dm-2                       ext4                          0      0                                                              127.0.0.1  409600                     
    /dev/c0d0p5        dead         MapR-FS                       0      1       Failed_disk                                            127.0.0.1                             
    
**system only**

    diskname           fstype       firmwareversion  mount  status  serialnum                         vendor  hostname   totalspace  modelnum       
    /dev/cciss/c0d0                 2.58             1      0       600508b1001fffffa008edda77720001  HP      127.0.0.1  700049      LOGICAL_VOLUME 
    /dev/cciss/c0d0p1  ext4                          1      0                                                 127.0.0.1                             
    /dev/cciss/c0d0p2  LVM2_member                   0      0                                                 127.0.0.1                             
    /dev/dm-1          swap                          0      0                                                 127.0.0.1  12000                      
    
**mapr only**

    diskname           powerstatus  fstype    mount  status  errormsg     hostname   totalspace 
    /dev/cciss/c0d0p3               Extended  0      0                    127.0.0.1             
    /dev/cciss/c0d0p5                         0      0                    127.0.0.1             
    /dev/cciss/c0d0p6               Linux     0      0                    127.0.0.1             
    /dev/cciss/c0d0p7               Linux     0      0                    127.0.0.1             
    /dev/dm-0                       ext4      0      0                    127.0.0.1  51200      
    /dev/dm-2                       ext4      0      0                    127.0.0.1  409600     
    /dev/c0d0p5        dead         MapR-FS   0      1       Failed_disk  127.0.0.1       

Outcomes