• Contenu
• Openstack
  • Objectifs
  • Liens
  • Liens Externes
  • Bugs
  • Ressources
  • Reunions
    • lundi 20140421
    • vendredi 20140425
    • mardi 20140902

Openstack¶

Objectifs¶

Monter un cluster openstack a tetaneutral.net en remplacement de ganeti (h1/4/5/6) + libvirt (n7).

Liens¶

• Openstack Installation TTNN
• Openstack Management TTNN
• Openstack Setup VM pas dans openstack
• Ceph
• Ceph-Sharing-Disk

Liens Externes¶

• https://en.wikipedia.org/wiki/OpenStack
• http://opensource.com/business/14/5/new-openstack-tutorials
• http://opensource.com/business/14/11/8-new-tips-getting-things-done-openstack
• Dave Neary http://fr.slideshare.net/nearyd/neutron-open-vswt et http://www.youtube.com/watch?v=afImoFeuDnY
• https://www.openstack.org/summit/openstack-summit-hong-kong-2013/session-videos/presentation/how-to-write-a-neutron-plugin-if-you-really-need-to et http://www.slideshare.net/salv_orlando/how-to-write-a-neutron-plugin-if-you-really-need-to

Bugs¶

• pb xfs TODO
• pb btrfs TODO
• vlan cassés OVS ixgbe en 3.16 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=763428
• nova perd des ports reseaux https://bugs.launchpad.net/nova/+bug/1323658
• ceph vs os-prober http://tracker.ceph.com/issues/9860

Ressources¶

Ressources en place :

1. g1 (ex bm0402) Q87M vPro i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 6x SATA 3Gb + 2X SSD 840 EVO 1TB http://www.asrock.com/mb/Intel/Q87M%20vPro/?cat=Specifications
2. g2 (ex bm0403) Q87M vPro i7-4770 32 GB FSF France 2x Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB
3. g3 (ex h8) Intel DQ67OW i5-2500 32 GB (ex velizy) INTEL SSDSC2CT060A3 60GB + ST2000DL004 2 TB + Samsung SSD 840 EVO 250GB http://ark.intel.com/products/51999/Intel-Desktop-Board-DQ67OW

Ressources dispo :

1. n7 PowerEdge R310 rackable 32 GB 4x SATA http://www.dell.com/downloads/emea/products/R310_spec_sheet.pdf 3x ST31000528AS 7200.12 1TB (1 de cassé)
2. STRI rackable 32 GB 1U SC813MTQ-350CBK - PWS-351-1H - 4x Hot-swap 3.5" SAS/SATA X9SCL-F 4xDDR3 UDIMM 8GB KVR1333D3E9S/8G xeon E3-1230V2 3x3TB WD3000FYYZ RE 7200rpm 2x (x8) PCI-E 3.0in x8 slots and 1x (x4) PCI-E 2.0 in x8 slot 2.0 in x8 slot 1x full-height, half-length PCI expansion slot (Riser Card Required) http://www.supermicro.com/products/motherboard/Xeon/C202_C204/X9SCL-F.cfm http://www.supermicro.com/manuals/chassis/1U/SC813.pdf

1. h1 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2M040G2GC 40GB ST2000DL003 2TB WDC WD20EARS 2TB perso guerby
2. h4 P8H67-M EVO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CW080G3 80GB WDC WD20EARS 2TB 4xSATA 3Gb 2xSATA 6Gb 1x eSATA perso guerby http://www.asus.com/Motherboards/P8H67M_EVO/specifications/
3. h5 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3 40GB ST2000DM001 2TB 4xSATA 3Gb 2xSATA 6Gb http://www.asus.com/Motherboards/P8H67M_PRO/specifications/
4. h6 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3 40GB ST2000DL004 2TB

1. z2-4 P8H67-M PRO i7-2600 16GB upgradable 32 GB WDC WD4001FAEX 4 TB FSF France
2. z2-9 GA-890GPA-UD3H AMD Phenom(tm) II X6 1055T 16GB pas upgradable WDC WD20EARS 2 TB INTEL SSDSC2MH250A2 250 GB INTEL SSDSC2MH250A2 250 GB 6x SATA 6Gb 2x SATA 3Gb FSF France http://www.gigabyte.com/products/product-page.aspx?pid=3516#sp

1. xeon S1200BTL E3-1230 8GB upgradable a 32 GB INTEL SSDSC2CW120A3 120GB 6x SATA perso guerby http://ark.intel.com/products/53557/intel-server-board-s1200btl
2. lapaillasse.org GA-B75M-D3H i3-3220 perso julien 24 GB upgradable 32 GB + TODO 5 disques http://www.gigabyte.com/products/product-page.aspx?pid=4150#sp
3. pc2 DQ67SW i5-2500 16GB upgradable 32 GB perso guerby http://ark.intel.com/products/51997/intel-desktop-board-dq67sw

Stock ddur

1. 1x Seagate 3To SATA ST3000DM001 7200 rpm ttnn
2. 1x WD Blue WD10EZEX 1 TB 7200rpm gael mugen
3. 2x Western Digital Caviar Black 7200rpm WD1002FAEX 1 TB lapaillasse
4. 1x Hitachi Deskstar 7K1000.B 7200rpm 1 TB lapaillasse
5. 1x WD10EFRX 5400rpm 1 TB lapaillasse
6. 1x WD30EFRX 5400rpm 3 TB lapaillasse
7. 1x 3 TB guerby
8. 1x SSD samsung 830 512 GB guerby
9. TODO PC mutu Yannick ?
10. TODO INSA ?
11. perso autre ?

Total 5*32 + 1*24 + 7*16 + 1*8 = 304 GB upgradable 13*32 + 1*16 = 416 GB

Autres

1. chaussette H77MA-G43 MS-7756 i3-3220 4GB RAM = 2x2 GB upgradable a 32 GB 2x1.5 TB 2x SATA6Gb + 4 x SATA3Gb http://www.msi.com/product/mb/H77MAG43.html#/?div=Basic
2. lesplanade.org B75-D3V G620T 16GB RAM upgradable 32 GB 500GB disque 1xSATA6Gb 4x SATA3Gb 1xmSATA http://www.gigabyte.com/products/product-page.aspx?pid=4149#sp
3. h7 Q87M vPro i5-4570 8GB upgradable a 32GB SSD Samsung_SSD_840_PRO_Series_S1ANNSAF106674W 6x SATA 3Gb http://www.asrock.com/mb/Intel/Q87M%20vPro/

lapaillasse

disque_dur WESTERN DIGITAL Caviar Red - 3 To - SATA 6Go/s  - 64 Mo cache - disque dur spécial pour NAS 
disque_dur WESTERN DIGITAL Caviar Green - 1 To - SATA   6Go/s - 64 Mo Cache WD10EZRX 
disque_dur WESTERN DIGITAL Caviar Red - 1 To - SATA 6Gos   - 64 Mo cache - disque dur spécial pour NAS 
processeur INTEL Core i3-3220 3.30GHz 3Mo Cache Socket    LGA1155 Graphics HD2500 35W BX80637I33220 |    BX80637I33220 
memoire_DDR3 KINGSTON Hyper X Blu Red Serie 8G (1x8Go)   PC12800 1600MHz CL10 | KHX16C10B1R/8 3x
carte_mere GIGABYTE GA-B75M-D3H | Chipset Intel B75 -    Socket 1155 - DDR3 - 2x PCIE 16X (dont 1x 3.0) - 1x SATA3 -    USB 3.0 - HDMI/DVI/VGA - mATX 

Uses cases

1. Je veux bien filer mes disques a installer sur d'autres machines mais je veux rester seul root sur mes machines physiques, je chiffrerai donc le stockage distant que j'utilise, possible ?
2. Je veux bien partager des disques de ma machine mais je veux rester seul root sur mes machines physiques, possible ?
3. Autre ?

Reunions¶

lundi 20140421¶

midi Toulouse centre a la belle verte http://www.labellevertebio.com/

1. Loic
2. Elie
3. Laurent

discussion droits et ceph :

• http://ceph.com/docs/master/rados/operations/auth-intro/#cephx-limitations
• http://ceph.com/docs/master/rbd/rbd-ko/
• rados messages https://github.com/ceph/ceph/tree/master/src/messages
• rados messenger https://github.com/ceph/ceph/tree/master/src/msg
• Public access to RBD http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/019017.html
• Sharing hard drives with Ceph http://dachary.org/?p=2930
• patch par dachary pour simplifier : https://github.com/ceph/ceph/pull/1717

vendredi 20140425¶

12h30 Labege http://www.lacoteetlarete.fr/

1. Mehdi
2. Joris
3. Elie
4. Lionel
5. Laurent

• howto ubuntu http://redmine.the.re/projects/there/wiki/HOWTO_setup_OpenStack
• KVM debian rdb pb avec arm http://metadata.ftp-master.debian.org/changelogs//main/q/qemu/qemu_1.7.0+dfsg-9_changelog
• manifest enovance https://github.com/enovance/puppet-openstack-cloud
• BSD http://wiki.ceph.com/Planning/Blueprints/Emperor/Increasing_Ceph_portability

mardi 20140902¶

9h 10 tricou, mehdi et laurent

ceph osd tree
=> affiche les osd et devices
=> cat /proc/mounts pour voir ou c'est cree

ceph osd crush rule dump
=> regles

ceph osd pool get ssds min_size
=> repond ok apres min_size replica
ceph osd pool get ssds size
=> nb de replica

ceph -s
=> status du cluster
up => fonction
in => utilisé

pg = placement group

/etc/init.d/ceph stop osd 
=> simuler un arret
/etc/init.d/ceph stop osd.4
=> arret juste un disque

ceph osd set noout
ceph osd unset noout
=> desactive la replication automatique si on sait qu'on va couper une machine

rbp -p images import fichier_in fichier_dans_pool
=> ajout un pichier dans un pool ici images

rados lspools
=> liste des pools

rados -p disks ls
=> affiche les objets

ceph => osd/mon
rados => objets
rbd => block device

ceph osd dump -f json-pretty | grep ssd-cache -A39 -B1

question a loic sur les placement groups

consideration reseau /etc/ceph/ceph.conf

cluster_network = 192.168.3.0/24
# replication entre les osd

public_network = 192.168.3.0/24
mon_host = 192.168.3.101,192.168.3.102,192.168.3.103
# acces aux moniteurs + osd pour les clients

source os.conf
nova list 
nova list --fields host,networks,name
nova show VM
nova list --host g1 

neutron net-list
neutron port-list

/var/log/libvirt/livirtd.log

ovs-vsctl show
ovs-dpctl show