{{>toc}}

h1. Openstack

h2. Objectifs

Monter un cluster openstack a tetaneutral.net en remplacement de ganeti (h1/4/5/6) + libvirt (n7).

h2. Liens

* [[Openstack Installation nouvelle node du cluster]]

* [[Openstack Management TTNN]]

* [[Openstack Setup VM pas dans openstack]]

* [[Openstack Installation TTNN]]

* [[Ceph]]

* [[Ceph-Sharing-Disk]]

h2. Liens Externes

* https://en.wikipedia.org/wiki/OpenStack

* https://opensource.com/resources/openstack-tutorials

* http://opensource.com/business/14/5/new-openstack-tutorials

* http://opensource.com/business/14/11/8-new-tips-getting-things-done-openstack

* Dave Neary http://fr.slideshare.net/nearyd/neutron-open-vswt et http://www.youtube.com/watch?v=afImoFeuDnY

* https://www.openstack.org/summit/openstack-summit-hong-kong-2013/session-videos/presentation/how-to-write-a-neutron-plugin-if-you-really-need-to et http://www.slideshare.net/salv_orlando/how-to-write-a-neutron-plugin-if-you-really-need-to

h2. Bugs

* pb xfs TODO

* pb btrfs TODO

* vlan cassés OVS ixgbe en 3.16 https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=763428

* nova perd des ports reseaux https://bugs.launchpad.net/nova/+bug/1323658

* ceph vs os-prober http://tracker.ceph.com/issues/9860

h2. Ressources

Ressources en place :

# g1 (ex bm0402) Q87M vPro  i7-4770 32 GB FSF France Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 6x SATA 3Gb + 2X SSD 840 EVO 1TB http://www.asrock.com/mb/Intel/Q87M%20vPro/?cat=Specifications

# g2 (ex bm0403) Q87M vPro  i7-4770 32 GB FSF France 2x Samsung SSD 840 EVO 250GB + WDC WD40EFRX 4TB 

# g3 (ex h8) Intel DQ67OW  i5-2500  32 GB (ex velizy) INTEL SSDSC2CT060A3 60GB + ST2000DL004 2 TB + Samsung SSD 840 EVO 250GB http://ark.intel.com/products/51999/Intel-Desktop-Board-DQ67OW

# n7 PowerEdge R310 Xeon X3430 rackable 32 GB 4x SATA http://www.dell.com/downloads/emea/products/R310_spec_sheet.pdf HDD 3x3 TB + SSD 250GB

# STRI rackable 32 GB 1U SC813MTQ-350CBK - PWS-351-1H - 4x Hot-swap 3.5" SAS/SATA X9SCL-F 4xDDR3 UDIMM 8GB KVR1333D3E9S/8G xeon E3-1230V2 3x3TB WD3000FYYZ RE 7200rpm 2x (x8) PCI-E 3.0in x8 slots and 1x (x4) PCI-E 2.0 in x8 slot 2.0 in x8 slot 1x full-height, half-length PCI expansion slot (Riser Card Required) http://www.supermicro.com/products/motherboard/Xeon/C202_C204/X9SCL-F.cfm http://www.supermicro.com/manuals/chassis/1U/SC813.pdf

# g4 (ex z2-4) P8H67-M PRO i7-2600 32 GB RAM WDC WD4001FAEX 4 TB FSF France

# g5 Q87M vPro i5-4570 CPU @ 3.20GHz 32 GB RAM 

Ressources dispo :

# h1 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2M040G2GC 40GB  ST2000DL003 2TB WDC WD20EARS 2TB perso guerby 

# h4 P8H67-M EVO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CW080G3  80GB WDC WD20EARS 2TB 4xSATA 3Gb 2xSATA 6Gb 1x eSATA perso guerby http://www.asus.com/Motherboards/P8H67M_EVO/specifications/

# h5 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DM001 2TB 4xSATA 3Gb 2xSATA 6Gb http://www.asus.com/Motherboards/P8H67M_PRO/specifications/

# h6 P8H67-M PRO i7-2600 16GB upgradable a 32 GB INTEL SSDSA2CT040G3  40GB  ST2000DL004 2TB

# z2-9 GA-890GPA-UD3H  AMD Phenom(tm) II X6 1055T   16GB pas upgradable WDC WD20EARS 2 TB INTEL SSDSC2MH250A2 250 GB INTEL SSDSC2MH250A2 250 GB 6x SATA 6Gb 2x SATA 3Gb FSF France http://www.gigabyte.com/products/product-page.aspx?pid=3516#sp

# xeon S1200BTL E3-1230 8GB upgradable a 32 GB INTEL SSDSC2CW120A3 120GB 6x SATA  perso guerby http://ark.intel.com/products/53557/intel-server-board-s1200btl

# lapaillasse.org GA-B75M-D3H  i3-3220 perso julien 24 GB upgradable 32 GB + TODO 5 disques http://www.gigabyte.com/products/product-page.aspx?pid=4150#sp

# pc2 DQ67SW i5-2500 16GB upgradable 32 GB perso guerby http://ark.intel.com/products/51997/intel-desktop-board-dq67sw

Stock ddur

# 1x Seagate 3To SATA ST3000DM001 7200 rpm ttnn

# 1x WD Blue WD10EZEX 1 TB 7200rpm gael mugen

# 2x  Western Digital Caviar Black 7200rpm WD1002FAEX 1 TB lapaillasse

# 1x Hitachi Deskstar 7K1000.B 7200rpm 1 TB lapaillasse

# 1x WD10EFRX 5400rpm 1 TB lapaillasse

# 1x WD30EFRX 5400rpm 3 TB lapaillasse

# 1x 3 TB guerby

# 1x SSD samsung 830 512 GB guerby

# TODO PC mutu Yannick ?

# TODO INSA ?

# perso autre ?

Total 5*32 + 1*24 + 7*16 + 1*8 = 304 GB upgradable  13*32 + 1*16 = 416 GB

Autres

# chaussette H77MA-G43 MS-7756 i3-3220 4GB RAM = 2x2 GB upgradable a 32 GB 2x1.5 TB 2x SATA6Gb + 4 x SATA3Gb http://www.msi.com/product/mb/H77MAG43.html#/?div=Basic

# lesplanade.org B75-D3V G620T 16GB RAM upgradable 32 GB 500GB disque 1xSATA6Gb 4x SATA3Gb 1xmSATA http://www.gigabyte.com/products/product-page.aspx?pid=4149#sp

# h7 Q87M vPro i5-4570 8GB upgradable a 32GB SSD Samsung_SSD_840_PRO_Series_S1ANNSAF106674W 6x SATA 3Gb   http://www.asrock.com/mb/Intel/Q87M%20vPro/

lapaillasse

<pre>

disque_dur WESTERN DIGITAL Caviar Red - 3 To - SATA 6Go/s  - 64 Mo cache - disque dur spécial pour NAS 

disque_dur WESTERN DIGITAL Caviar Green - 1 To - SATA   6Go/s - 64 Mo Cache WD10EZRX 

disque_dur WESTERN DIGITAL Caviar Red - 1 To - SATA 6Gos   - 64 Mo cache - disque dur spécial pour NAS 

processeur INTEL Core i3-3220 3.30GHz 3Mo Cache Socket    LGA1155 Graphics HD2500 35W BX80637I33220 |    BX80637I33220 

memoire_DDR3 KINGSTON Hyper X Blu Red Serie 8G (1x8Go)   PC12800 1600MHz CL10 | KHX16C10B1R/8 3x

carte_mere GIGABYTE GA-B75M-D3H | Chipset Intel B75 -    Socket 1155 - DDR3 - 2x PCIE 16X (dont 1x 3.0) - 1x SATA3 -    USB 3.0 - HDMI/DVI/VGA - mATX 

</pre>

Uses cases

# Je veux bien filer mes disques a installer sur d'autres machines mais je veux rester seul root sur mes machines physiques, je chiffrerai donc le stockage distant que j'utilise, possible ?

# Je veux bien partager des disques de ma machine mais je veux rester seul root sur mes machines physiques, possible ?

# Autre ?

h2. Reunions

h3. lundi 20140421 

midi Toulouse centre a la belle verte http://www.labellevertebio.com/

# Loic

# Elie

# Laurent

discussion droits et ceph : 

* http://ceph.com/docs/master/rados/operations/auth-intro/#cephx-limitations

* http://ceph.com/docs/master/rbd/rbd-ko/

* rados messages https://github.com/ceph/ceph/tree/master/src/messages

* rados messenger https://github.com/ceph/ceph/tree/master/src/msg

* Public access to RBD http://lists.ceph.com/pipermail/ceph-users-ceph.com/2014-April/019017.html

* Sharing hard drives with Ceph http://dachary.org/?p=2930

* patch par dachary pour simplifier : https://github.com/ceph/ceph/pull/1717

h3. vendredi 20140425

12h30 Labege http://www.lacoteetlarete.fr/

# Mehdi

# Joris

# Elie

# Lionel

# Laurent

* howto ubuntu http://redmine.the.re/projects/there/wiki/HOWTO_setup_OpenStack

* KVM debian rdb pb avec arm http://metadata.ftp-master.debian.org/changelogs//main/q/qemu/qemu_1.7.0+dfsg-9_changelog

* manifest enovance https://github.com/enovance/puppet-openstack-cloud

* BSD http://wiki.ceph.com/Planning/Blueprints/Emperor/Increasing_Ceph_portability

h3. mardi 20140902

9h 10 tricou, mehdi et laurent

<pre>

ceph osd tree

=> affiche les osd et devices

=> cat /proc/mounts pour voir ou c'est cree

ceph osd crush rule dump

=> regles

ceph osd pool get ssds min_size

=> repond ok apres min_size replica

ceph osd pool get ssds size

=> nb de replica

ceph -s

=> status du cluster

up => fonction

in => utilisé

pg = placement group

/etc/init.d/ceph stop osd 

=> simuler un arret

/etc/init.d/ceph stop osd.4

=> arret juste un disque

ceph osd set noout

ceph osd unset noout

=> desactive la replication automatique si on sait qu'on va couper une machine

rbp -p images import fichier_in fichier_dans_pool

=> ajout un pichier dans un pool ici images

rados lspools

=> liste des pools

rados -p disks ls

=> affiche les objets

ceph => osd/mon

rados => objets

rbd => block device

ceph osd dump -f json-pretty | grep ssd-cache -A39 -B1

</pre>

question a loic sur les placement groups

consideration reseau /etc/ceph/ceph.conf

<pre>

cluster_network = 192.168.3.0/24

# replication entre les osd

public_network = 192.168.3.0/24

mon_host = 192.168.3.101,192.168.3.102,192.168.3.103

# acces aux moniteurs + osd pour les clients

</pre>

<pre>

source os.conf

nova list 

nova list --fields host,networks,name

nova show VM

nova list --host g1 

neutron net-list

neutron port-list

/var/log/libvirt/livirtd.log

ovs-vsctl show

ovs-dpctl show

</pre>