RequestedCDTSoftware < DICE

DICE Web>ResearchAndTeachingUnit>RequestedCDTSoftware (01 Mar 2017, IainRae) (raw view)EditAttach
<!--
  This is a comment, in the HTML sense of the word, but Wiki directives still work, so you could put
  access control statements here to restrict access to your new topic, and they won't show up in the
  published page.
  Please think carefully when creating a new topic, and use a GoodWikiName.
  Remember that by default all Wiki content is world readable and editable unless you've taken steps
  to limit it.
-->

----+++ CDT Software requirements
----+++ Key

|*field*   | *purpose* |
| Software     |Software Package |
| * DICE Version* | Version currently available on DICE (SL6) |
| *Sl7 Version* | Version currently available on SL7 (and supporting repos) |
|*Latest SRPM* | Latest SRPM available anywhere|
|*Latest Version* |Latest *stable* version| 
|*Comments* |...|

|*colour*             | *meaning*                    |
|<b class="b">Unavailable</b> | No software in place |
|<b class="x">Feedback</x>|Awaiting feedback from requestors|
|<b class="r">Needs updating</f>| Upgrade to later version|
|<b class="g">Needs work</b> | needs tweaking |
|<b class="a">Signed off</b> | this is what will ship|


  <!-- colours for the above: --><style type="text/css">
   td .b{background-color:red;color:inherit;}td .g{background-color:orange;color:inherit;}
   td .a{background-color:lime;color:inherit;}td .r{background-color:pink;color:inherit;}
   td .x{background-color:black;color:white;}</style>



---++General Requirements
%EDITTABLE{buttonrow="top"}%
| * Software* | *SL6 Version* | *Sl7 Version* | *Latest SRPM* | *Latest Version* | *Comments* |
| <b class="g">[[http://hadoop.apache.org/][hadoop]]</b> | 0.20.0 | - | 2.4.1-6 | 2.7.1 | hadoop versioning is interesting. the old cluster was tied to 0.20.0 for teaching. It may be more sensible to ship our own unpackaged copies. Currently running  2.7.1 we need a component and to look at kerberiszed authentication CDT use has been minimal |
| <b class="a">kernel</b> | 2.6.32-431.23.3.el6.x86_64 | 3.10.0-123.20.1.el7.x86_64 | | | For Information|
| <b class="a">python</b> | 2.6.6/3.4.1 | 2.7.5 | 3.4.2 | 3.4.3 | |
| <b class="a">gcc</b> | 4.4.7 (4.9.1) | 4.8.2 | 4.9.2 | 4.9.2 | (scl version) |
| <b class="a">OpenCV</b> | | 2.4.5 | 3.0.0-1 | 3.0.0 | RT:70852 will bring up to 3.0.0 when it goes sitewide. |
| <b class="b">docker</b> | | | | | RT:70836  Largely stalled waiting KVM and related stuff (we want to use KVM to wrap the docker instances) |
| <b class="b">boot2docker</b> | | | | | RT:70836 as above. |
| <b class="g">gridengine</b> | 6.2u5-10 | 8.1.8-1 | 8.1.8-1 | 8.1.8-1 | (actually son of gridengine) component needs heavily revised, probably just use it to set up hosts and  user acls |





---++PPAR Requirements 
%EDITTABLE{buttonrow="top"}%
| * Software* | *SL6 Version* | *Sl7 Version* | *Latest SRPM* | *Latest Version* | *Comments* |
| <b class="a">[[https://www.haskell.org/platform][haskell-platform]]</b> | haskell-platform-2013.2.0.0 (7.6.3) | 2013.2.0.0 (7.6.3) | 2014.2.0.0.1-1.fc22 (ghc-7.8.3) | 2014.2.0.0  (ghc-7.8.3) | Latest srpms are in rawhide and unlikely to be stable until Fedora 22 |
| <b class="a">[[https://www.haskell.org/ghc/download][haskell]]</b> | ghc-7.6.3 | ghc-7.6.3 | ghc-7.8.4 | ghc-7.8.4 | We tend to run with the haskell-platform because it gives a nice stable platform for teaching it's not possible to site install multiple versions  of ghc. |
| <b class="a">[[http://www.cgal.org/][CGAL]]</b> | 4.0.2-1 | - | 4.5.1 | 4.5.2 | |
| <b class="a">[[https://networkx.github.io/][python-networkx]]</b> | 1.5-1 | 1.8.1 | 1.9.1 | 1.9.1 | using gduttons patented inf python stack for 1.9.1 |

---++Datascience Requirements
%EDITTABLE{buttonrow="top"}%
| * Software* | *SL6 Version* | *Sl7 Version* | *Latest SRPM* | *Latest Version* | *Comments* |
| <b class="a">Matlab</b> | R2015a | R2015a | R2015a | R2015a | Site license, we'd tend to want to keep the same version across all DICE |
| <b class="a">R</b> | 3.0.1 | 3.2.2 | 3.2.2 | 3.2.2 | We may wish to build a seperate version against openblas |
| <b class="a">iPython</b> | 1.1.0 | 3,2,1 | 3.2.1 | 2.3.0-1 / 2.4 | |
| <b class="b">Spark</b> | - | - | | 1.2.1 | requires hadoop |
| <b class="a">Theano</b> | 0.6 | 0.6 | - | 0.6 | |
| <b class="a">sklearn (python-scikit-learn)</b> | - | 0.16.1-0 | 0.15.2 | 0.15 | |
| <b class="a">SciPy</b> | 0.14.0 | 0.12.1 | 0.14.1 | 0.15.0 | |
| <b class="a">numpy</b> | 1.8.2 | 1.7.1 | 1.9.1 | 1.9.1 | |
| <b class="a">pandas</b> | 0.14.1 | 0.15.2-1 | 0.15.2 | 0.15.2 | |
| <b class="a">mathplotlib</b> | - | 1.3.1 | 1.3.1 (1.4.2) | 1.4.2 | 1.4.2 available for SuSe, build deps are evil |
| <b class="a">ATLAS</b> | 3.8.4 | 3.10.1 | 3.10.1 | 3.10.2 | |
| <b class="a">OpenBLas</b> | - | 0.2.13 | 0.2.13 | ? | |
| <b class="a">LApack</b> | 3.2.1 | 3.4.2 | 3.5.0 | 3.5.0 | |
| <b class="a">Postgresql</b> | 9.3.4 | 9.2.7 | 9.4.1 | 9.4.1 | |
| <b class="b">Storm</b> | - | - | - | 0.9.3 | requires hadoop |
| | | | | | |
| | | | | | |
| | | | | | |
| | | | | | |

---++DICE/Management Requirements
%EDITTABLE{buttonrow="top"}%
| * Software* | *SL6 Version* | *Sl7 Version* | *Latest SRPM* | *Latest Version* | *Comments* |
| <b class="g">nagios integration</b> | - | - | - | - | Some kind of nagios monitoring of cluster hardware and the software infrastructure somehow integrated with gridengine and or hadoop |
| <b class="b">openstack</b> | Grizzly/Icehouse | Juno | Kilo | Kilo | big can of worms |
| <b class="g">ganglia/too hot</b> | 3.1.7 | - | 3.6.0 | 3.6.1 | performance and "climate" monitoring (need to write a component) |
| <b class="g">gluster/shared filesystem</b> | 3.3.0 | 3.6.0 | 3.6.0(3.7.5) | 3.6.6/(3.7.5) | stable/(development) we need a shared filesystem to get gridengine working. We need to write a component to manage this |
| <b class="a">ipmi/consoles</b> | - | - | - | - | It just works |
----++Openstack

| *component* | *Description* | *Required* | *Availability* | *Dice tech*| *Comments*|
| Nova | Compute |  |  | | |
|Swift | Object Store |  |  | | |
|Cinder  | block storage |  |  | | |
|Neutron | Networking |  |  | | |
|Horizon| dashboard |  |  | | |
| Keystone  | Identity service |  |  | | |
| Glance| Image service |  |  | | |
|Ceilometer | Telemetry |  |  | | |
| Heat| Orchestration |  |  | | |
| Trove| Database |  |  | | |
| Ironic | Bare metal provisioning |  |  | | |
| Zaquar | Multiple tenant Cloud Messaging |  |  | | |
| Sahara | Elastic map Reduce |  |  | | |

-- Main.IainRae - 09 Feb 2015
Topic revision: r16 - 01 Mar 2017 - 10:19:45 - IainRae
DICE
This is WebLeftBar
Copyright © by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding TWiki? Send feedback
This Wiki uses Cookies