Last Update: 2019-06-19

Table of Contents

Major Themes
Planned Releases
Release Notes
Known Issues
Report Issues
Mailing list
Frequently Asked Questions
Why are there 2 ISOs available per product?
Beta Test Subscription and Registration Code
Private channel for sensitive data
Contact Beta Manager



SUSE Enterprise Storage is an intelligent software-defined storage solution, powered by Ceph Technology that enables IT to transform their enterprise storage infrastructure to deliver highly scalable and resilient storage that is cost-efficient and able to seamlessly adapt to changing business and data demands.

Following is an updated Enterprise Storage Ecosystem reflecting the targeted SUSE Enterprise Storage 6 enhancements.

The color Green indicates that the functionality meets the needs established by the existing Enterprise Storage Ecosystem.

Yellow indicates some functionality exists (or is a technical preview) but is not at the level required by the enterprise storage market.

The color Black indicates that the functionality is absent but will come in a future release.

Majors themes:

  • Built on the latest
  • Manageability
  • Interoperability
    • IPv6
    • TECH-PREVIEW: RDMA back-end
  • Availability
    • Sync to external cloud via S3
    • CephFS snapshots
    • TECH-PREVIEW: Asynchronous file replication
  • Efficienty
    • QoS for RDB
    • Background operation QoS
Planned Releases

Beta 8February 01, 2019
Beta 9February 14, 2019
Beta 10February 28, 2019
Beta 11March 15, 2019
Beta 12March 28, 2019
Beta 13April 12, 2019
Beta 14May 2, 2019
Beta 15May 17, 2019
GMCMay 23, 2019
GMC2June 19, 2019
GMEnd of May 2019



Please note that we reserve the right to change or adapt this schedule depending on various factors. Rest assured that we will communicate if there is any change to the plan.



SLES 15 SP1 GMC3 and SES 6 GMC2

We are offering SLES and SES DVD ISOS for the following architecture:

  • x86-64,
  • aarch64
Warning: SLES 15 SP1 Beta

You need to have a SLES 15 SP1 Beta to install and run SUSE Enterprise Storage 6 Beta. You can find more information on SUSE Linux Enterprise Server 15 SP1 Beta at:




Important: The following Documents are drafts.

And will remain as such throughout the SUSE Enterprise Storage Beta Program. Documentation on Beta Products do not yet have the quality, accuracy and content of our official documentation. However we will update these documents on the fly during the SUSE Enterprise Storage Beta Program.

Release Notes


The following changelogs include changes from all architectures:

SES 6 Beta 8:


SES 6 Beta9:


SES 6 Beta 10:


SES 6 Beta11:


SES 6 Beta12:


SES 6 Beta14:


SES 6 Beta15:






Known Issues

for GMC:


  • Upgrade from one Beta version to another Beta version (i.e. Beta 13 -> Beta 14) not supported
  • 1 nautilus mon + 1 luminous mon can’t automatically form quorum – see


  • Deployment Guide and Administration Guide are not yet up-to-date in all areas (e.g. iSCSI target management)


  • SES6 is based on Ceph Nautilus 14.2
  • ceph-volume’s lvmcache plugin does not work

Ceph Dashboard

  • Ceph Dashboard replaces openATTIC as the default management/monitoring UI
  • Known Issues/features under development
    • Under some circumstances DeepSea might not install the ceph-mgr-dashboard package – check if the package is really installed before trying to enable the dashboard
    • Administrator must manually set the Grafana URL in the dashboard via the “ceph dashboard set-grafana-api-url ” command, according to online docs here:
    • Issues with getting logged out of the dashboard immediately when there’s a time difference between backend and frontend: (not fixed in Nautilus/SES6 yet)
      • Manually apply the change posted at to the file `/usr/share/ceph/mgr/dashboard/services/` on all nodes running the dashboard (ceph-mgr role)
      • Restart the dashboard using `ceph mgr module disable dashboard; ceph mgr module enable dashboard`
      • Update the timestamp on admin’s password: `ceph dashboard ac-user-set-password admin `
      • Try to login again
    • The look and feel (branding) has now been adapted to match the SUSE CI – testing/feedback is welcome
    • The translations in languages other than English are still work in progress and therefore incomplete (missing translations will be shown in English)
    • No migration of oA user accounts during upgrade (not planned)
    • iSCSI Target management is now available through ceph-dashboard
      • The “iSCSI overview page” (tab) will not show any information about the gateways (please ignore this tab for now)
      • Creating iSCSI gateways using IPv6 addresses fails with an error: “gateway IP addresses provided do not match any ip on this host” –
    • Disabling SSL support on the dashboard does not change the TCP port the dashboard listens on:
    • Deleting a Ceph pool may fail with “pool deletion is disabled; you must first set the mon_allow_pool_delete config option to true” –
    • NFS-Ganesha Exports management is now available through ceph-dashboard
    • RadosGW Users and Bucket management is now available through ceph-dashboard (but may have to be set up manually in some situations)
    • Grafana Dashboard integration needs to be configured manually (installation/configuration of Prometheus/Grafana via DeepSea should work now)
    • Some of the Grafana metrics are not updating (“No data to show” or “No datapoints”) or are showing errors like “many-to-many matching not allowed: matching labels must be unique on one side” – an update for the dashboards is under review
    • Administrator must manually set the grafana api setting with “ceph dashboard set-grafana-api-url” –
  • General feedback on the Dashboard is very welcome: Do you miss any any key functionality when comparing the dashboard to openATTIC?
  • Feedback to any existing/visible functionality would be helpful, e.g.
    • Ceph Pool management
    • OSD management
    • RBD management
    • RGW management
    • NFS management
    • iSCSI management
    • Prometheus alerts
    • Grafana dashboards


    • If deepsea_minions is a compound target (e.g. ‘G@deepsea:*’) you will see “crc_method minion” failing in stage 0. This can be either ignored or fixed by running “salt state.apply ceph.salt.crc.minion”. M14 will fix this. Fixed
    • Starting with Beta 13 the policy.cfg must include role-storage for all storage nodes. cp
      • in the past this was done via the profile includes, which are no longer used
      • including profile-* is no longer necessary
    • Still under development
    • ceph.rebuild and ceph.migrate are being re-written and are not present up to now (2019-05-06)
    • Known issues:
      • Warning “Ignoring pillar stack template …” should be ignored
      • OSD deployment (can only deploy standalone OSDs)
        • Other OSD related tasks (report, purge, remove, …) do not work Fixed
      • ISCSI is disabled (iSCSI can be configured using lrbd)
      • ISCSI is enabled now but is currently broken (investigation will follow)
        • For now please remove the ‘role-igw’ from the policy.cfg
        • ISCSI deployments are fixed
        • iSCSI gateways are now managed by ceph-iscsi (no more lrbd) and thus configuration is done through “gwcli” tool (documentation not yet available)
        • Monitoring stack should work now
          • ~known bug where initial stage 2 run does not deploy monitoring stack. Workaround: re-run stage (fixed)
      • Ceph clusters currently come up in HEALTH_WARN with the warning “x monitors have not enabled msgr2”. Currently, the fix for this is to manually issue the command “ceph mon enable-msgr2”. If the the cluster starts to malfunction, messenger v2 can be disabled by setting `ms bind msgr2 = false` in the [global] section (and subsequently restarting the daemons).
      • To work around a major bug we are shipping special zypper packages in addition
      • Deploying nfs-ganesha should work now with Milestone 10
        • NOTE: please re-run “deepsea stage run ceph.stage.ganesha” or “salt-run state.orch ceph.stage.ganesha” after stage 4 to fix an issue with ganesha deployment
      • Dashboard will be activated automatically with stage.3 execution.
        • You can adapt the username and password by adding a ‘dashboard_username’ and ‘dashboard_password’ to the pillar.
        • If no user/password is provided it will use ‘admin’ and a random generated password that can be retrieved with:
        • salt -I roles:master grains.get dashboard_creds (proper documentation follows)
        • It will create the dashboard with a self signed certificate.
      • stage.0 will not place a crc_method to the salt configuration, supressing the CRC Warning messages seen since salt 2019.
      • the orchestrator is currently disabled
      • in some cases timeout issues on aarch64
      • Feedback welcome:
        • All roles
        • DeepSea CLI
        • Essentially everything besides the mentioned known-issues
        • Upgrade code is in place and can be experimented with
        • We added three new roles
          • role-grafana
          • role-prometheus
          • role-storage (explicite now)
          • Those can be applied as usual (in the policy.cfg)
          • We no longer deploy prometheus and grafana on _all_ nodes
      • There is a substantial change to the way a user defines osd layouts
        • We call it “Drive Groups” according to what upstream is heading to
        • For more information please refer to
      • NFS-Ganesha deployment (experienced a rework to accomodate the dashboard)

Whenever you find a bug or have a question while using SUSE Enterprise Storage, we highly recommend that you use our mailing list first, then if it really make sense you should open a bug report.

Mailing List is our dedicated Mailing List to discuss the SUSE Enterprise Storage Beta product. It is used by the SUSE Release Team to announce new beta images and technical information, as well as for general or technical questions, feedback, or defect reports related to SUSE Enterprise Storage Beta products from our beta testers base.

Only subscribers can post to our mailing lists. To subscribe, please go to

To see the collection of prior postings to the list, visit the storage-beta Archives.

Please refer to our Mailing Lists Guideline for more information.


Here are the links to the SUSE Enterprise Storage Bugzilla product that you will use for reporting the defects of the following products:

Please refer to our complete Bugzilla guideline for more information and before creating your first bug report: how to use Bugzilla


Frequently Asked Questions
        • Why are there 2 ISOs available per product?

          We offer 2 DVD ISOs for SUSE Enterprise Storage 6 Beta:

          • SUSE-Enterprise-Storage-6-DVD-x86_64-BetaX-DVD1.iso = DVD1 contains the binaries and the sources
          • SUSE-Enterprise-Storage-6-DVD-x86_64-BetaX-DVD2.iso = DVD2 the debuginfo packages


          For installation purposes you just need DVD 1 for your architecture. Please verify the sha256sum of the ISO using the SHA256SUMS file, which can also be found on the download page.

        • Beta Test Subscription and Registration Code



          Regular product subscription and registration code will not work with the beta products!

          Thus we will not provide a beta product subscription or beta product registration code by default for the SUSE Enterprise Storage 6 Beta Program. You should request one via, but we reserve the right to review your case and eventually provide one for your personal beta test.

          Without a beta registration code for SUSE Enterprise Storage 6 you won’t be able to access the online channels.

        • Private channel for sensitive data

          In case you are a SUSE partner or customer and would like to share some sensitive data with us (data for bug reports, feedbacks, etc), please contact us at, and we will review your case and provide you a private channel with us.

        • Contact Beta Manager

          For questions related to the beta test infrastructure, for example download issues or problems with reporting bugs or the mailing list, please write to